-- Logs begin at Tue 2022-07-05 19:55:57 UTC, end at Tue 2022-07-05 21:08:44 UTC. -- Jul 05 20:34:29.236260 dv-cinder-797608-49-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 05 20:34:29.243900 dv-cinder-797608-49-smb devstack@keystone.service[87122]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 05 20:34:29.248564 dv-cinder-797608-49-smb devstack@keystone.service[87122]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 5 20:34:29 2022] *** Jul 05 20:34:29.248564 dv-cinder-797608-49-smb devstack@keystone.service[87122]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 05 20:34:29.248564 dv-cinder-797608-49-smb devstack@keystone.service[87122]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 05 20:34:29.248564 dv-cinder-797608-49-smb devstack@keystone.service[87122]: nodename: dv-cinder-797608-49-smb Jul 05 20:34:29.248564 dv-cinder-797608-49-smb devstack@keystone.service[87122]: machine: x86_64 Jul 05 20:34:29.248564 dv-cinder-797608-49-smb devstack@keystone.service[87122]: clock source: unix Jul 05 20:34:29.248564 dv-cinder-797608-49-smb devstack@keystone.service[87122]: pcre jit disabled Jul 05 20:34:29.248564 dv-cinder-797608-49-smb devstack@keystone.service[87122]: detected number of CPU cores: 4 Jul 05 20:34:29.248564 dv-cinder-797608-49-smb devstack@keystone.service[87122]: current working directory: / Jul 05 20:34:29.248564 dv-cinder-797608-49-smb devstack@keystone.service[87122]: detected binary path: /usr/bin/uwsgi-core Jul 05 20:34:29.248564 dv-cinder-797608-49-smb devstack@keystone.service[87122]: your processes number limit is 47680 Jul 05 20:34:29.248564 dv-cinder-797608-49-smb devstack@keystone.service[87122]: your memory page size is 4096 bytes Jul 05 20:34:29.248564 dv-cinder-797608-49-smb devstack@keystone.service[87122]: detected max file descriptor number: 2048 Jul 05 20:34:29.248564 dv-cinder-797608-49-smb devstack@keystone.service[87122]: lock engine: pthread robust mutexes Jul 05 20:34:29.248564 dv-cinder-797608-49-smb devstack@keystone.service[87122]: thunder lock: enabled Jul 05 20:34:29.248564 dv-cinder-797608-49-smb devstack@keystone.service[87122]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 05 20:34:29.248564 dv-cinder-797608-49-smb devstack@keystone.service[87122]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 05 20:34:29.290211 dv-cinder-797608-49-smb devstack@keystone.service[87122]: Python main interpreter initialized at 0x563ab00769c0 Jul 05 20:34:29.290211 dv-cinder-797608-49-smb devstack@keystone.service[87122]: python threads support enabled Jul 05 20:34:29.290211 dv-cinder-797608-49-smb devstack@keystone.service[87122]: your server socket listen backlog is limited to 100 connections Jul 05 20:34:29.290211 dv-cinder-797608-49-smb devstack@keystone.service[87122]: your mercy for graceful operations on workers is 90 seconds Jul 05 20:34:29.290586 dv-cinder-797608-49-smb devstack@keystone.service[87122]: mapped 403077 bytes (393 KB) for 2 cores Jul 05 20:34:29.290665 dv-cinder-797608-49-smb devstack@keystone.service[87122]: *** Operational MODE: preforking *** Jul 05 20:34:29.290931 dv-cinder-797608-49-smb devstack@keystone.service[87122]: *** uWSGI is running in multiple interpreter mode *** Jul 05 20:34:29.290931 dv-cinder-797608-49-smb devstack@keystone.service[87122]: spawned uWSGI master process (pid: 87122) Jul 05 20:34:29.291137 dv-cinder-797608-49-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 05 20:34:29.291693 dv-cinder-797608-49-smb devstack@keystone.service[87122]: spawned uWSGI worker 1 (pid: 87151, cores: 1) Jul 05 20:34:29.292011 dv-cinder-797608-49-smb devstack@keystone.service[87122]: spawned uWSGI worker 2 (pid: 87152, cores: 1) Jul 05 20:34:29.292162 dv-cinder-797608-49-smb devstack@keystone.service[87122]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 05 20:34:34.666257 dv-cinder-797608-49-smb devstack@keystone.service[87152]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 20:34:34.666257 dv-cinder-797608-49-smb devstack@keystone.service[87152]: from cryptography.utils import int_from_bytes Jul 05 20:34:34.667049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 20:34:34.667049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: from cryptography.utils import int_from_bytes Jul 05 20:34:34.710292 dv-cinder-797608-49-smb devstack@keystone.service[87151]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 20:34:34.710292 dv-cinder-797608-49-smb devstack@keystone.service[87151]: from cryptography.utils import int_from_bytes Jul 05 20:34:34.710842 dv-cinder-797608-49-smb devstack@keystone.service[87151]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 05 20:34:34.710842 dv-cinder-797608-49-smb devstack@keystone.service[87151]: from cryptography.utils import int_from_bytes Jul 05 20:34:34.715362 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 05 20:34:34.715544 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 05 20:34:34.715799 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] command line args: [] {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 05 20:34:34.716106 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 05 20:34:34.716280 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ================================================================================ {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 05 20:34:34.716644 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] admin_token = **** {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.716913 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] config_dir = [] {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.717214 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.717372 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] config_source = [] {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.717583 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] debug = True {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.717739 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.719362 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.719362 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.719362 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.719362 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.719362 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] list_limit = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.719362 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] log_config_append = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.719362 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.719777 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] log_dir = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.719777 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] log_file = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.719887 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.720044 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.720309 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.720514 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.720716 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.720842 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.721105 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.721361 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.721513 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.721760 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.722004 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.722235 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.722475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.722714 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.722981 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.723470 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.723647 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] publish_errors = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.723870 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.724094 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.724270 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.724507 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.724734 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.724970 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] standard_threads = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.725179 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.725415 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.725586 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.725762 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] use_journal = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.725959 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] use_json = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.726131 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] use_stderr = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.726301 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] use_syslog = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.726526 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.726778 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.727013 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.727274 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.727510 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.727756 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.727990 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.728234 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.728465 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.728709 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.728952 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.729202 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.729431 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.729673 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.729928 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.730175 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.730417 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.730653 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.730904 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.731155 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.731395 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.731627 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.731874 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.732256 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.732508 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.732758 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.732987 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.733217 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.733445 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.733678 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.733949 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.734196 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.734423 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.734649 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.734888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.735129 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.736491 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.736491 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.736491 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.736491 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.736491 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.736491 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.737177 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.737177 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.737177 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.737492 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.737611 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.737770 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.738025 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.738251 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.738483 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.738713 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.738956 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.739181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.739413 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.739644 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.739874 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.740104 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.740335 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.740560 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.740803 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.741034 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.741266 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.741492 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.741747 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.742002 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.742228 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.742458 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.742689 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.742948 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.743183 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.743424 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.743664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.743893 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.744123 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.744351 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.744591 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.744822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.745053 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.745289 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.745518 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.745751 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.746002 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.746231 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.746459 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.746713 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.746948 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.747181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.747412 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.747744 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.747975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.748206 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.748436 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.748661 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.748885 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.749109 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.749338 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.749563 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.749796 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.750054 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.750297 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.750530 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.750779 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.751031 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.751266 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.751492 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] auth.external = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.751720 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.752012 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.752240 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.752474 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] auth.password = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.752700 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] auth.token = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.752933 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.753162 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.753403 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.753630 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.753893 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.754136 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.754360 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.754589 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] credential.caching = True {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.754831 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.755073 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.755315 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.755547 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.755788 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.756015 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.756272 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.756516 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 05 20:34:34.756635 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.756747 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 05 20:34:34.756939 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.757055 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] command line args: [] {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 05 20:34:34.757165 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.757280 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 05 20:34:34.757392 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.757504 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ================================================================================ {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 05 20:34:34.757624 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.757737 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] admin_token = **** {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.757866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.757980 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] config_dir = [] {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.758091 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.758202 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.758202 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] config_source = [] {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.758427 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.758540 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] debug = True {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.758658 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] federation.caching = True {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.758771 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.758917 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.759031 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.759147 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.759259 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.759376 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.759489 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.759598 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.759693 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.759787 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.759882 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] list_limit = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.759882 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] log_config_append = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.760064 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.760170 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.760266 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.760393 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] log_dir = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.760498 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.760602 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] log_file = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.760705 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.760818 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.760932 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.761044 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.761147 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.761264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.761376 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] identity.caching = True {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.761499 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.761499 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.761717 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.761835 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.762000 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.762117 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.762246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.762369 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.762483 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.762603 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.762706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.762817 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.762938 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.763050 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.763168 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.763273 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.763367 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.763462 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.763565 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.763663 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.763757 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.763757 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.763971 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.764084 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.764084 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.764310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.764407 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.764507 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] publish_errors = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.764611 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.764709 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.764709 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.764924 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.765044 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.765157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.765279 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.765399 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.765511 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.765629 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.765744 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] standard_threads = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.765874 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.766001 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.766121 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.766234 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.766352 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.766465 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.766568 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.766688 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] use_journal = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.766688 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] use_json = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.766901 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.767013 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] use_stderr = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.767125 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.767241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] use_syslog = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.767364 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.767477 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 05 20:34:34.767589 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.767701 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.767813 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.767926 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.768047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.768161 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.768272 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.768384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.768496 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.768608 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.768799 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.768925 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.769047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.769160 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.769272 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.769398 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.769517 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.769639 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.769753 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.769910 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.770027 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.770139 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.770252 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.770381 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.770496 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.770608 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.770729 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.770843 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.770955 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.771077 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.771191 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.771305 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.771418 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.771532 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.771645 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.771766 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.771880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.771880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.772092 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.772210 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.772323 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.772465 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.772588 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.772710 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.772825 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.772938 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.773051 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.773165 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.user = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.773277 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.773399 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.773514 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.773633 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.773747 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.773890 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.774007 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.774130 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.774244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.774357 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.774470 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.774583 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.774695 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.774816 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.774931 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.775043 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.775156 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.775270 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.775383 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.775504 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.775619 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.775732 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.775844 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.775975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.776091 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.776212 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.776334 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.776448 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.776560 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.776673 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.776786 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.776909 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.777024 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.777137 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.777253 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.777368 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.777480 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.777606 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.777721 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.777866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.777994 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.778109 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.778222 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.778346 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.778460 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.778573 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.778692 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.778806 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.778954 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.779079 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.779281 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.779396 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.779509 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.779622 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.779747 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.779862 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.779974 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.780087 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.780208 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.780322 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.780445 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.780559 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.780679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.780778 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.780874 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.780969 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.781073 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.781171 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.781268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.781382 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.781495 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.781608 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.781737 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.781871 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] resource.caching = True {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.781987 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.782100 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.782214 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.782327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.782524 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.782644 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.782766 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.782881 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.782994 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.783114 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.783227 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.783417 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.783536 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.783651 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.783764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.783877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.784001 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.784116 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.784230 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.784343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] role.caching = True {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.784343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] role.driver = sql {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.784556 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.784679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.784794 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.784907 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.785028 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.785146 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.785266 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.785389 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.785504 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.785617 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.785731 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.785908 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.786026 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.786154 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.786276 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.786390 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.786504 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.786623 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.786739 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.786861 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.786976 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.787088 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.787202 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.787318 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.787432 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.787554 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.787669 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.787784 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.787898 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.787898 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.788111 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.788233 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.788348 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.788445 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.788558 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.788655 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.788767 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.788890 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.788890 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.789103 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.789217 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.789329 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.789443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.789564 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.789687 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.789786 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.789898 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.789999 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.790095 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.790203 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.790301 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.790398 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.790494 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.790589 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.790685 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.790789 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.790789 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.790979 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.791075 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.791171 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.791266 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.791380 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.791478 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.791574 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.791670 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.791772 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.791877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.791974 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] auth.external = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.792070 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] token.caching = True {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.792173 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.792269 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.792365 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.792471 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.792569 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.792671 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.792768 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] auth.password = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.792863 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.792959 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] auth.token = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.793070 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.793168 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.793264 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.793359 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.793466 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.793564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.793668 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.793764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.793916 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.793916 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.794139 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.794254 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.794254 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.794509 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.794623 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.794737 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.794849 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.794962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.795113 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.795233 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] credential.caching = True {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.795406 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.795663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] database.connection = **** {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.795790 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.795914 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.796110 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.796231 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.796353 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.796468 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.796581 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.796695 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.796808 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.796922 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.797044 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.797158 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.797271 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.797385 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.797498 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.797615 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.797775 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.797913 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.798056 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.798336 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.798481 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.798611 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.798772 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.798892 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.799049 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.799208 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.799699 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.799906 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] federation.caching = True {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.800024 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.800139 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.800376 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.800495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.800609 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.800731 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.800847 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.800960 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.801180 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.801299 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.801415 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.801571 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87152) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 05 20:34:34.801736 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.802223 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.802676 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.803159 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.803606 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.804051 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.804319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] identity.caching = True {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.804577 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.804831 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.805070 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.805308 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.805561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.805794 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.806061 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.806316 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.806573 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.806802 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.807012 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.807248 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.807486 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.807731 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.807978 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.808232 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.808478 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.808765 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.809004 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.809243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.809482 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.809741 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.809997 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.810291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.810551 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.810792 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.811038 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.811270 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.811518 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.811765 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.812000 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.812246 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.812491 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.812721 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.812959 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.813187 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.813426 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.813662 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.813930 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.814168 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.814405 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.814652 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.814901 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.815130 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.815358 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.815605 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.815849 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.816084 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.816316 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.816550 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.816777 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.user = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.817013 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.817269 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.817499 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.817744 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.818013 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.818259 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.818491 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.818717 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.818949 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.819180 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.819414 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.819646 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.819888 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.820130 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.820373 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.820616 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.820858 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.821085 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.821328 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.821563 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.821807 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.822064 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.822296 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.822541 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.822788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.823031 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.823290 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.823520 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.823761 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.823998 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.824230 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.824467 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.824712 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.824950 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.825177 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.825408 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.825666 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] resource.caching = True {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.825937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.826187 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.826419 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.826663 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.826910 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.827142 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.827384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.827619 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.827855 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.828087 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] role.caching = True {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.828332 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] role.driver = sql {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.828563 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.828808 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.829054 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.829300 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.829557 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.829808 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.830078 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.830323 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.830570 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.830800 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.831046 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.831292 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.831536 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.831779 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.832485 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.832729 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.832977 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.833225 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.833472 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.833719 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.833975 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.834230 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.834481 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.834719 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.834852 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:34.834976 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:34.835090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.835203 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:34.835319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.835441 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.835627 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.835882 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.836132 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.836369 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.836603 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.836830 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.837064 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] token.caching = True {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.837298 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.837545 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.837782 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.838062 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.838311 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.838550 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.838796 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.839033 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.839282 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.839514 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.839760 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.839991 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.840235 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.840481 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.840709 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.840949 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.841242 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.841548 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] database.connection = **** {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.841794 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.842061 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.842301 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.842546 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.842780 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.843015 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.843248 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.843472 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:34.843593 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.843709 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.843934 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.844174 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.844406 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.844652 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.844886 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.845127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.845354 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.845589 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.845828 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 05 20:34:34.846018 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 05 20:34:34.871029 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:34.871255 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:34.871904 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:34.872136 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:34.872362 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:34.880979 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:34.898939 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:34.899163 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:34.937160 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.015285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.050959 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.051184 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.079797 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.080012 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.115605 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.115824 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.116039 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.116251 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.116443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.116651 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.121368 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.121594 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.121814 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.122055 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.122284 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.122490 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.142291 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.142766 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.142945 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.144058 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.144058 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.144058 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.144058 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.144560 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.144560 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.144847 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.144969 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.145160 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.145554 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.145764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.156334 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.156820 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.171509 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.171993 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.172141 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.172257 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.172324 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.172452 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.172666 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.172807 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.172896 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.173017 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.173099 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.173314 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87151) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.173439 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.173788 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87152) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 05 20:34:35.191636 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.191773 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 20:34:35.191936 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.192164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 20:34:35.192303 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.192499 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.192625 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 20:34:35.192704 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 05 20:34:35.192767 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.192901 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.192998 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.193192 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.193318 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.193397 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.193459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.193673 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.204454 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.204581 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.204710 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.204794 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.204984 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.205130 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.205215 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.205293 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.213471 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87151) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:34:35.213598 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:34:35.216768 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:34:35.216894 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87151) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:34:35.217022 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.217105 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.217306 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.217450 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.217588 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.217671 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.217866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.217990 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.218145 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.218230 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.218367 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.218492 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.218645 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.218726 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.218850 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.218940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.219137 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.219262 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.219347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.219436 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.245559 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.245871 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.247172 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:34:35.247443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.247585 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87151) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:34:35.247815 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.252697 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:34:35.252977 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.253100 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87151) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:34:35.253236 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.253337 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.253601 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.260566 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:34:35.260847 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.260970 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87151) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:34:35.261284 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.265404 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:34:35.265681 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.265804 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87151) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:34:35.265946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.266149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.266278 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.266415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.266496 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.266694 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.266820 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.266970 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.267052 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.267207 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.267330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.267480 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.267723 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.285678 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.285970 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.286487 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.286759 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.290460 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:34:35.291275 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87151) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:34:35.294241 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.294579 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.294974 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.295269 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.300035 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:34:35.300776 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87151) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:34:35.303647 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:34:35.304375 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87151) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:34:35.307267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.307552 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.307823 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.308087 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.308209 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.308340 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.308441 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.308638 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.308765 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.308975 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.309255 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.309529 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.327586 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:34:35.327862 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.328124 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.328378 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.328606 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87151) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:34:35.328874 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.329138 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.329412 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.336257 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.337316 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.338100 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.338272 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.339033 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.339317 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.341373 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:34:35.341659 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.341946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.342220 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.342507 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.342632 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87151) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:34:35.342788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.343087 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.343367 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.343640 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.355856 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:34:35.356126 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.356400 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.356672 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.356964 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87151) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:34:35.357102 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.357241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.357321 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.357528 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.357654 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.357790 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.358100 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.358378 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.358656 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.376555 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:34:35.376783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87151) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:34:35.379814 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:34:35.380111 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87151) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:34:35.383124 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.383430 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.384714 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.385078 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.386477 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:34:35.386744 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.386867 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87151) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:34:35.387006 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.387203 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.387446 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.394272 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.394763 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.395858 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:34:35.396663 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87151) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:34:35.399085 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.399357 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.399644 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.399911 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.402586 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.403016 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.403423 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.403858 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.409118 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:34:35.409392 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.409667 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.415779 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87151) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:34:35.416084 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.416360 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.417454 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87152) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:34:35.417728 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.418015 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.418284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.418539 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.418798 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.419051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.419420 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.419690 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.419958 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.420235 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.420494 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.420749 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.420999 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87152) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.424243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87151) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 05 20:34:35.424883 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.425159 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.425433 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.425703 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.425994 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.426283 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.426547 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.427886 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.428175 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.428464 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.428737 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.429012 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.429296 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87151) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 05 20:34:35.458787 dv-cinder-797608-49-smb devstack@keystone.service[87152]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563ab00769c0 pid: 87152 (default app) Jul 05 20:34:35.462113 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b419ca-e111-4df6-918b-447a2bfccb6d None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:35.462407 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b419ca-e111-4df6-918b-447a2bfccb6d None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:35.462684 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b419ca-e111-4df6-918b-447a2bfccb6d None None] PATH_INFO: `/v3` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:35.467022 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Tue Jul 5 20:34:35 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:34:35.467281 dv-cinder-797608-49-smb devstack@keystone.service[87151]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563ab00769c0 pid: 87151 (default app) Jul 05 20:34:43.075721 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f737d5-0b2a-480a-941e-8369c89d2281 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:43.076342 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f737d5-0b2a-480a-941e-8369c89d2281 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:43.076342 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f737d5-0b2a-480a-941e-8369c89d2281 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:43.077664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 2/2] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:34:43.087637 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef14b3-772d-404e-984b-c60f4f528baa None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:43.088674 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef14b3-772d-404e-984b-c60f4f528baa None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:43.089145 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef14b3-772d-404e-984b-c60f4f528baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:43.158035 dv-cinder-797608-49-smb devstack@keystone.service[87151]: INFO dbcounter [None req-9aef14b3-772d-404e-984b-c60f4f528baa None None] Registered counter for database keystone Jul 05 20:34:43.182753 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG oslo_db.sqlalchemy.engines [None req-9aef14b3-772d-404e-984b-c60f4f528baa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87151) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 20:34:43.190090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writer thread running {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 20:34:43.367301 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG passlib.handlers.bcrypt [None req-9aef14b3-772d-404e-984b-c60f4f528baa None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87151) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 05 20:34:43.367713 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG passlib.handlers.bcrypt [None req-9aef14b3-772d-404e-984b-c60f4f528baa None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87151) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 05 20:34:43.423011 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-9aef14b3-772d-404e-984b-c60f4f528baa None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:34:43.424950 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-9aef14b3-772d-404e-984b-c60f4f528baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:34:43.571614 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1/3] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:34:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 489 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 05 20:34:43.794934 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f737d5-0b2a-480a-941e-8369c89d2281 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:34:43.871129 dv-cinder-797608-49-smb devstack@keystone.service[87152]: INFO dbcounter [None req-50f737d5-0b2a-480a-941e-8369c89d2281 None None] Registered counter for database keystone Jul 05 20:34:43.893494 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG oslo_db.sqlalchemy.engines [None req-50f737d5-0b2a-480a-941e-8369c89d2281 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87152) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 05 20:34:43.904938 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writer thread running {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 05 20:34:44.023839 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f737d5-0b2a-480a-941e-8369c89d2281 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:34:44.031841 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb2a17-a7a5-499c-b0d6-af8dce4bfbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:34:44.032929 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb2a17-a7a5-499c-b0d6-af8dce4bfbe8 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:44.033398 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb2a17-a7a5-499c-b0d6-af8dce4bfbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:44.033891 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb2a17-a7a5-499c-b0d6-af8dce4bfbe8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:44.047161 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cb2a17-a7a5-499c-b0d6-af8dce4bfbe8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:34:44.099684 dv-cinder-797608-49-smb devstack@keystone.service[87152]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c2cb2a17-a7a5-499c-b0d6-af8dce4bfbe8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 05 20:34:44.100239 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cb2a17-a7a5-499c-b0d6-af8dce4bfbe8 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:34:44.110684 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 3/4] 10.222.0.27 () {58 vars in 1324 bytes} [Tue Jul 5 20:34:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 20:34:44.117885 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef14b3-772d-404e-984b-c60f4f528baa None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:34:44.140778 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef14b3-772d-404e-984b-c60f4f528baa None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:34:44.146155 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b3005-fe2f-4f4e-9e1c-b3e3f333ff2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:34:44.147287 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b3005-fe2f-4f4e-9e1c-b3e3f333ff2d admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:44.147570 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b3005-fe2f-4f4e-9e1c-b3e3f333ff2d admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:44.147847 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b3005-fe2f-4f4e-9e1c-b3e3f333ff2d admin admin] PATH_INFO: `/v3/projects/d2d267a59c9249019ee131b3dae58a6e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:44.149654 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b3005-fe2f-4f4e-9e1c-b3e3f333ff2d admin admin] RBAC: Authorizing `identity:get_project(project_id=d2d267a59c9249019ee131b3dae58a6e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:34:44.201885 dv-cinder-797608-49-smb devstack@keystone.service[87151]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ff1b3005-fe2f-4f4e-9e1c-b3e3f333ff2d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 05 20:34:44.202265 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b3005-fe2f-4f4e-9e1c-b3e3f333ff2d admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:34:44.206903 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 2/5] 10.222.0.27 () {56 vars in 1207 bytes} [Tue Jul 5 20:34:44 2022] GET /identity/v3/projects/d2d267a59c9249019ee131b3dae58a6e => generated 344 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:34:46.188163 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc28f6-850e-4f0d-a315-fbcf37650756 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:46.188683 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc28f6-850e-4f0d-a315-fbcf37650756 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:46.188683 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc28f6-850e-4f0d-a315-fbcf37650756 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:46.192886 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 4/6] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:34:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:34:46.199597 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c183b2-ece6-4834-be7e-e16411dd1d06 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:46.200290 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c183b2-ece6-4834-be7e-e16411dd1d06 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:46.200428 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c183b2-ece6-4834-be7e-e16411dd1d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:46.225715 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-47c183b2-ece6-4834-be7e-e16411dd1d06 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:34:46.227258 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-47c183b2-ece6-4834-be7e-e16411dd1d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:34:46.236519 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 3/7] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:34:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 05 20:34:46.258568 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc28f6-850e-4f0d-a315-fbcf37650756 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:34:46.273078 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc28f6-850e-4f0d-a315-fbcf37650756 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:34:46.278557 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0422a-767e-4d7f-8bd0-7ac42af7beb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:34:46.279234 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0422a-767e-4d7f-8bd0-7ac42af7beb1 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:46.279513 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0422a-767e-4d7f-8bd0-7ac42af7beb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:46.279786 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0422a-767e-4d7f-8bd0-7ac42af7beb1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:46.288435 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0422a-767e-4d7f-8bd0-7ac42af7beb1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:34:46.290261 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0422a-767e-4d7f-8bd0-7ac42af7beb1 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:34:46.299190 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 5/8] 10.222.0.27 () {58 vars in 1324 bytes} [Tue Jul 5 20:34:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 20:34:46.304727 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c183b2-ece6-4834-be7e-e16411dd1d06 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:34:46.313882 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c183b2-ece6-4834-be7e-e16411dd1d06 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:34:46.320011 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020ff1c-5784-4e1e-9305-ced02361f4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:34:46.320879 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020ff1c-5784-4e1e-9305-ced02361f4d4 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:46.321157 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020ff1c-5784-4e1e-9305-ced02361f4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:46.321436 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020ff1c-5784-4e1e-9305-ced02361f4d4 admin admin] PATH_INFO: `/v3/users/0aa59f315d9f4ee3a1a7a51f7ef6b880` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:46.322969 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8020ff1c-5784-4e1e-9305-ced02361f4d4 admin admin] RBAC: Authorizing `identity:get_user(user_id=0aa59f315d9f4ee3a1a7a51f7ef6b880)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:34:46.324822 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8020ff1c-5784-4e1e-9305-ced02361f4d4 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:34:46.326457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 4/9] 10.222.0.27 () {56 vars in 1198 bytes} [Tue Jul 5 20:34:46 2022] GET /identity/v3/users/0aa59f315d9f4ee3a1a7a51f7ef6b880 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:34:48.369438 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725c4c8-d41a-4e63-90ed-404af6c4a997 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:48.370030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725c4c8-d41a-4e63-90ed-404af6c4a997 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:48.370277 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725c4c8-d41a-4e63-90ed-404af6c4a997 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:48.371657 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 6/10] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:34:48.377404 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517478a-b475-4cef-af13-798b6297582f None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:48.377891 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517478a-b475-4cef-af13-798b6297582f None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:48.378145 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517478a-b475-4cef-af13-798b6297582f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:48.400329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-7517478a-b475-4cef-af13-798b6297582f None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:34:48.401454 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-7517478a-b475-4cef-af13-798b6297582f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:34:48.408941 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75002deb-465e-4e0e-9d65-8f88bb9026c7 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:48.409231 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75002deb-465e-4e0e-9d65-8f88bb9026c7 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:48.409503 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75002deb-465e-4e0e-9d65-8f88bb9026c7 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:48.410862 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 7/11] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:34:48.415688 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79389501-c776-4a1a-a886-5772682b69a0 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:48.415974 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79389501-c776-4a1a-a886-5772682b69a0 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:48.416245 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79389501-c776-4a1a-a886-5772682b69a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:48.457211 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG passlib.handlers.bcrypt [None req-79389501-c776-4a1a-a886-5772682b69a0 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87152) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 05 20:34:48.457877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG passlib.handlers.bcrypt [None req-79389501-c776-4a1a-a886-5772682b69a0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87152) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 05 20:34:48.494536 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 5/12] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:34:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:34:48.502988 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-79389501-c776-4a1a-a886-5772682b69a0 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:34:48.504592 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-79389501-c776-4a1a-a886-5772682b69a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:34:48.517657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517478a-b475-4cef-af13-798b6297582f None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:34:48.542760 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:34:48.605117 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 8/13] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:34:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:34:48.624782 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517478a-b475-4cef-af13-798b6297582f None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:34:48.626653 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79389501-c776-4a1a-a886-5772682b69a0 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:34:48.659323 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a4ab9-8665-459e-ac4f-1a8ab37b81de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:34:48.660057 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a4ab9-8665-459e-ac4f-1a8ab37b81de None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:48.660336 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a4ab9-8665-459e-ac4f-1a8ab37b81de None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:48.660614 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a4ab9-8665-459e-ac4f-1a8ab37b81de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:48.671863 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a4ab9-8665-459e-ac4f-1a8ab37b81de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:34:48.686243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-933a4ab9-8665-459e-ac4f-1a8ab37b81de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:34:48.686243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:34:48.686243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:34:48.686243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:34:48.686243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:34:48.686243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:34:48.686243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:34:48.686243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:34:48.686243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:34:48.686243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:34:48.686243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:34:48.686243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:34:48.686243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:34:48.686243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:34:48.686243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:34:48.686243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:34:48.687186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:34:48.687186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:34:48.687186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:34:48.687186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:34:48.687186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:34:48.687186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:34:48.687186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:34:48.687186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:34:48.687186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:34:48.687186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:34:48.687186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:34:48.687186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:34:48.687186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:34:48.687186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:34:48.687186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:34:48.687186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:34:48.688015 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:34:48.688015 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:34:48.688015 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:34:48.688015 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:34:48.688015 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:34:48.688015 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:34:48.688015 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:34:48.688015 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:34:48.688015 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:34:48.688015 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:34:48.688015 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:34:48.688015 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:34:48.688015 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 6/14] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 5 20:34:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:34:48.693634 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a4ab9-8665-459e-ac4f-1a8ab37b81de None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:34:48.733077 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79389501-c776-4a1a-a886-5772682b69a0 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:34:48.739781 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:34:48.777237 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91b2d3-3699-4553-9804-eedab2d5f216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:34:48.778187 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91b2d3-3699-4553-9804-eedab2d5f216 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:48.778471 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91b2d3-3699-4553-9804-eedab2d5f216 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:48.778742 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91b2d3-3699-4553-9804-eedab2d5f216 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:48.780242 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:34:48.801105 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a4ab9-8665-459e-ac4f-1a8ab37b81de None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:34:48.834311 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820fb14-1698-466f-bbdd-ff21ad118467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:34:48.834981 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820fb14-1698-466f-bbdd-ff21ad118467 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:48.835257 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820fb14-1698-466f-bbdd-ff21ad118467 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:48.835525 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820fb14-1698-466f-bbdd-ff21ad118467 None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:48.836685 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820fb14-1698-466f-bbdd-ff21ad118467 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:34:48.836991 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820fb14-1698-466f-bbdd-ff21ad118467 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:34:48.838437 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820fb14-1698-466f-bbdd-ff21ad118467 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:34:48.850066 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 7/15] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:34:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:34:48.853103 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91b2d3-3699-4553-9804-eedab2d5f216 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:34:48.854657 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91b2d3-3699-4553-9804-eedab2d5f216 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:34:48.855581 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820fb14-1698-466f-bbdd-ff21ad118467 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:34:48.951954 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820fb14-1698-466f-bbdd-ff21ad118467 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:34:48.952659 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 9/16] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:34:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 20:34:48.958303 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91b2d3-3699-4553-9804-eedab2d5f216 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:34:48.961183 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:34:48.986044 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7be881-fea3-40da-babc-a9dda7698c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:34:48.986923 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7be881-fea3-40da-babc-a9dda7698c71 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:48.987202 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7be881-fea3-40da-babc-a9dda7698c71 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:48.987472 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7be881-fea3-40da-babc-a9dda7698c71 None admin] PATH_INFO: `/v3/users/0aa59f315d9f4ee3a1a7a51f7ef6b880` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:48.988661 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7be881-fea3-40da-babc-a9dda7698c71 None admin] RBAC: Authorizing `identity:get_user(user_id=0aa59f315d9f4ee3a1a7a51f7ef6b880)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:34:48.990176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7be881-fea3-40da-babc-a9dda7698c71 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:34:48.991851 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 8/17] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:34:48 2022] GET /identity/v3/users/0aa59f315d9f4ee3a1a7a51f7ef6b880 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:34:48.997467 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7be881-fea3-40da-babc-a9dda7698c71 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:34:49.012005 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:34:49.054933 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91b2d3-3699-4553-9804-eedab2d5f216 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:34:49.090877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e0f19-4e79-4dca-b451-af84e3d9063d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:34:49.091749 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e0f19-4e79-4dca-b451-af84e3d9063d None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:49.092025 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e0f19-4e79-4dca-b451-af84e3d9063d None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:49.092293 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e0f19-4e79-4dca-b451-af84e3d9063d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:49.099915 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7be881-fea3-40da-babc-a9dda7698c71 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:34:49.111330 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e0f19-4e79-4dca-b451-af84e3d9063d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:34:49.112811 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e0f19-4e79-4dca-b451-af84e3d9063d None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:34:49.135294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-ff5e0f19-4e79-4dca-b451-af84e3d9063d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:34:49.135294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:34:49.135294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:34:49.135294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:34:49.135294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:34:49.135294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:34:49.135294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:34:49.135294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:34:49.135294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:34:49.135294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:34:49.135294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:34:49.135294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:34:49.135294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:34:49.135294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:34:49.135294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:34:49.136172 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:34:49.136172 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:34:49.136172 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:34:49.136172 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:34:49.136172 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:34:49.136172 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:34:49.136172 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:34:49.136172 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:34:49.136172 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:34:49.136172 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:34:49.136172 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:34:49.136172 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:34:49.136172 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:34:49.136172 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:34:49.136172 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:34:49.136172 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:34:49.136172 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:34:49.137184 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:34:49.137184 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:34:49.137184 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:34:49.137184 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:34:49.137184 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 10/18] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:34:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:34:49.137741 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55323038-ff2b-4cc4-aeaf-9d3082226cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:34:49.138846 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55323038-ff2b-4cc4-aeaf-9d3082226cbf None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:49.139113 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55323038-ff2b-4cc4-aeaf-9d3082226cbf None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:49.139389 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55323038-ff2b-4cc4-aeaf-9d3082226cbf None admin] PATH_INFO: `/v3/domains/default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:49.141811 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55323038-ff2b-4cc4-aeaf-9d3082226cbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:34:49.142311 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e0f19-4e79-4dca-b451-af84e3d9063d None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:34:49.143398 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55323038-ff2b-4cc4-aeaf-9d3082226cbf None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:34:49.145043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 9/19] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:34:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:34:49.150981 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55323038-ff2b-4cc4-aeaf-9d3082226cbf None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:34:49.199871 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:34:49.232893 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:34:49.245139 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e0f19-4e79-4dca-b451-af84e3d9063d None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:34:49.252333 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55323038-ff2b-4cc4-aeaf-9d3082226cbf None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:34:49.278802 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1d155-92af-4215-b6b1-c47b83c04b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:34:49.279488 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1d155-92af-4215-b6b1-c47b83c04b09 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:49.279787 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1d155-92af-4215-b6b1-c47b83c04b09 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:49.280059 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1d155-92af-4215-b6b1-c47b83c04b09 None admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:49.280795 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1d155-92af-4215-b6b1-c47b83c04b09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:34:49.281089 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1d155-92af-4215-b6b1-c47b83c04b09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:34:49.282532 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1d155-92af-4215-b6b1-c47b83c04b09 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:34:49.285080 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed44a6-b4d2-48e9-a7bf-88bd1d98a75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:34:49.285730 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed44a6-b4d2-48e9-a7bf-88bd1d98a75d None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:49.286037 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed44a6-b4d2-48e9-a7bf-88bd1d98a75d None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:49.286309 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed44a6-b4d2-48e9-a7bf-88bd1d98a75d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:49.287148 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ed44a6-b4d2-48e9-a7bf-88bd1d98a75d None admin] RBAC: Adding query filter params (role.id=37ba4a62052348d4811b560c19a07e02, scope.domain.id=default, user.id=0aa59f315d9f4ee3a1a7a51f7ef6b880) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:34:49.287452 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ed44a6-b4d2-48e9-a7bf-88bd1d98a75d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:34:49.288883 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ed44a6-b4d2-48e9-a7bf-88bd1d98a75d None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:34:49.295661 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 10/20] 10.222.0.27 () {56 vars in 1322 bytes} [Tue Jul 5 20:34:49 2022] GET /identity/v3/role_assignments?user.id=0aa59f315d9f4ee3a1a7a51f7ef6b880&scope.domain.id=default&role.id=37ba4a62052348d4811b560c19a07e02 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:34:49.300479 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 11/21] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:34:51.707497 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eec435-c02d-4208-80d1-abe4c7895e65 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:51.708560 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eec435-c02d-4208-80d1-abe4c7895e65 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:51.709060 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eec435-c02d-4208-80d1-abe4c7895e65 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:51.710744 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 11/22] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:34:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:34:51.716325 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c1b2d-3fc7-4810-a648-f728857c43ed None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:51.717161 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c1b2d-3fc7-4810-a648-f728857c43ed None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:51.717635 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c1b2d-3fc7-4810-a648-f728857c43ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:51.751177 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-dc0c1b2d-3fc7-4810-a648-f728857c43ed None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:34:51.752723 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-dc0c1b2d-3fc7-4810-a648-f728857c43ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:34:51.855854 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 12/23] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:34:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:34:51.883062 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff52fb6-8343-4503-a5a7-31aba991eba3 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:51.883653 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff52fb6-8343-4503-a5a7-31aba991eba3 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:51.884126 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff52fb6-8343-4503-a5a7-31aba991eba3 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:51.885730 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 12/24] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:34:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:34:51.891021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd9952-7234-4276-b273-993ca318c823 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:51.891516 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd9952-7234-4276-b273-993ca318c823 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:51.891975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd9952-7234-4276-b273-993ca318c823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:51.907603 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff52fb6-8343-4503-a5a7-31aba991eba3 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:34:51.925993 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-b7fd9952-7234-4276-b273-993ca318c823 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:34:51.927667 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-b7fd9952-7234-4276-b273-993ca318c823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:34:52.014295 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:34:52.061631 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 13/25] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:34:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:34:52.063044 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af7f57-d496-42a2-ada1-46d1dc01f474 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:52.063332 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af7f57-d496-42a2-ada1-46d1dc01f474 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:52.063607 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af7f57-d496-42a2-ada1-46d1dc01f474 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:52.064886 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 14/26] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:34:52.072345 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b093b-87ce-450c-a5dc-9c9b8a18909f None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:52.072625 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b093b-87ce-450c-a5dc-9c9b8a18909f None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:52.072900 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b093b-87ce-450c-a5dc-9c9b8a18909f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:52.102137 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff52fb6-8343-4503-a5a7-31aba991eba3 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:34:52.104539 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-c18b093b-87ce-450c-a5dc-9c9b8a18909f None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:34:52.105767 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-c18b093b-87ce-450c-a5dc-9c9b8a18909f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:34:52.150686 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e531f-925b-4270-abcb-cb38d86c9a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:34:52.151514 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e531f-925b-4270-abcb-cb38d86c9a2e None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:52.151796 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e531f-925b-4270-abcb-cb38d86c9a2e None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:52.152070 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e531f-925b-4270-abcb-cb38d86c9a2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:52.166311 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507e531f-925b-4270-abcb-cb38d86c9a2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:34:52.175537 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-507e531f-925b-4270-abcb-cb38d86c9a2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:34:52.175537 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:34:52.175537 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:34:52.175537 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:34:52.175537 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:34:52.175537 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:34:52.175537 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:34:52.175537 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:34:52.175537 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:34:52.175537 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:34:52.175537 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:34:52.175537 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:34:52.175537 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:34:52.175537 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:34:52.175537 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:34:52.175537 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:34:52.176673 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:34:52.176673 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:34:52.176673 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:34:52.176673 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:34:52.176673 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:34:52.176673 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:34:52.176673 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:34:52.176673 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:34:52.176673 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:34:52.176673 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:34:52.176673 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:34:52.176673 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:34:52.176673 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:34:52.176673 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:34:52.176673 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:34:52.176673 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:34:52.177610 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:34:52.177610 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:34:52.177610 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:34:52.177610 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:34:52.177610 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:34:52.177610 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:34:52.177610 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:34:52.177610 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:34:52.177610 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:34:52.177610 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:34:52.177610 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:34:52.177610 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:34:52.180119 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 13/27] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 5 20:34:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:34:52.181257 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e531f-925b-4270-abcb-cb38d86c9a2e None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:34:52.186253 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:34:52.193309 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 15/28] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:34:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:34:52.194881 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ec18c-af35-4959-acb6-d2601e406954 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:52.195311 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ec18c-af35-4959-acb6-d2601e406954 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:52.195729 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ec18c-af35-4959-acb6-d2601e406954 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:52.197143 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 16/29] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:34:52.201947 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ec18c-af35-4959-acb6-d2601e406954 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:34:52.299590 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e531f-925b-4270-abcb-cb38d86c9a2e None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:34:52.319019 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ec18c-af35-4959-acb6-d2601e406954 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:34:52.326695 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:34:52.336846 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e7c45-3620-436e-be9c-dae17c678385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:34:52.337825 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e7c45-3620-436e-be9c-dae17c678385 None admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:52.338351 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e7c45-3620-436e-be9c-dae17c678385 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:52.338777 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e7c45-3620-436e-be9c-dae17c678385 None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:52.339680 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e7c45-3620-436e-be9c-dae17c678385 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:34:52.341339 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e7c45-3620-436e-be9c-dae17c678385 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:34:52.357209 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d88de-f3ee-4ef0-b085-4590e405cb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:34:52.358382 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d88de-f3ee-4ef0-b085-4590e405cb3c None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:52.358806 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d88de-f3ee-4ef0-b085-4590e405cb3c None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:52.359264 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d88de-f3ee-4ef0-b085-4590e405cb3c None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:52.360224 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d88de-f3ee-4ef0-b085-4590e405cb3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:34:52.360674 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d88de-f3ee-4ef0-b085-4590e405cb3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:34:52.362412 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d88de-f3ee-4ef0-b085-4590e405cb3c None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:34:52.377037 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 17/30] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:34:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:34:52.378598 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156846d-3d20-4123-865a-10a9b761638e None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:52.379112 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156846d-3d20-4123-865a-10a9b761638e None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:52.379575 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156846d-3d20-4123-865a-10a9b761638e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:52.397211 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-e156846d-3d20-4123-865a-10a9b761638e None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:34:52.398792 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-e156846d-3d20-4123-865a-10a9b761638e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:34:52.467769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 14/31] 10.222.0.27 () {60 vars in 1131 bytes} [Tue Jul 5 20:34:52 2022] POST /identity/v3/roles => generated 225 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:34:52.469188 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e7c45-3620-436e-be9c-dae17c678385 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:34:52.472365 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 18/32] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:34:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:34:52.477965 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156846d-3d20-4123-865a-10a9b761638e None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:34:52.561670 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:34:52.605858 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e7c45-3620-436e-be9c-dae17c678385 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:34:52.606194 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:34:52.612042 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156846d-3d20-4123-865a-10a9b761638e None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:34:52.643939 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615a49d-8505-4149-a6fa-538130f0e413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:34:52.645093 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615a49d-8505-4149-a6fa-538130f0e413 None admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:52.645571 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615a49d-8505-4149-a6fa-538130f0e413 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:52.646087 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615a49d-8505-4149-a6fa-538130f0e413 None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:52.647037 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5615a49d-8505-4149-a6fa-538130f0e413 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:34:52.648772 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5615a49d-8505-4149-a6fa-538130f0e413 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:34:52.657312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366b56c-4319-49a7-9be0-62f4276d3c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:34:52.658261 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366b56c-4319-49a7-9be0-62f4276d3c0c None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:52.658533 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366b56c-4319-49a7-9be0-62f4276d3c0c None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:52.658803 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366b56c-4319-49a7-9be0-62f4276d3c0c None admin] PATH_INFO: `/v3/users/0aa59f315d9f4ee3a1a7a51f7ef6b880` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:52.660581 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7366b56c-4319-49a7-9be0-62f4276d3c0c None admin] RBAC: Authorizing `identity:get_user(user_id=0aa59f315d9f4ee3a1a7a51f7ef6b880)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:34:52.662093 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7366b56c-4319-49a7-9be0-62f4276d3c0c None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:34:52.663797 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 19/33] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:34:52 2022] GET /identity/v3/users/0aa59f315d9f4ee3a1a7a51f7ef6b880 => generated 247 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:34:52.664559 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366b56c-4319-49a7-9be0-62f4276d3c0c None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:34:52.666773 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 15/34] 10.222.0.27 () {60 vars in 1131 bytes} [Tue Jul 5 20:34:52 2022] POST /identity/v3/roles => generated 219 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:34:52.675330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615a49d-8505-4149-a6fa-538130f0e413 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:34:52.780188 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366b56c-4319-49a7-9be0-62f4276d3c0c None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:34:52.818132 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530164f-8d90-44d5-9361-f0a46c08542e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:34:52.818861 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530164f-8d90-44d5-9361-f0a46c08542e None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:52.819139 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530164f-8d90-44d5-9361-f0a46c08542e None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:52.819412 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530164f-8d90-44d5-9361-f0a46c08542e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:52.831522 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530164f-8d90-44d5-9361-f0a46c08542e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:34:52.833340 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530164f-8d90-44d5-9361-f0a46c08542e None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:34:52.848084 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615a49d-8505-4149-a6fa-538130f0e413 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:34:52.852259 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-a530164f-8d90-44d5-9361-f0a46c08542e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:34:52.852259 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:34:52.852259 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:34:52.852259 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:34:52.852259 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:34:52.852259 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:34:52.852259 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:34:52.852259 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:34:52.852259 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:34:52.852259 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:34:52.852259 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:34:52.852259 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:34:52.852259 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:34:52.852259 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:34:52.852259 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:34:52.853068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:34:52.853068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:34:52.853068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:34:52.853068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:34:52.853068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:34:52.853068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:34:52.853068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:34:52.853068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:34:52.853068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:34:52.853068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:34:52.853068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:34:52.853068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:34:52.853068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:34:52.853068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:34:52.853068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:34:52.853068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:34:52.853068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:34:52.853892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:34:52.853892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:34:52.853892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:34:52.853892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:34:52.853892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 20/35] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:34:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:34:52.860330 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530164f-8d90-44d5-9361-f0a46c08542e None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:34:52.884062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:34:52.891378 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:34:52.916067 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794ca08-e036-4333-bf65-ed2a2b8dadf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:34:52.916738 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794ca08-e036-4333-bf65-ed2a2b8dadf2 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:52.917029 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794ca08-e036-4333-bf65-ed2a2b8dadf2 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:52.917387 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794ca08-e036-4333-bf65-ed2a2b8dadf2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:52.918624 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794ca08-e036-4333-bf65-ed2a2b8dadf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:34:52.920180 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794ca08-e036-4333-bf65-ed2a2b8dadf2 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:34:52.921833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 16/36] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:34:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:34:52.928284 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794ca08-e036-4333-bf65-ed2a2b8dadf2 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:34:52.981915 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530164f-8d90-44d5-9361-f0a46c08542e None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:34:53.021515 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876a1d2-74b6-4b51-853a-79fe297a1059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:34:53.022535 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876a1d2-74b6-4b51-853a-79fe297a1059 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:53.022954 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876a1d2-74b6-4b51-853a-79fe297a1059 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:53.023359 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876a1d2-74b6-4b51-853a-79fe297a1059 None admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:53.024240 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876a1d2-74b6-4b51-853a-79fe297a1059 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:34:53.024700 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876a1d2-74b6-4b51-853a-79fe297a1059 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:34:53.026319 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876a1d2-74b6-4b51-853a-79fe297a1059 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:34:53.040736 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 21/37] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:34:53.042356 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964d6fd-8bd1-4c34-bb91-8a58ebc41768 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:53.042813 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964d6fd-8bd1-4c34-bb91-8a58ebc41768 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:53.043252 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964d6fd-8bd1-4c34-bb91-8a58ebc41768 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:53.045459 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 22/38] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:34:53.048134 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964d6fd-8bd1-4c34-bb91-8a58ebc41768 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:34:53.050990 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794ca08-e036-4333-bf65-ed2a2b8dadf2 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:34:53.101810 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343d0ab-6634-4adb-a8e1-86995f09b72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:34:53.103026 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343d0ab-6634-4adb-a8e1-86995f09b72b None admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:53.103499 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343d0ab-6634-4adb-a8e1-86995f09b72b None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:53.103940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343d0ab-6634-4adb-a8e1-86995f09b72b None admin] PATH_INFO: `/v3/domains/default/users/0aa59f315d9f4ee3a1a7a51f7ef6b880/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:53.106271 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343d0ab-6634-4adb-a8e1-86995f09b72b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0aa59f315d9f4ee3a1a7a51f7ef6b880, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:34:53.108186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343d0ab-6634-4adb-a8e1-86995f09b72b None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:34:53.127505 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 17/39] 10.222.0.27 () {58 vars in 1361 bytes} [Tue Jul 5 20:34:52 2022] PUT /identity/v3/domains/default/users/0aa59f315d9f4ee3a1a7a51f7ef6b880/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:34:53.129096 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40789d-212d-42e6-9145-b94a24cc0ddb None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:53.129383 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40789d-212d-42e6-9145-b94a24cc0ddb None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:53.129661 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40789d-212d-42e6-9145-b94a24cc0ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:53.162887 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:34:53.164298 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-1e40789d-212d-42e6-9145-b94a24cc0ddb None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:34:53.166165 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-1e40789d-212d-42e6-9145-b94a24cc0ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:34:53.189946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964d6fd-8bd1-4c34-bb91-8a58ebc41768 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:34:53.223780 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:34:53.232131 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2449c3-d50f-4571-8751-3be7d4e1ab4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:34:53.232825 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2449c3-d50f-4571-8751-3be7d4e1ab4e None admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:53.233109 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2449c3-d50f-4571-8751-3be7d4e1ab4e None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:53.233382 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2449c3-d50f-4571-8751-3be7d4e1ab4e None admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:53.234171 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2449c3-d50f-4571-8751-3be7d4e1ab4e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:34:53.236481 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2449c3-d50f-4571-8751-3be7d4e1ab4e None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:34:53.247643 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 18/40] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:34:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:34:53.274259 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40789d-212d-42e6-9145-b94a24cc0ddb None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:34:53.378780 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 23/41] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Jul 5 20:34:53 2022] POST /identity/v3/projects => generated 301 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:34:53.380405 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bbb53-aaba-43af-b7e6-87bc0e53c03d None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:53.380701 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bbb53-aaba-43af-b7e6-87bc0e53c03d None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:53.380984 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bbb53-aaba-43af-b7e6-87bc0e53c03d None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:53.382479 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 24/42] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:34:53.388140 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3ca8d-72dd-4b6c-9c24-cdbade42e575 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:53.388363 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40789d-212d-42e6-9145-b94a24cc0ddb None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:34:53.388527 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3ca8d-72dd-4b6c-9c24-cdbade42e575 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:53.388754 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3ca8d-72dd-4b6c-9c24-cdbade42e575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:53.413452 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-8af3ca8d-72dd-4b6c-9c24-cdbade42e575 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:34:53.415142 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-8af3ca8d-72dd-4b6c-9c24-cdbade42e575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:34:53.428969 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176dbd8c-b02e-4a74-8a6b-08f554791edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:34:53.430154 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176dbd8c-b02e-4a74-8a6b-08f554791edf None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:53.430606 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176dbd8c-b02e-4a74-8a6b-08f554791edf None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:53.431067 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176dbd8c-b02e-4a74-8a6b-08f554791edf None admin] PATH_INFO: `/v3/domains/default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:53.432486 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176dbd8c-b02e-4a74-8a6b-08f554791edf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:34:53.434359 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176dbd8c-b02e-4a74-8a6b-08f554791edf None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:34:53.436395 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 19/43] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:34:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:34:53.446921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176dbd8c-b02e-4a74-8a6b-08f554791edf None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:34:53.496482 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 25/44] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:34:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:34:53.507450 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:34:53.524043 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3ca8d-72dd-4b6c-9c24-cdbade42e575 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:34:53.593355 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:34:53.640459 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3ca8d-72dd-4b6c-9c24-cdbade42e575 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:34:53.677267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83d419-edb0-488e-8900-f15837dd9b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:34:53.677973 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83d419-edb0-488e-8900-f15837dd9b95 None admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:53.678284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83d419-edb0-488e-8900-f15837dd9b95 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:53.678536 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83d419-edb0-488e-8900-f15837dd9b95 None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:53.679312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83d419-edb0-488e-8900-f15837dd9b95 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:34:53.680862 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83d419-edb0-488e-8900-f15837dd9b95 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:34:53.681948 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176dbd8c-b02e-4a74-8a6b-08f554791edf None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:34:53.698395 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 26/45] 10.222.0.27 () {60 vars in 1131 bytes} [Tue Jul 5 20:34:53 2022] POST /identity/v3/roles => generated 223 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:34:53.720271 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75547f55-e64e-4cd2-8f7b-a0cbb5b34c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:34:53.720962 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75547f55-e64e-4cd2-8f7b-a0cbb5b34c05 None admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:53.721248 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75547f55-e64e-4cd2-8f7b-a0cbb5b34c05 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:53.721527 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75547f55-e64e-4cd2-8f7b-a0cbb5b34c05 None admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:53.722301 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75547f55-e64e-4cd2-8f7b-a0cbb5b34c05 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:34:53.723837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75547f55-e64e-4cd2-8f7b-a0cbb5b34c05 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:34:53.755325 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 20/46] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Jul 5 20:34:53 2022] POST /identity/v3/projects => generated 312 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:34:55.200162 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14fb2b-05d7-402b-ad34-8061c1e23c5a None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:55.200691 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14fb2b-05d7-402b-ad34-8061c1e23c5a None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:55.200691 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14fb2b-05d7-402b-ad34-8061c1e23c5a None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:55.202107 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 27/47] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:34:55.207632 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb19821-570a-458d-aa11-faf037c358c4 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:55.208036 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb19821-570a-458d-aa11-faf037c358c4 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:55.208288 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb19821-570a-458d-aa11-faf037c358c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:55.225731 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-3bb19821-570a-458d-aa11-faf037c358c4 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:34:55.226946 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-3bb19821-570a-458d-aa11-faf037c358c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:34:55.295139 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 21/48] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:34:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:34:55.317877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14fb2b-05d7-402b-ad34-8061c1e23c5a None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:34:55.424537 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14fb2b-05d7-402b-ad34-8061c1e23c5a None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:34:55.446291 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:34:55.462840 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394770cc-2f98-44d7-b9fb-98c06e533914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:34:55.463651 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394770cc-2f98-44d7-b9fb-98c06e533914 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:55.463934 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394770cc-2f98-44d7-b9fb-98c06e533914 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:55.464212 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394770cc-2f98-44d7-b9fb-98c06e533914 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:55.477421 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394770cc-2f98-44d7-b9fb-98c06e533914 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:34:55.486246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-394770cc-2f98-44d7-b9fb-98c06e533914 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:34:55.486246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:34:55.486246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:34:55.486246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:34:55.486246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:34:55.486246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:34:55.486246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:34:55.486246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:34:55.486246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:34:55.486246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:34:55.486246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:34:55.486246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:34:55.486246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:34:55.486246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:34:55.486246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:34:55.486246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:34:55.487212 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:34:55.487212 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:34:55.487212 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:34:55.487212 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:34:55.487212 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:34:55.487212 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:34:55.487212 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:34:55.487212 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:34:55.487212 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:34:55.487212 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:34:55.487212 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:34:55.487212 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:34:55.487212 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:34:55.487212 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:34:55.487212 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:34:55.487212 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:34:55.492874 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:34:55.492874 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:34:55.492874 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:34:55.492874 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:34:55.492874 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:34:55.492874 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:34:55.492874 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:34:55.492874 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:34:55.492874 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:34:55.492874 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:34:55.492874 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:34:55.492874 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:34:55.492874 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 28/49] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 5 20:34:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:34:55.493514 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb19821-570a-458d-aa11-faf037c358c4 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:34:55.524545 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:34:55.598891 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb19821-570a-458d-aa11-faf037c358c4 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:34:55.634949 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c3afd-50d5-4c7c-8019-6e6fe3dc975c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:34:55.635629 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c3afd-50d5-4c7c-8019-6e6fe3dc975c None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:55.635908 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c3afd-50d5-4c7c-8019-6e6fe3dc975c None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:55.636179 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c3afd-50d5-4c7c-8019-6e6fe3dc975c None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:55.636945 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c3afd-50d5-4c7c-8019-6e6fe3dc975c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:34:55.637246 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c3afd-50d5-4c7c-8019-6e6fe3dc975c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:34:55.638772 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c3afd-50d5-4c7c-8019-6e6fe3dc975c None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:34:55.648087 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 22/50] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:34:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:34:55.653752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394770cc-2f98-44d7-b9fb-98c06e533914 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:34:55.766763 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f4fc1-dfee-4a2a-b1b4-e9d3c8ae015b None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:55.766946 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f4fc1-dfee-4a2a-b1b4-e9d3c8ae015b None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:55.767221 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f4fc1-dfee-4a2a-b1b4-e9d3c8ae015b None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:55.768780 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 23/51] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:34:55.773982 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217a572-ab90-448d-8a83-9657308ff47f None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:55.774272 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217a572-ab90-448d-8a83-9657308ff47f None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:55.774531 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217a572-ab90-448d-8a83-9657308ff47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:55.792646 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-6217a572-ab90-448d-8a83-9657308ff47f None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:34:55.793867 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-6217a572-ab90-448d-8a83-9657308ff47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:34:55.861095 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 24/52] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:34:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:34:55.863820 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394770cc-2f98-44d7-b9fb-98c06e533914 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:34:55.885623 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217a572-ab90-448d-8a83-9657308ff47f None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:34:55.900591 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b479da-b868-415a-ae1d-e485245fa826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:34:55.901486 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b479da-b868-415a-ae1d-e485245fa826 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:55.901768 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b479da-b868-415a-ae1d-e485245fa826 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:55.902077 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b479da-b868-415a-ae1d-e485245fa826 None admin] PATH_INFO: `/v3/users/0aa59f315d9f4ee3a1a7a51f7ef6b880` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:55.903271 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b479da-b868-415a-ae1d-e485245fa826 None admin] RBAC: Authorizing `identity:get_user(user_id=0aa59f315d9f4ee3a1a7a51f7ef6b880)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:34:55.906937 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b479da-b868-415a-ae1d-e485245fa826 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:34:55.908607 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 29/53] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:34:55 2022] GET /identity/v3/users/0aa59f315d9f4ee3a1a7a51f7ef6b880 => generated 247 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:34:55.912527 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:34:55.914159 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b479da-b868-415a-ae1d-e485245fa826 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:34:55.965414 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:34:55.997827 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217a572-ab90-448d-8a83-9657308ff47f None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:34:56.016944 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b479da-b868-415a-ae1d-e485245fa826 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:34:56.031221 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3c8db-885b-475c-b29e-e48d37748b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:34:56.032028 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3c8db-885b-475c-b29e-e48d37748b4d None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:56.032314 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3c8db-885b-475c-b29e-e48d37748b4d None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:56.032577 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3c8db-885b-475c-b29e-e48d37748b4d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:56.033756 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3c8db-885b-475c-b29e-e48d37748b4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:34:56.035255 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3c8db-885b-475c-b29e-e48d37748b4d None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:34:56.036876 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 25/54] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:34:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:34:56.042523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3c8db-885b-475c-b29e-e48d37748b4d None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:34:56.050550 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbed3ab-a4bd-4013-a072-05f408b7ab64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:34:56.051366 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbed3ab-a4bd-4013-a072-05f408b7ab64 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:56.051653 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbed3ab-a4bd-4013-a072-05f408b7ab64 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:56.051934 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbed3ab-a4bd-4013-a072-05f408b7ab64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:56.053125 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbed3ab-a4bd-4013-a072-05f408b7ab64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:34:56.054634 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbed3ab-a4bd-4013-a072-05f408b7ab64 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:34:56.056466 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 30/55] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:34:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:34:56.062267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbed3ab-a4bd-4013-a072-05f408b7ab64 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:34:56.131813 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:34:56.143830 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3c8db-885b-475c-b29e-e48d37748b4d None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:34:56.162599 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbed3ab-a4bd-4013-a072-05f408b7ab64 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:34:56.179414 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:34:56.184099 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f1478-9c0f-4407-b7cc-a41f3404af13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:34:56.184902 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f1478-9c0f-4407-b7cc-a41f3404af13 None admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:56.185226 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f1478-9c0f-4407-b7cc-a41f3404af13 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:56.185647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f1478-9c0f-4407-b7cc-a41f3404af13 None admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:56.186422 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f1478-9c0f-4407-b7cc-a41f3404af13 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:34:56.187913 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f1478-9c0f-4407-b7cc-a41f3404af13 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:34:56.197776 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3392d84b-0468-4d90-ac96-fbeba7b9efca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:34:56.198489 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392d84b-0468-4d90-ac96-fbeba7b9efca None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:56.198768 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392d84b-0468-4d90-ac96-fbeba7b9efca None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:56.199046 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392d84b-0468-4d90-ac96-fbeba7b9efca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:56.199890 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3392d84b-0468-4d90-ac96-fbeba7b9efca None admin] RBAC: Adding query filter params (role.id=37ba4a62052348d4811b560c19a07e02, scope.domain.id=default, user.id=0aa59f315d9f4ee3a1a7a51f7ef6b880) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:34:56.200205 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3392d84b-0468-4d90-ac96-fbeba7b9efca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:34:56.201724 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3392d84b-0468-4d90-ac96-fbeba7b9efca None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:34:56.211393 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 31/56] 10.222.0.27 () {56 vars in 1322 bytes} [Tue Jul 5 20:34:56 2022] GET /identity/v3/role_assignments?user.id=0aa59f315d9f4ee3a1a7a51f7ef6b880&scope.domain.id=default&role.id=37ba4a62052348d4811b560c19a07e02 => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:34:56.214312 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 26/57] 10.222.0.27 () {60 vars in 1140 bytes} [Tue Jul 5 20:34:56 2022] POST /identity/v3/projects => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:34:58.237828 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa54b92-9d7a-4945-bd38-1155d7b027ec None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:58.238362 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa54b92-9d7a-4945-bd38-1155d7b027ec None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:58.238362 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa54b92-9d7a-4945-bd38-1155d7b027ec None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:58.239804 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 32/58] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:34:58.246272 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11feeb6d-35ad-4966-b07a-003c0a0da4ef None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:58.246961 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11feeb6d-35ad-4966-b07a-003c0a0da4ef None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:58.247215 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11feeb6d-35ad-4966-b07a-003c0a0da4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:58.265748 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-11feeb6d-35ad-4966-b07a-003c0a0da4ef None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:34:58.267767 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-11feeb6d-35ad-4966-b07a-003c0a0da4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:34:58.348555 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 27/59] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:34:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:34:58.372673 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa54b92-9d7a-4945-bd38-1155d7b027ec None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:34:58.486084 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa54b92-9d7a-4945-bd38-1155d7b027ec None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:34:58.521404 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f974ac-a1be-448b-abc6-55b7c773aa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:34:58.522217 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f974ac-a1be-448b-abc6-55b7c773aa06 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:58.522502 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f974ac-a1be-448b-abc6-55b7c773aa06 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:58.522775 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f974ac-a1be-448b-abc6-55b7c773aa06 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:58.524055 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f974ac-a1be-448b-abc6-55b7c773aa06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:34:58.525532 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f974ac-a1be-448b-abc6-55b7c773aa06 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:34:58.527184 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 33/60] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:34:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:34:58.535471 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11feeb6d-35ad-4966-b07a-003c0a0da4ef None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:34:58.617775 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:34:58.644637 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11feeb6d-35ad-4966-b07a-003c0a0da4ef None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:34:58.684875 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ecdc26-9ab8-4b18-837f-e1ba4f68bcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:34:58.685650 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecdc26-9ab8-4b18-837f-e1ba4f68bcf7 None admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:34:58.685964 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecdc26-9ab8-4b18-837f-e1ba4f68bcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:34:58.686248 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ecdc26-9ab8-4b18-837f-e1ba4f68bcf7 None admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:34:58.686960 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ecdc26-9ab8-4b18-837f-e1ba4f68bcf7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:34:58.688430 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ecdc26-9ab8-4b18-837f-e1ba4f68bcf7 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:34:58.718396 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 28/61] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Jul 5 20:34:58 2022] POST /identity/v3/users => generated 275 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:35:01.863953 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae64e49-0f40-43ff-b9db-5b7efe6b4caf None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:01.864988 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae64e49-0f40-43ff-b9db-5b7efe6b4caf None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:01.865486 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae64e49-0f40-43ff-b9db-5b7efe6b4caf None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:01.867122 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 34/62] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:01.879986 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed8896-7773-431e-9e46-e637bc982e49 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:01.880933 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed8896-7773-431e-9e46-e637bc982e49 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:01.881408 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed8896-7773-431e-9e46-e637bc982e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:01.906872 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-60ed8896-7773-431e-9e46-e637bc982e49 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:01.908450 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-60ed8896-7773-431e-9e46-e637bc982e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:01.998463 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5f829-2d0e-474b-b1a8-e74a5d27c990 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:01.999089 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5f829-2d0e-474b-b1a8-e74a5d27c990 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:01.999589 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5f829-2d0e-474b-b1a8-e74a5d27c990 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:02.001207 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 35/63] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:02.006310 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f81ff2-b04d-43fb-9785-d2ca9f69151d None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:02.006830 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f81ff2-b04d-43fb-9785-d2ca9f69151d None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:02.007306 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f81ff2-b04d-43fb-9785-d2ca9f69151d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:02.007561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 29/64] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:02.034238 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-48f81ff2-b04d-43fb-9785-d2ca9f69151d None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:02.035826 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-48f81ff2-b04d-43fb-9785-d2ca9f69151d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:02.072205 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed8896-7773-431e-9e46-e637bc982e49 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:02.106206 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:02.139879 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 36/65] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:35:02.145864 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4b969-9952-40e4-91cc-a28fbe358ab8 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:02.146499 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4b969-9952-40e4-91cc-a28fbe358ab8 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:02.146499 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4b969-9952-40e4-91cc-a28fbe358ab8 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:02.147992 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 37/66] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:02.156131 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a259924-5a5a-46a2-96e2-31c86b4769ae None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:02.156419 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a259924-5a5a-46a2-96e2-31c86b4769ae None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:02.156707 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a259924-5a5a-46a2-96e2-31c86b4769ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:02.177188 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:02.179189 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-9a259924-5a5a-46a2-96e2-31c86b4769ae None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:02.180401 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-9a259924-5a5a-46a2-96e2-31c86b4769ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:02.224001 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed8896-7773-431e-9e46-e637bc982e49 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:02.261375 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20c45a-fd67-4e25-865a-d64a2115bda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:02.262518 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20c45a-fd67-4e25-865a-d64a2115bda8 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:02.262974 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20c45a-fd67-4e25-865a-d64a2115bda8 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:02.263418 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20c45a-fd67-4e25-865a-d64a2115bda8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:02.265965 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 38/67] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:02.273296 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a259924-5a5a-46a2-96e2-31c86b4769ae None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:02.281897 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20c45a-fd67-4e25-865a-d64a2115bda8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:02.290321 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-7a20c45a-fd67-4e25-865a-d64a2115bda8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:35:02.290321 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:02.290321 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:02.290321 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:02.290321 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:02.290321 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:02.290321 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:02.290321 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:02.290321 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:02.290321 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:02.290321 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:02.290321 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:02.290321 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:02.290321 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:02.290321 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:02.290321 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:02.291329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:02.291329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:02.291329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:02.291329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:02.291329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:02.291329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:02.291329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:02.291329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:02.291329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:02.291329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:02.291329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:02.291329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:02.291329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:02.291329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:02.291329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:02.291329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:02.292104 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:02.292104 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:02.292104 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:02.292104 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:02.292104 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:02.292104 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:02.292104 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:02.292104 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:02.292104 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:02.292104 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:02.292104 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:35:02.292104 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:35:02.292104 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 30/68] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:35:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:35:02.293155 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df7cb3-9cd5-42e3-8ac3-8ad862ec45c7 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:02.293246 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df7cb3-9cd5-42e3-8ac3-8ad862ec45c7 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:02.293508 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df7cb3-9cd5-42e3-8ac3-8ad862ec45c7 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:02.294841 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 31/69] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:02.295662 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df7cb3-9cd5-42e3-8ac3-8ad862ec45c7 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:02.375411 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a259924-5a5a-46a2-96e2-31c86b4769ae None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:02.384504 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:02.403569 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df7cb3-9cd5-42e3-8ac3-8ad862ec45c7 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:02.408962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99648366-f533-4b49-9553-d17a3d9cb56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:02.409771 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99648366-f533-4b49-9553-d17a3d9cb56b None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:02.410081 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99648366-f533-4b49-9553-d17a3d9cb56b None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:02.410354 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99648366-f533-4b49-9553-d17a3d9cb56b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:02.420585 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99648366-f533-4b49-9553-d17a3d9cb56b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:02.423761 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:02.428807 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-99648366-f533-4b49-9553-d17a3d9cb56b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:35:02.428807 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:02.428807 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:02.428807 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:02.428807 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:02.428807 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:02.428807 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:02.428807 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:02.428807 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:02.428807 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:02.428807 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:02.428807 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:02.428807 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:02.428807 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:02.428807 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:02.428807 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:02.429678 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:02.429678 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:02.429678 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:02.429678 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:02.429678 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:02.429678 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:02.429678 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:02.429678 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:02.429678 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:02.429678 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:02.429678 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:02.429678 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:02.429678 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:02.429678 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:02.429678 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:02.429678 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:02.430494 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:02.430494 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:02.430494 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:02.430494 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:02.430494 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:02.430494 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:02.430494 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:02.430494 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:02.430494 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:02.430494 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:02.430494 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:35:02.430494 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:02.430494 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 39/70] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 5 20:35:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:02.434664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99648366-f533-4b49-9553-d17a3d9cb56b None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:02.441078 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca22e6-e9c2-4035-a31a-fbe6e1166c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:02.441899 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca22e6-e9c2-4035-a31a-fbe6e1166c49 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:02.442203 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca22e6-e9c2-4035-a31a-fbe6e1166c49 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:02.442477 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca22e6-e9c2-4035-a31a-fbe6e1166c49 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:02.452787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca22e6-e9c2-4035-a31a-fbe6e1166c49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:02.460769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-2bca22e6-e9c2-4035-a31a-fbe6e1166c49 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:35:02.460769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:02.460769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:02.460769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:02.460769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:02.460769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:02.460769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:02.460769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:02.460769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:02.460769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:02.460769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:02.460769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:02.460769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:02.460769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:02.460769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:02.460769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:02.461651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:02.461651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:02.461651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:02.461651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:02.461651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:02.461651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:02.461651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:02.461651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:02.461651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:02.461651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:02.461651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:02.461651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:02.461651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:02.461651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:02.461651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:02.461651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:02.462445 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:02.462445 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:02.462445 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:02.462445 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:02.462445 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:02.462445 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:02.462445 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:02.462445 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:02.462445 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:02.462445 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:02.462445 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:35:02.462445 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:35:02.462445 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 32/71] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 5 20:35:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:02.463223 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f120f-222d-44a0-a148-9dd78b1854d1 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:02.463445 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f120f-222d-44a0-a148-9dd78b1854d1 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:02.463809 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f120f-222d-44a0-a148-9dd78b1854d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:02.480080 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-7e7f120f-222d-44a0-a148-9dd78b1854d1 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:02.481259 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-7e7f120f-222d-44a0-a148-9dd78b1854d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:02.540696 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99648366-f533-4b49-9553-d17a3d9cb56b None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:02.546695 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 33/72] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:02.548054 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c48c6-7de8-4cb6-9ed0-b43c97409464 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:02.548345 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c48c6-7de8-4cb6-9ed0-b43c97409464 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:02.548618 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c48c6-7de8-4cb6-9ed0-b43c97409464 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:02.552932 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 34/73] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:02.552932 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c48c6-7de8-4cb6-9ed0-b43c97409464 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:02.589386 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d6cbf-4852-4ecd-a360-0c66a083e7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:02.590097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d6cbf-4852-4ecd-a360-0c66a083e7e9 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:02.590384 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d6cbf-4852-4ecd-a360-0c66a083e7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:02.590659 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d6cbf-4852-4ecd-a360-0c66a083e7e9 None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:02.591413 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d6cbf-4852-4ecd-a360-0c66a083e7e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:02.591720 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d6cbf-4852-4ecd-a360-0c66a083e7e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:02.593249 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d6cbf-4852-4ecd-a360-0c66a083e7e9 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:02.601466 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 40/74] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 5 20:35:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:02.602286 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d6cbf-4852-4ecd-a360-0c66a083e7e9 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:02.633167 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:02.657979 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c48c6-7de8-4cb6-9ed0-b43c97409464 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:02.668379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:02.692471 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311a824-bf41-4608-97d4-7422223d41d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:02.693143 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311a824-bf41-4608-97d4-7422223d41d5 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:02.693427 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311a824-bf41-4608-97d4-7422223d41d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:02.693687 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311a824-bf41-4608-97d4-7422223d41d5 None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:02.694460 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311a824-bf41-4608-97d4-7422223d41d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:02.694770 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311a824-bf41-4608-97d4-7422223d41d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:02.696171 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311a824-bf41-4608-97d4-7422223d41d5 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:02.702075 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d6cbf-4852-4ecd-a360-0c66a083e7e9 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:02.704265 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 35/75] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:35:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:02.705627 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d32e9-6d36-4ddd-8f51-c7ed0b71c239 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:02.705943 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d32e9-6d36-4ddd-8f51-c7ed0b71c239 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:02.706223 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d32e9-6d36-4ddd-8f51-c7ed0b71c239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:02.722864 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-227d32e9-6d36-4ddd-8f51-c7ed0b71c239 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:02.724040 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-227d32e9-6d36-4ddd-8f51-c7ed0b71c239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:02.743832 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bd245-2d4e-4b73-ac33-39b7eec667a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:02.744513 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bd245-2d4e-4b73-ac33-39b7eec667a2 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:02.744786 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bd245-2d4e-4b73-ac33-39b7eec667a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:02.745063 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bd245-2d4e-4b73-ac33-39b7eec667a2 None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:02.745820 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021bd245-2d4e-4b73-ac33-39b7eec667a2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:02.746157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021bd245-2d4e-4b73-ac33-39b7eec667a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:02.747568 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021bd245-2d4e-4b73-ac33-39b7eec667a2 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:02.755868 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 41/76] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:35:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:02.757007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bd245-2d4e-4b73-ac33-39b7eec667a2 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:02.793224 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 36/77] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:02.794075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d32e9-6d36-4ddd-8f51-c7ed0b71c239 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:02.849754 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:02.858722 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bd245-2d4e-4b73-ac33-39b7eec667a2 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:02.892404 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f48e3-e7eb-43d7-a501-1b393a97569d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:02.893227 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f48e3-e7eb-43d7-a501-1b393a97569d None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:02.893512 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f48e3-e7eb-43d7-a501-1b393a97569d None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:02.893790 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f48e3-e7eb-43d7-a501-1b393a97569d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:02.895023 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f48e3-e7eb-43d7-a501-1b393a97569d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:02.896508 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f48e3-e7eb-43d7-a501-1b393a97569d None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:02.898180 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 42/78] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:35:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:02.903041 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f48e3-e7eb-43d7-a501-1b393a97569d None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:02.903144 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d32e9-6d36-4ddd-8f51-c7ed0b71c239 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:02.903144 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:02.936522 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3a066-b2d9-4093-9820-f4dd500d8027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:02.937329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3a066-b2d9-4093-9820-f4dd500d8027 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:02.937611 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3a066-b2d9-4093-9820-f4dd500d8027 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:02.937916 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3a066-b2d9-4093-9820-f4dd500d8027 None admin] PATH_INFO: `/v3/users/0c42d09008734d94bf2a1073bbdfb052` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:02.950984 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd3a066-b2d9-4093-9820-f4dd500d8027 None admin] RBAC: Authorizing `identity:get_user(user_id=0c42d09008734d94bf2a1073bbdfb052)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:02.952495 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd3a066-b2d9-4093-9820-f4dd500d8027 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:02.954228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 37/79] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:35:02 2022] GET /identity/v3/users/0c42d09008734d94bf2a1073bbdfb052 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:02.954992 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3a066-b2d9-4093-9820-f4dd500d8027 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:03.004337 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f48e3-e7eb-43d7-a501-1b393a97569d None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:03.042192 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7c6be-19d7-48f9-94e5-2a8e6fb470b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:03.043080 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7c6be-19d7-48f9-94e5-2a8e6fb470b9 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:03.043360 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7c6be-19d7-48f9-94e5-2a8e6fb470b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:03.043641 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7c6be-19d7-48f9-94e5-2a8e6fb470b9 None admin] PATH_INFO: `/v3/users/0aa59f315d9f4ee3a1a7a51f7ef6b880` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:03.044971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc7c6be-19d7-48f9-94e5-2a8e6fb470b9 None admin] RBAC: Authorizing `identity:get_user(user_id=0aa59f315d9f4ee3a1a7a51f7ef6b880)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:03.046559 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc7c6be-19d7-48f9-94e5-2a8e6fb470b9 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:03.048201 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 43/80] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:35:02 2022] GET /identity/v3/users/0aa59f315d9f4ee3a1a7a51f7ef6b880 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:03.050554 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7c6be-19d7-48f9-94e5-2a8e6fb470b9 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:03.061836 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3a066-b2d9-4093-9820-f4dd500d8027 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:03.079606 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:03.095042 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc635e1-1ae9-4777-8769-f708122b785b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:03.095935 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc635e1-1ae9-4777-8769-f708122b785b None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:03.096220 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc635e1-1ae9-4777-8769-f708122b785b None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:03.096497 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc635e1-1ae9-4777-8769-f708122b785b None admin] PATH_INFO: `/v3/users/0c42d09008734d94bf2a1073bbdfb052` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:03.097685 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc635e1-1ae9-4777-8769-f708122b785b None admin] RBAC: Authorizing `identity:get_user(user_id=0c42d09008734d94bf2a1073bbdfb052)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:03.099180 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc635e1-1ae9-4777-8769-f708122b785b None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:03.100844 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 38/81] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:35:02 2022] GET /identity/v3/users/0c42d09008734d94bf2a1073bbdfb052 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:03.101574 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc635e1-1ae9-4777-8769-f708122b785b None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:03.128254 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:03.159232 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7c6be-19d7-48f9-94e5-2a8e6fb470b9 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:03.191960 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f0374-7322-4ea4-8054-024f9294d491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:03.192687 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f0374-7322-4ea4-8054-024f9294d491 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:03.192969 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f0374-7322-4ea4-8054-024f9294d491 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:03.193241 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f0374-7322-4ea4-8054-024f9294d491 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:03.200051 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc635e1-1ae9-4777-8769-f708122b785b None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:03.203195 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f0374-7322-4ea4-8054-024f9294d491 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:03.210764 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-7b4f0374-7322-4ea4-8054-024f9294d491 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:35:03.210764 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:03.210764 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:03.210764 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:03.210764 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:03.210764 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:03.210764 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:03.210764 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:03.210764 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:03.210764 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:03.210764 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:03.210764 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:03.210764 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:03.210764 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:03.210764 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:03.210764 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:03.211586 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:03.211586 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:03.211586 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:03.211586 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:03.211586 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:03.211586 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:03.211586 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:03.211586 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:03.211586 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:03.211586 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:03.211586 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:03.211586 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:03.211586 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:03.211586 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:03.211586 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:03.211586 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:03.212347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:03.212347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:03.212347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:03.212347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:03.212347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:03.212347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:03.212347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:03.212347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:03.212347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:03.212347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:03.212347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:35:03.212347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:03.212347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 44/82] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:35:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:03.212964 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f0374-7322-4ea4-8054-024f9294d491 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:03.235808 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c006f-21c7-45e9-bf22-1ccdddc32421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:03.236499 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c006f-21c7-45e9-bf22-1ccdddc32421 None admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:03.236787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c006f-21c7-45e9-bf22-1ccdddc32421 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:03.237065 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c006f-21c7-45e9-bf22-1ccdddc32421 None admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:03.237792 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c006f-21c7-45e9-bf22-1ccdddc32421 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:03.239292 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c006f-21c7-45e9-bf22-1ccdddc32421 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:03.260082 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 39/83] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Jul 5 20:35:03 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:35:03.260882 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c006f-21c7-45e9-bf22-1ccdddc32421 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:03.317061 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:03.330752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f0374-7322-4ea4-8054-024f9294d491 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:03.364093 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:03.367943 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10fa19-d157-4e58-b244-d79493701048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:03.368608 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10fa19-d157-4e58-b244-d79493701048 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:03.368889 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10fa19-d157-4e58-b244-d79493701048 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:03.369163 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10fa19-d157-4e58-b244-d79493701048 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:03.388341 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c006f-21c7-45e9-bf22-1ccdddc32421 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:03.428142 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2579aa-c2da-4cde-b990-235741057816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:03.428904 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2579aa-c2da-4cde-b990-235741057816 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:03.429191 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2579aa-c2da-4cde-b990-235741057816 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:03.430084 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2579aa-c2da-4cde-b990-235741057816 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:03.444172 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad10fa19-d157-4e58-b244-d79493701048 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:03.445599 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad10fa19-d157-4e58-b244-d79493701048 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:03.510095 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2579aa-c2da-4cde-b990-235741057816 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:03.512093 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2579aa-c2da-4cde-b990-235741057816 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:03.554365 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:03.570553 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 45/84] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:35:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:35:03.571441 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10fa19-d157-4e58-b244-d79493701048 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:03.616445 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:03.639192 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 40/85] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:35:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:35:03.640128 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2579aa-c2da-4cde-b990-235741057816 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:03.680824 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10fa19-d157-4e58-b244-d79493701048 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:03.720835 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2589768-595c-4a04-a93e-c6f1baf8df18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:03.721414 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2589768-595c-4a04-a93e-c6f1baf8df18 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:03.721699 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2589768-595c-4a04-a93e-c6f1baf8df18 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:03.722008 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2589768-595c-4a04-a93e-c6f1baf8df18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:03.767332 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2579aa-c2da-4cde-b990-235741057816 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:03.790925 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:03.805744 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2589768-595c-4a04-a93e-c6f1baf8df18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:03.807484 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2589768-595c-4a04-a93e-c6f1baf8df18 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:03.811687 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b3ac0-3c6f-46c8-ad21-cae0606f34fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:03.812380 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b3ac0-3c6f-46c8-ad21-cae0606f34fa None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:03.812665 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b3ac0-3c6f-46c8-ad21-cae0606f34fa None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:03.812942 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b3ac0-3c6f-46c8-ad21-cae0606f34fa None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:03.813700 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b3ac0-3c6f-46c8-ad21-cae0606f34fa None admin] RBAC: Adding query filter params (name=member) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:03.814032 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b3ac0-3c6f-46c8-ad21-cae0606f34fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:03.815433 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b3ac0-3c6f-46c8-ad21-cae0606f34fa None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:03.827497 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 41/86] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 5 20:35:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:03.828413 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b3ac0-3c6f-46c8-ad21-cae0606f34fa None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:03.891514 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:03.938264 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 46/87] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:35:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:35:03.939146 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2589768-595c-4a04-a93e-c6f1baf8df18 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:03.955304 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b3ac0-3c6f-46c8-ad21-cae0606f34fa None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:03.997633 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61cf80-629d-483a-be21-0e7a4d2711b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:03.998840 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61cf80-629d-483a-be21-0e7a4d2711b0 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:03.999201 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61cf80-629d-483a-be21-0e7a4d2711b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:03.999551 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61cf80-629d-483a-be21-0e7a4d2711b0 None admin] PATH_INFO: `/v3/projects/49b18126ef0a46788f631cd665c36e57` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:04.001321 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61cf80-629d-483a-be21-0e7a4d2711b0 None admin] RBAC: Authorizing `identity:get_project(project_id=49b18126ef0a46788f631cd665c36e57)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:04.003214 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61cf80-629d-483a-be21-0e7a4d2711b0 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:04.005768 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 42/88] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:03 2022] GET /identity/v3/projects/49b18126ef0a46788f631cd665c36e57 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:04.007741 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61cf80-629d-483a-be21-0e7a4d2711b0 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:04.049892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:04.063922 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2589768-595c-4a04-a93e-c6f1baf8df18 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:04.099426 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3cd16b-94ab-49e0-ba6a-e6a586d375c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:04.100696 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cd16b-94ab-49e0-ba6a-e6a586d375c6 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:04.101184 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cd16b-94ab-49e0-ba6a-e6a586d375c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:04.101761 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cd16b-94ab-49e0-ba6a-e6a586d375c6 None admin] PATH_INFO: `/v3/projects/49b18126ef0a46788f631cd665c36e57` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:04.103308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3cd16b-94ab-49e0-ba6a-e6a586d375c6 None admin] RBAC: Authorizing `identity:get_project(project_id=49b18126ef0a46788f631cd665c36e57)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:04.104984 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3cd16b-94ab-49e0-ba6a-e6a586d375c6 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:04.106975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 47/89] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:03 2022] GET /identity/v3/projects/49b18126ef0a46788f631cd665c36e57 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:04.108119 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3cd16b-94ab-49e0-ba6a-e6a586d375c6 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:04.139839 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61cf80-629d-483a-be21-0e7a4d2711b0 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:04.162182 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:04.190411 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68820b-b0af-4c0c-b737-e30ab5b0a630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:04.192351 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68820b-b0af-4c0c-b737-e30ab5b0a630 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:04.192832 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68820b-b0af-4c0c-b737-e30ab5b0a630 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:04.193593 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68820b-b0af-4c0c-b737-e30ab5b0a630 None admin] PATH_INFO: `/v3/users/0c42d09008734d94bf2a1073bbdfb052` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:04.196750 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68820b-b0af-4c0c-b737-e30ab5b0a630 None admin] RBAC: Authorizing `identity:get_user(user_id=0c42d09008734d94bf2a1073bbdfb052)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:04.198576 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68820b-b0af-4c0c-b737-e30ab5b0a630 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:04.201198 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 43/90] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:35:04 2022] GET /identity/v3/users/0c42d09008734d94bf2a1073bbdfb052 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:04.202346 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68820b-b0af-4c0c-b737-e30ab5b0a630 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:04.231928 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3cd16b-94ab-49e0-ba6a-e6a586d375c6 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:04.277528 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f862c-62ea-45fe-b313-171842ce8ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:04.279002 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f862c-62ea-45fe-b313-171842ce8ae4 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:04.279803 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f862c-62ea-45fe-b313-171842ce8ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:04.280248 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f862c-62ea-45fe-b313-171842ce8ae4 None admin] PATH_INFO: `/v3/projects/49b18126ef0a46788f631cd665c36e57` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:04.282244 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f862c-62ea-45fe-b313-171842ce8ae4 None admin] RBAC: Authorizing `identity:get_project(project_id=49b18126ef0a46788f631cd665c36e57)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:04.284778 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f862c-62ea-45fe-b313-171842ce8ae4 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:04.286719 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 48/91] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:04 2022] GET /identity/v3/projects/49b18126ef0a46788f631cd665c36e57 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:04.287634 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f862c-62ea-45fe-b313-171842ce8ae4 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:04.326684 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:04.333656 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68820b-b0af-4c0c-b737-e30ab5b0a630 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:04.381293 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808fd4e4-18e4-41a5-ae28-fa651b0f8dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:04.382404 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fd4e4-18e4-41a5-ae28-fa651b0f8dba None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:04.383276 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fd4e4-18e4-41a5-ae28-fa651b0f8dba None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:04.383704 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fd4e4-18e4-41a5-ae28-fa651b0f8dba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:04.385034 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808fd4e4-18e4-41a5-ae28-fa651b0f8dba None admin] RBAC: Adding query filter params (role.id=8dc2563a47c540cfa548eb210d02066e, scope.project.id=49b18126ef0a46788f631cd665c36e57, user.id=0c42d09008734d94bf2a1073bbdfb052) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:04.385531 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808fd4e4-18e4-41a5-ae28-fa651b0f8dba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:04.389354 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808fd4e4-18e4-41a5-ae28-fa651b0f8dba None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:04.398061 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 44/92] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:35:04 2022] GET /identity/v3/role_assignments?user.id=0c42d09008734d94bf2a1073bbdfb052&scope.project.id=49b18126ef0a46788f631cd665c36e57&role.id=8dc2563a47c540cfa548eb210d02066e => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:04.399065 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808fd4e4-18e4-41a5-ae28-fa651b0f8dba None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:04.455275 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f862c-62ea-45fe-b313-171842ce8ae4 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:04.513226 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:04.519886 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281aeb7-0ff6-4c53-8622-0b0b46390d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:04.521709 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281aeb7-0ff6-4c53-8622-0b0b46390d20 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:04.522184 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281aeb7-0ff6-4c53-8622-0b0b46390d20 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:04.523183 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281aeb7-0ff6-4c53-8622-0b0b46390d20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:04.524228 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281aeb7-0ff6-4c53-8622-0b0b46390d20 None admin] RBAC: Adding query filter params (role.id=37ba4a62052348d4811b560c19a07e02, scope.project.id=49b18126ef0a46788f631cd665c36e57, user.id=0aa59f315d9f4ee3a1a7a51f7ef6b880) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:04.524716 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281aeb7-0ff6-4c53-8622-0b0b46390d20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:04.526422 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281aeb7-0ff6-4c53-8622-0b0b46390d20 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:04.535924 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 49/93] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:35:04 2022] GET /identity/v3/role_assignments?user.id=0aa59f315d9f4ee3a1a7a51f7ef6b880&scope.project.id=49b18126ef0a46788f631cd665c36e57&role.id=37ba4a62052348d4811b560c19a07e02 => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:04.537250 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281aeb7-0ff6-4c53-8622-0b0b46390d20 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:04.641325 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808fd4e4-18e4-41a5-ae28-fa651b0f8dba None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:04.664096 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:04.683062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281aeb7-0ff6-4c53-8622-0b0b46390d20 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:04.724840 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa1105-fe36-4460-abc1-6f14552f9a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:04.725606 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa1105-fe36-4460-abc1-6f14552f9a20 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:04.725982 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa1105-fe36-4460-abc1-6f14552f9a20 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:04.726349 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa1105-fe36-4460-abc1-6f14552f9a20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:04.730325 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221bb3bb-d528-4eaf-978d-c7de21a6c168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:04.731268 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bb3bb-d528-4eaf-978d-c7de21a6c168 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:04.731740 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bb3bb-d528-4eaf-978d-c7de21a6c168 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:04.732626 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bb3bb-d528-4eaf-978d-c7de21a6c168 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:04.734985 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221bb3bb-d528-4eaf-978d-c7de21a6c168 None admin] RBAC: Adding query filter params (role.id=c403525d65944d2187540a6d893b91e7, scope.project.id=49b18126ef0a46788f631cd665c36e57, user.id=0c42d09008734d94bf2a1073bbdfb052) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:04.735482 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221bb3bb-d528-4eaf-978d-c7de21a6c168 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:04.738099 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221bb3bb-d528-4eaf-978d-c7de21a6c168 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:04.747764 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 50/94] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:35:04 2022] GET /identity/v3/role_assignments?user.id=0c42d09008734d94bf2a1073bbdfb052&scope.project.id=49b18126ef0a46788f631cd665c36e57&role.id=c403525d65944d2187540a6d893b91e7 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:04.819494 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa1105-fe36-4460-abc1-6f14552f9a20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:04.821378 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa1105-fe36-4460-abc1-6f14552f9a20 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:04.873998 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:04.936990 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 45/95] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:35:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:35:04.942798 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221bb3bb-d528-4eaf-978d-c7de21a6c168 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:05.076265 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221bb3bb-d528-4eaf-978d-c7de21a6c168 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:05.125056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c0cd9-3327-4d9c-bbf4-d4a700680c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:05.126347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c0cd9-3327-4d9c-bbf4-d4a700680c2c None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:05.126853 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c0cd9-3327-4d9c-bbf4-d4a700680c2c None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:05.127318 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c0cd9-3327-4d9c-bbf4-d4a700680c2c None admin] PATH_INFO: `/v3/projects/e03d0b8a504a4625acde9366aa8adeac` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:05.128736 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c0cd9-3327-4d9c-bbf4-d4a700680c2c None admin] RBAC: Authorizing `identity:get_project(project_id=e03d0b8a504a4625acde9366aa8adeac)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:05.130445 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c0cd9-3327-4d9c-bbf4-d4a700680c2c None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:05.132368 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 51/96] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:04 2022] GET /identity/v3/projects/e03d0b8a504a4625acde9366aa8adeac => generated 312 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:05.138429 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa1105-fe36-4460-abc1-6f14552f9a20 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:05.289097 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa1105-fe36-4460-abc1-6f14552f9a20 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:05.327371 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb000d9-1398-4a33-98fb-a5387f7ddb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:05.328829 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb000d9-1398-4a33-98fb-a5387f7ddb77 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:05.329308 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb000d9-1398-4a33-98fb-a5387f7ddb77 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:05.329772 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb000d9-1398-4a33-98fb-a5387f7ddb77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:05.330856 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb000d9-1398-4a33-98fb-a5387f7ddb77 None admin] RBAC: Adding query filter params (role.id=8dc2563a47c540cfa548eb210d02066e, scope.project.id=e03d0b8a504a4625acde9366aa8adeac, user.id=0c42d09008734d94bf2a1073bbdfb052) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:05.331366 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb000d9-1398-4a33-98fb-a5387f7ddb77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:05.333046 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb000d9-1398-4a33-98fb-a5387f7ddb77 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:05.339815 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 46/97] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:35:05 2022] GET /identity/v3/role_assignments?user.id=0c42d09008734d94bf2a1073bbdfb052&scope.project.id=e03d0b8a504a4625acde9366aa8adeac&role.id=8dc2563a47c540cfa548eb210d02066e => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:35:05.804011 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc98187-6a0b-4284-8547-48a5d4f7a2ea None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:05.804729 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc98187-6a0b-4284-8547-48a5d4f7a2ea None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:05.805239 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc98187-6a0b-4284-8547-48a5d4f7a2ea None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:05.807099 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 52/98] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:05.812748 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d54fbc-b2da-42c0-be26-ea7f2b99f062 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:05.813246 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d54fbc-b2da-42c0-be26-ea7f2b99f062 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:05.813733 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d54fbc-b2da-42c0-be26-ea7f2b99f062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:05.835301 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-72d54fbc-b2da-42c0-be26-ea7f2b99f062 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:05.836819 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-72d54fbc-b2da-42c0-be26-ea7f2b99f062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:05.840036 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:05.929793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 47/99] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:05.975345 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc98187-6a0b-4284-8547-48a5d4f7a2ea None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:05.995126 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9d28b-8cae-4db0-bdb8-e25f3101d1ac None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:05.995764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9d28b-8cae-4db0-bdb8-e25f3101d1ac None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:05.996237 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9d28b-8cae-4db0-bdb8-e25f3101d1ac None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:05.997909 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 48/100] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:35:06.006447 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:06.016403 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b8f6c-6889-44f3-82dc-665ffc089756 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:06.016689 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b8f6c-6889-44f3-82dc-665ffc089756 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:06.016972 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b8f6c-6889-44f3-82dc-665ffc089756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:06.041638 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-dc0b8f6c-6889-44f3-82dc-665ffc089756 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:06.043682 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-dc0b8f6c-6889-44f3-82dc-665ffc089756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:06.120365 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 49/101] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 05 20:35:06.154352 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b8f6c-6889-44f3-82dc-665ffc089756 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:06.214559 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc98187-6a0b-4284-8547-48a5d4f7a2ea None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:06.229777 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:06.265573 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b8f6c-6889-44f3-82dc-665ffc089756 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:06.302621 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc896b-35c7-42db-a05a-58335d75bebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:06.303726 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc896b-35c7-42db-a05a-58335d75bebc None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:06.304153 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc896b-35c7-42db-a05a-58335d75bebc None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:06.304568 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc896b-35c7-42db-a05a-58335d75bebc None admin] PATH_INFO: `/v3/domains/default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:06.305914 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc896b-35c7-42db-a05a-58335d75bebc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:06.307741 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc896b-35c7-42db-a05a-58335d75bebc None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:06.309819 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 50/102] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:35:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:06.315675 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc896b-35c7-42db-a05a-58335d75bebc None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:06.322570 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69780264-c82b-4e79-9ab3-76eb17d82d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:06.323404 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69780264-c82b-4e79-9ab3-76eb17d82d34 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:06.323693 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69780264-c82b-4e79-9ab3-76eb17d82d34 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:06.323978 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69780264-c82b-4e79-9ab3-76eb17d82d34 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:06.343065 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69780264-c82b-4e79-9ab3-76eb17d82d34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:06.363215 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-69780264-c82b-4e79-9ab3-76eb17d82d34 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 20:35:06.363215 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:06.363215 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:06.363215 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:06.363215 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:06.363215 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:06.363215 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:06.363215 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:06.363215 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:06.363215 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:06.363215 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:06.363215 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:06.363215 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:06.363215 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:06.363215 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:06.363215 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:06.364352 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:06.364352 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:06.364352 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:06.364352 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:06.364352 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:06.364352 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:06.364352 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:06.364352 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:06.364352 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:06.364352 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:06.364352 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:06.364352 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:06.364352 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:06.364352 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:06.364352 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:06.364352 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:06.365298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:06.365298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:06.365298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:06.365298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:06.365298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:06.365298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:06.365298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:06.365298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:06.365298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:06.365298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:06.365298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 20:35:06.365298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:06.367279 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 53/103] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:35:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:06.373386 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69780264-c82b-4e79-9ab3-76eb17d82d34 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:06.458454 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:06.488536 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69780264-c82b-4e79-9ab3-76eb17d82d34 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:06.499866 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc896b-35c7-42db-a05a-58335d75bebc None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:06.522160 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b508a1b-b985-4b37-b4cf-95243f622081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:06.523554 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b508a1b-b985-4b37-b4cf-95243f622081 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:06.523977 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b508a1b-b985-4b37-b4cf-95243f622081 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:06.524418 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b508a1b-b985-4b37-b4cf-95243f622081 None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:06.525409 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b508a1b-b985-4b37-b4cf-95243f622081 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:06.526017 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b508a1b-b985-4b37-b4cf-95243f622081 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:06.527695 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b508a1b-b985-4b37-b4cf-95243f622081 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:06.541298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 54/104] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 5 20:35:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:06.542664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b508a1b-b985-4b37-b4cf-95243f622081 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:06.623669 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4ded4-177d-4324-b7fe-58314f9e794b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:06.624283 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4ded4-177d-4324-b7fe-58314f9e794b None admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:06.624563 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4ded4-177d-4324-b7fe-58314f9e794b None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:06.625000 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4ded4-177d-4324-b7fe-58314f9e794b None admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:06.625926 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a4ded4-177d-4324-b7fe-58314f9e794b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:06.627550 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a4ded4-177d-4324-b7fe-58314f9e794b None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:06.642196 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:06.684855 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 51/105] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Jul 5 20:35:06 2022] POST /identity/v3/projects => generated 302 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:35:06.687214 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b508a1b-b985-4b37-b4cf-95243f622081 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:06.745464 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1a0c5-a8a1-4e3e-b728-12ef8a374910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:06.746663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1a0c5-a8a1-4e3e-b728-12ef8a374910 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:06.747083 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1a0c5-a8a1-4e3e-b728-12ef8a374910 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:06.747524 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1a0c5-a8a1-4e3e-b728-12ef8a374910 None admin] PATH_INFO: `/v3/users/8fba7c824655421394c750e3e30770e1` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:06.774754 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:06.778446 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1a0c5-a8a1-4e3e-b728-12ef8a374910 None admin] RBAC: Authorizing `identity:get_user(user_id=8fba7c824655421394c750e3e30770e1)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:06.780218 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1a0c5-a8a1-4e3e-b728-12ef8a374910 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:06.782396 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 55/106] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:35:06 2022] GET /identity/v3/users/8fba7c824655421394c750e3e30770e1 => generated 289 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:06.789536 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4ded4-177d-4324-b7fe-58314f9e794b None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:06.935846 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4ded4-177d-4324-b7fe-58314f9e794b None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:06.973293 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558919e6-14d9-4bb6-a41a-a4218f320d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:06.974287 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558919e6-14d9-4bb6-a41a-a4218f320d00 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:06.974756 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558919e6-14d9-4bb6-a41a-a4218f320d00 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:06.975198 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558919e6-14d9-4bb6-a41a-a4218f320d00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:07.037104 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:07.048542 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558919e6-14d9-4bb6-a41a-a4218f320d00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:07.050739 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558919e6-14d9-4bb6-a41a-a4218f320d00 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:07.200197 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 52/107] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:35:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:35:07.210960 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1a0c5-a8a1-4e3e-b728-12ef8a374910 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:07.339479 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18563b39-efd8-4ec4-9d32-fe4c585f8be3 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:07.339998 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18563b39-efd8-4ec4-9d32-fe4c585f8be3 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:07.340420 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18563b39-efd8-4ec4-9d32-fe4c585f8be3 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:07.342024 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 53/108] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:07.348124 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f9edd-29e6-4fbd-b1da-4a1e78bb5770 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:07.348602 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f9edd-29e6-4fbd-b1da-4a1e78bb5770 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:07.349019 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f9edd-29e6-4fbd-b1da-4a1e78bb5770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:07.351985 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1a0c5-a8a1-4e3e-b728-12ef8a374910 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:07.381296 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-151f9edd-29e6-4fbd-b1da-4a1e78bb5770 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:07.382813 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-151f9edd-29e6-4fbd-b1da-4a1e78bb5770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:07.396341 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc7440-e643-4453-8fd7-266dbd9cae3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:07.397224 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc7440-e643-4453-8fd7-266dbd9cae3d None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:07.397501 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc7440-e643-4453-8fd7-266dbd9cae3d None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:07.397771 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc7440-e643-4453-8fd7-266dbd9cae3d None admin] PATH_INFO: `/v3/projects/49b18126ef0a46788f631cd665c36e57` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:07.398998 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc7440-e643-4453-8fd7-266dbd9cae3d None admin] RBAC: Authorizing `identity:get_project(project_id=49b18126ef0a46788f631cd665c36e57)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:07.400483 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc7440-e643-4453-8fd7-266dbd9cae3d None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:07.402223 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 56/109] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:07 2022] GET /identity/v3/projects/49b18126ef0a46788f631cd665c36e57 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:07.408594 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc7440-e643-4453-8fd7-266dbd9cae3d None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:07.501700 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 54/110] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:07.536018 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f9edd-29e6-4fbd-b1da-4a1e78bb5770 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:07.550843 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:07.570244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:07.577668 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc7440-e643-4453-8fd7-266dbd9cae3d None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:07.644446 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e92e4-2771-47f5-ba4f-d43000caee42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:07.645606 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e92e4-2771-47f5-ba4f-d43000caee42 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:07.646891 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e92e4-2771-47f5-ba4f-d43000caee42 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:07.647920 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e92e4-2771-47f5-ba4f-d43000caee42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:07.649141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e92e4-2771-47f5-ba4f-d43000caee42 None admin] RBAC: Adding query filter params (role.id=ca2c6e2b56e14467bcd435e641e63880, scope.project.id=49b18126ef0a46788f631cd665c36e57, user.id=8fba7c824655421394c750e3e30770e1) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:07.651898 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e92e4-2771-47f5-ba4f-d43000caee42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:07.653615 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e92e4-2771-47f5-ba4f-d43000caee42 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:07.663318 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 57/111] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:35:07 2022] GET /identity/v3/role_assignments?user.id=8fba7c824655421394c750e3e30770e1&scope.project.id=49b18126ef0a46788f631cd665c36e57&role.id=ca2c6e2b56e14467bcd435e641e63880 => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:07.670346 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db1226-420b-4627-aca6-43c9bca5f9cd None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:07.670986 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db1226-420b-4627-aca6-43c9bca5f9cd None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:07.671461 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db1226-420b-4627-aca6-43c9bca5f9cd None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:07.675716 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 58/112] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:07 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:07.685131 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc107b-36a8-4fef-9a6d-20988b053717 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:07.685818 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc107b-36a8-4fef-9a6d-20988b053717 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:07.686318 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc107b-36a8-4fef-9a6d-20988b053717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:07.713042 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-25cc107b-36a8-4fef-9a6d-20988b053717 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:07.716275 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-25cc107b-36a8-4fef-9a6d-20988b053717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:07.731113 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f9edd-29e6-4fbd-b1da-4a1e78bb5770 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:07.774627 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1d239-63b2-433c-8d57-4a20c8229ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:07.775826 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1d239-63b2-433c-8d57-4a20c8229ac3 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:07.776314 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1d239-63b2-433c-8d57-4a20c8229ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:07.776788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1d239-63b2-433c-8d57-4a20c8229ac3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:07.789518 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d1d239-63b2-433c-8d57-4a20c8229ac3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:07.798140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-22d1d239-63b2-433c-8d57-4a20c8229ac3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:35:07.798140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:07.798140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:07.798140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:07.798140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:07.798140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:07.798140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:07.798140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:07.798140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:07.798140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:07.798140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:07.798140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:07.798140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:07.798140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:07.798140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:07.798140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:07.799076 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:07.799076 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:07.799076 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:07.799076 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:07.799076 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:07.799076 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:07.799076 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:07.799076 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:07.799076 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:07.799076 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:07.799076 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:07.799076 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:07.799076 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:07.799076 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:07.799076 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:07.799076 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:07.799833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:07.799833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:07.799833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:07.799833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:07.799833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:07.799833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:07.799833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:07.799833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:07.799833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:07.799833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:07.799833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:35:07.799833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:35:07.801285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 59/113] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:07.805885 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84005070-0770-48cb-86da-bb1e86372f8d None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:07.805885 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84005070-0770-48cb-86da-bb1e86372f8d None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:07.805885 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84005070-0770-48cb-86da-bb1e86372f8d None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:07.805885 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 60/114] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:07.807426 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 55/115] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:35:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:35:07.810180 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d11fd0-eb6b-4ab4-82cb-dc200ab05876 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:07.810469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d11fd0-eb6b-4ab4-82cb-dc200ab05876 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:07.811220 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d11fd0-eb6b-4ab4-82cb-dc200ab05876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:07.814495 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1d239-63b2-433c-8d57-4a20c8229ac3 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:07.833938 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-e4d11fd0-eb6b-4ab4-82cb-dc200ab05876 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:07.833938 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-e4d11fd0-eb6b-4ab4-82cb-dc200ab05876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:07.912345 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:07.931878 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 61/116] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:07.932808 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d11fd0-eb6b-4ab4-82cb-dc200ab05876 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:07.952333 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:07.994273 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1d239-63b2-433c-8d57-4a20c8229ac3 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:08.082395 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d11fd0-eb6b-4ab4-82cb-dc200ab05876 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:08.103154 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14adb257-5bce-474a-a2aa-a85c33ce9a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:08.103852 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adb257-5bce-474a-a2aa-a85c33ce9a01 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:08.104135 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adb257-5bce-474a-a2aa-a85c33ce9a01 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:08.104413 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adb257-5bce-474a-a2aa-a85c33ce9a01 None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:08.105178 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14adb257-5bce-474a-a2aa-a85c33ce9a01 None admin] RBAC: Adding query filter params (name=member) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:08.105495 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14adb257-5bce-474a-a2aa-a85c33ce9a01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:08.106930 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14adb257-5bce-474a-a2aa-a85c33ce9a01 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:08.118928 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c320a-d9ed-403a-a71c-e5ea9eef72b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:08.119744 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c320a-d9ed-403a-a71c-e5ea9eef72b5 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:08.120032 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c320a-d9ed-403a-a71c-e5ea9eef72b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:08.120308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c320a-d9ed-403a-a71c-e5ea9eef72b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:08.128043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 56/117] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 5 20:35:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:35:08.128980 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14adb257-5bce-474a-a2aa-a85c33ce9a01 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:08.131696 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c320a-d9ed-403a-a71c-e5ea9eef72b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:08.139853 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-684c320a-d9ed-403a-a71c-e5ea9eef72b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:35:08.139853 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:08.139853 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:08.139853 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:08.139853 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:08.139853 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:08.139853 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:08.139853 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:08.139853 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:08.139853 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:08.139853 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:08.139853 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:08.139853 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:08.139853 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:08.139853 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:08.139853 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:08.140842 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:08.140842 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:08.140842 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:08.140842 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:08.140842 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:08.140842 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:08.140842 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:08.140842 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:08.140842 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:08.140842 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:08.140842 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:08.140842 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:08.140842 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:08.140842 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:08.140842 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:08.140842 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:08.141613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:08.141613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:08.141613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:08.141613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:08.141613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:08.141613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:08.141613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:08.141613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:08.141613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:08.141613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:08.141613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:35:08.141613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:08.141613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 62/118] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 5 20:35:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:08.142273 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c320a-d9ed-403a-a71c-e5ea9eef72b5 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:08.218670 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:08.254596 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14adb257-5bce-474a-a2aa-a85c33ce9a01 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:08.287785 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9226a-e71a-47d3-a152-0d8c61a621b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:08.288615 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9226a-e71a-47d3-a152-0d8c61a621b6 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:08.288899 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9226a-e71a-47d3-a152-0d8c61a621b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:08.289176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9226a-e71a-47d3-a152-0d8c61a621b6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:08.300018 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9226a-e71a-47d3-a152-0d8c61a621b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:08.303758 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c320a-d9ed-403a-a71c-e5ea9eef72b5 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:08.308362 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-9aa9226a-e71a-47d3-a152-0d8c61a621b6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:35:08.308362 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:08.308362 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:08.308362 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:08.308362 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:08.308362 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:08.308362 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:08.308362 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:08.308362 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:08.308362 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:08.308362 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:08.308362 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:08.308362 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:08.308362 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:08.308362 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:08.308362 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:08.309379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:08.309379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:08.309379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:08.309379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:08.309379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:08.309379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:08.309379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:08.309379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:08.309379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:08.309379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:08.309379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:08.309379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:08.309379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:08.309379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:08.309379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:08.309379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:08.310250 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:08.310250 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:08.310250 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:08.310250 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:08.310250 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:08.310250 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:08.310250 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:08.310250 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:08.310250 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:08.310250 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:08.310250 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:35:08.310250 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:35:08.310250 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 57/119] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 5 20:35:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:08.310942 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9226a-e71a-47d3-a152-0d8c61a621b6 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:08.346303 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:08.369388 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c57edc-1945-498e-a023-88b279dffffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:08.370343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c57edc-1945-498e-a023-88b279dffffc None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:08.370625 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c57edc-1945-498e-a023-88b279dffffc None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:08.370901 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c57edc-1945-498e-a023-88b279dffffc None admin] PATH_INFO: `/v3/users/0c42d09008734d94bf2a1073bbdfb052` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:08.373498 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c57edc-1945-498e-a023-88b279dffffc None admin] RBAC: Authorizing `identity:get_user(user_id=0c42d09008734d94bf2a1073bbdfb052)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:08.375079 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c57edc-1945-498e-a023-88b279dffffc None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:08.377064 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 63/120] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:35:08 2022] GET /identity/v3/users/0c42d09008734d94bf2a1073bbdfb052 => generated 275 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:08.377986 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c57edc-1945-498e-a023-88b279dffffc None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:08.415011 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9226a-e71a-47d3-a152-0d8c61a621b6 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:08.452428 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd279221-78a1-4e80-803a-de979fe3ffb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:08.453107 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd279221-78a1-4e80-803a-de979fe3ffb2 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:08.453389 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd279221-78a1-4e80-803a-de979fe3ffb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:08.453664 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd279221-78a1-4e80-803a-de979fe3ffb2 None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:08.455203 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd279221-78a1-4e80-803a-de979fe3ffb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:08.455516 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd279221-78a1-4e80-803a-de979fe3ffb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:08.456925 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd279221-78a1-4e80-803a-de979fe3ffb2 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:08.474944 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 58/121] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:35:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:08.476961 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd279221-78a1-4e80-803a-de979fe3ffb2 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:08.575756 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c57edc-1945-498e-a023-88b279dffffc None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:08.595504 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:08.626330 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:08.653573 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd533bb-f549-4ea2-90f6-b91f00b9a8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:08.654296 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd533bb-f549-4ea2-90f6-b91f00b9a8c4 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:08.654672 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd533bb-f549-4ea2-90f6-b91f00b9a8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:08.654917 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd533bb-f549-4ea2-90f6-b91f00b9a8c4 None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:08.655691 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd533bb-f549-4ea2-90f6-b91f00b9a8c4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:08.656004 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd533bb-f549-4ea2-90f6-b91f00b9a8c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:08.657410 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd533bb-f549-4ea2-90f6-b91f00b9a8c4 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:08.657563 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd279221-78a1-4e80-803a-de979fe3ffb2 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:08.673945 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 64/122] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:35:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:08.674920 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd533bb-f549-4ea2-90f6-b91f00b9a8c4 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:08.693295 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ed619-e3f9-47da-be81-f8858b48a7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:08.694216 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ed619-e3f9-47da-be81-f8858b48a7ea None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:08.694503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ed619-e3f9-47da-be81-f8858b48a7ea None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:08.694786 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ed619-e3f9-47da-be81-f8858b48a7ea None admin] PATH_INFO: `/v3/projects/49b18126ef0a46788f631cd665c36e57` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:08.696050 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ed619-e3f9-47da-be81-f8858b48a7ea None admin] RBAC: Authorizing `identity:get_project(project_id=49b18126ef0a46788f631cd665c36e57)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:08.697553 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ed619-e3f9-47da-be81-f8858b48a7ea None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:08.699638 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 59/123] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:08 2022] GET /identity/v3/projects/49b18126ef0a46788f631cd665c36e57 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:08.700434 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ed619-e3f9-47da-be81-f8858b48a7ea None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:08.783238 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd533bb-f549-4ea2-90f6-b91f00b9a8c4 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:08.819260 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9564f-bfe9-454b-9b39-fb1d988ed687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:08.820154 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9564f-bfe9-454b-9b39-fb1d988ed687 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:08.820440 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9564f-bfe9-454b-9b39-fb1d988ed687 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:08.820718 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9564f-bfe9-454b-9b39-fb1d988ed687 None admin] PATH_INFO: `/v3/users/0aa59f315d9f4ee3a1a7a51f7ef6b880` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:08.821952 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9564f-bfe9-454b-9b39-fb1d988ed687 None admin] RBAC: Authorizing `identity:get_user(user_id=0aa59f315d9f4ee3a1a7a51f7ef6b880)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:08.823504 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9564f-bfe9-454b-9b39-fb1d988ed687 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:08.825160 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 65/124] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:35:08 2022] GET /identity/v3/users/0aa59f315d9f4ee3a1a7a51f7ef6b880 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:08.825931 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9564f-bfe9-454b-9b39-fb1d988ed687 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:08.859827 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ed619-e3f9-47da-be81-f8858b48a7ea None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:08.880287 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:08.893926 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:08.900462 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b89b67-bde9-4d27-b7d9-d49d3da16b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:08.901780 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b89b67-bde9-4d27-b7d9-d49d3da16b4a None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:08.902286 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b89b67-bde9-4d27-b7d9-d49d3da16b4a None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:08.902755 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b89b67-bde9-4d27-b7d9-d49d3da16b4a None admin] PATH_INFO: `/v3/users/0c42d09008734d94bf2a1073bbdfb052` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:08.904179 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b89b67-bde9-4d27-b7d9-d49d3da16b4a None admin] RBAC: Authorizing `identity:get_user(user_id=0c42d09008734d94bf2a1073bbdfb052)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:08.905968 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b89b67-bde9-4d27-b7d9-d49d3da16b4a None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:08.907926 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 60/125] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:35:08 2022] GET /identity/v3/users/0c42d09008734d94bf2a1073bbdfb052 => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:08.909469 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdd445-e283-4992-9a60-2cc622979d51 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:08.909975 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdd445-e283-4992-9a60-2cc622979d51 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:08.910496 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdd445-e283-4992-9a60-2cc622979d51 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:08.911928 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 61/126] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:08.916691 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdd445-e283-4992-9a60-2cc622979d51 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:08.933174 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9564f-bfe9-454b-9b39-fb1d988ed687 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:08.968049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d91450-4d92-493f-b279-3902f91f33d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:08.969018 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d91450-4d92-493f-b279-3902f91f33d5 None admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:08.969237 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d91450-4d92-493f-b279-3902f91f33d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:08.969518 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d91450-4d92-493f-b279-3902f91f33d5 None admin] PATH_INFO: `/v3/projects/49b18126ef0a46788f631cd665c36e57/users/0c42d09008734d94bf2a1073bbdfb052/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:08.971671 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d91450-4d92-493f-b279-3902f91f33d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=49b18126ef0a46788f631cd665c36e57, user_id=0c42d09008734d94bf2a1073bbdfb052, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:08.973146 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d91450-4d92-493f-b279-3902f91f33d5 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:08.990887 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 66/127] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 5 20:35:08 2022] PUT /identity/v3/projects/49b18126ef0a46788f631cd665c36e57/users/0c42d09008734d94bf2a1073bbdfb052/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:35:08.999392 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d91450-4d92-493f-b279-3902f91f33d5 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:09.033599 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdd445-e283-4992-9a60-2cc622979d51 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:09.089537 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3cc66f-3153-4642-b7a5-3fb255e66dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:09.091153 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cc66f-3153-4642-b7a5-3fb255e66dd7 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:09.095013 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cc66f-3153-4642-b7a5-3fb255e66dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:09.095620 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cc66f-3153-4642-b7a5-3fb255e66dd7 None admin] PATH_INFO: `/v3/projects/49b18126ef0a46788f631cd665c36e57` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:09.097430 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3cc66f-3153-4642-b7a5-3fb255e66dd7 None admin] RBAC: Authorizing `identity:get_project(project_id=49b18126ef0a46788f631cd665c36e57)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:09.099576 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3cc66f-3153-4642-b7a5-3fb255e66dd7 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:09.103295 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 62/128] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:08 2022] GET /identity/v3/projects/49b18126ef0a46788f631cd665c36e57 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:09.105198 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c4419-5332-48c6-9342-4b5d4b3cb1d6 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:09.107426 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c4419-5332-48c6-9342-4b5d4b3cb1d6 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:09.109104 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c4419-5332-48c6-9342-4b5d4b3cb1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:09.159092 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-8a7c4419-5332-48c6-9342-4b5d4b3cb1d6 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:09.165748 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-8a7c4419-5332-48c6-9342-4b5d4b3cb1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:09.228162 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d91450-4d92-493f-b279-3902f91f33d5 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:09.242935 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:09.289179 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73aaf2-d5f9-4e92-be21-17920bf2bdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:09.290679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:09.291308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73aaf2-d5f9-4e92-be21-17920bf2bdd3 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:09.292106 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73aaf2-d5f9-4e92-be21-17920bf2bdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:09.292387 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73aaf2-d5f9-4e92-be21-17920bf2bdd3 None admin] PATH_INFO: `/v3/projects/49b18126ef0a46788f631cd665c36e57` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:09.295616 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73aaf2-d5f9-4e92-be21-17920bf2bdd3 None admin] RBAC: Authorizing `identity:get_project(project_id=49b18126ef0a46788f631cd665c36e57)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:09.296293 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73aaf2-d5f9-4e92-be21-17920bf2bdd3 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:09.298136 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 67/129] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:08 2022] GET /identity/v3/projects/49b18126ef0a46788f631cd665c36e57 => generated 298 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:09.298892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73aaf2-d5f9-4e92-be21-17920bf2bdd3 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:09.303895 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 63/130] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:09.304959 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c4419-5332-48c6-9342-4b5d4b3cb1d6 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:09.430648 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c4419-5332-48c6-9342-4b5d4b3cb1d6 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:09.477162 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05905874-6e41-4e13-b997-62df85c13cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:09.478299 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05905874-6e41-4e13-b997-62df85c13cd8 None admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:09.478589 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05905874-6e41-4e13-b997-62df85c13cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:09.478870 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05905874-6e41-4e13-b997-62df85c13cd8 None admin] PATH_INFO: `/v3/projects/49b18126ef0a46788f631cd665c36e57/users/0c42d09008734d94bf2a1073bbdfb052/roles/c403525d65944d2187540a6d893b91e7` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:09.481427 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05905874-6e41-4e13-b997-62df85c13cd8 None admin] RBAC: Authorizing `identity:create_grant(project_id=49b18126ef0a46788f631cd665c36e57, user_id=0c42d09008734d94bf2a1073bbdfb052, role_id=c403525d65944d2187540a6d893b91e7)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:09.483718 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05905874-6e41-4e13-b997-62df85c13cd8 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:09.502632 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 64/131] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 5 20:35:09 2022] PUT /identity/v3/projects/49b18126ef0a46788f631cd665c36e57/users/0c42d09008734d94bf2a1073bbdfb052/roles/c403525d65944d2187540a6d893b91e7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:35:09.503615 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05905874-6e41-4e13-b997-62df85c13cd8 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:09.538939 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73aaf2-d5f9-4e92-be21-17920bf2bdd3 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:09.575908 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:09.615550 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4d323-4d4c-413c-bf48-4757346fb1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:09.616478 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4d323-4d4c-413c-bf48-4757346fb1d0 None admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:09.616761 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4d323-4d4c-413c-bf48-4757346fb1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:09.617037 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4d323-4d4c-413c-bf48-4757346fb1d0 None admin] PATH_INFO: `/v3/projects/49b18126ef0a46788f631cd665c36e57/users/0aa59f315d9f4ee3a1a7a51f7ef6b880/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:09.623556 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be4d323-4d4c-413c-bf48-4757346fb1d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=49b18126ef0a46788f631cd665c36e57, user_id=0aa59f315d9f4ee3a1a7a51f7ef6b880, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:09.625064 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be4d323-4d4c-413c-bf48-4757346fb1d0 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:09.630214 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05905874-6e41-4e13-b997-62df85c13cd8 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:09.648360 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 68/132] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 5 20:35:09 2022] PUT /identity/v3/projects/49b18126ef0a46788f631cd665c36e57/users/0aa59f315d9f4ee3a1a7a51f7ef6b880/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:35:09.673354 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3d5b2-e3ab-49e3-aabb-cebbd69985ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:09.674252 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3d5b2-e3ab-49e3-aabb-cebbd69985ee None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:09.674540 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3d5b2-e3ab-49e3-aabb-cebbd69985ee None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:09.674820 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3d5b2-e3ab-49e3-aabb-cebbd69985ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:09.688654 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3d5b2-e3ab-49e3-aabb-cebbd69985ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:09.692036 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9d10b-db29-4839-8180-f63e44bdffe0 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:09.692329 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9d10b-db29-4839-8180-f63e44bdffe0 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:09.692626 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9d10b-db29-4839-8180-f63e44bdffe0 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:09.694074 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 69/133] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:35:09.697474 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-26f3d5b2-e3ab-49e3-aabb-cebbd69985ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:35:09.697474 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:09.697474 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:09.697474 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:09.697474 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:09.697474 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:09.697474 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:09.697474 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:09.697474 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:09.697474 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:09.697474 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:09.697474 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:09.697474 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:09.697474 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:09.697474 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:09.697474 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:09.698524 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:09.698524 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:09.698524 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:09.698524 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:09.698524 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:09.698524 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:09.698524 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:09.698524 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:09.698524 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:09.698524 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:09.698524 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:09.698524 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:09.698524 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:09.698524 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:09.698524 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:09.698524 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:09.699299 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:09.699299 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:09.699299 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:09.699299 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:09.699299 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:09.699299 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:09.699299 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:09.699299 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:09.699299 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:09.699299 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:09.699299 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:35:09.699299 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:35:09.699299 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 65/134] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:35:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:09.703349 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfaf7e2-7b4f-4467-97ee-31d661313d09 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:09.703636 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfaf7e2-7b4f-4467-97ee-31d661313d09 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:09.704183 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfaf7e2-7b4f-4467-97ee-31d661313d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:09.705094 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3d5b2-e3ab-49e3-aabb-cebbd69985ee None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:09.742360 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-4bfaf7e2-7b4f-4467-97ee-31d661313d09 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:09.743683 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-4bfaf7e2-7b4f-4467-97ee-31d661313d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:09.819855 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:09.889898 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 70/135] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:09.906422 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3d5b2-e3ab-49e3-aabb-cebbd69985ee None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:09.924671 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:09.934444 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfaf7e2-7b4f-4467-97ee-31d661313d09 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:09.943891 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d70a01-2d0b-4f79-a22e-67d395eb1772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:09.944525 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d70a01-2d0b-4f79-a22e-67d395eb1772 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:09.944817 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d70a01-2d0b-4f79-a22e-67d395eb1772 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:09.945151 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d70a01-2d0b-4f79-a22e-67d395eb1772 None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:09.945994 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d70a01-2d0b-4f79-a22e-67d395eb1772 None admin] RBAC: Adding query filter params (name=member) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:09.946386 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d70a01-2d0b-4f79-a22e-67d395eb1772 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:09.947805 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d70a01-2d0b-4f79-a22e-67d395eb1772 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:09.957113 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 66/136] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 5 20:35:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:35:09.969025 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d70a01-2d0b-4f79-a22e-67d395eb1772 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:10.150611 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfaf7e2-7b4f-4467-97ee-31d661313d09 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:10.180803 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d70a01-2d0b-4f79-a22e-67d395eb1772 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:10.238718 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ead7d-5bc3-4469-9d4e-854cca8d8a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:10.239472 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ead7d-5bc3-4469-9d4e-854cca8d8a6c None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:10.239757 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ead7d-5bc3-4469-9d4e-854cca8d8a6c None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:10.240059 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ead7d-5bc3-4469-9d4e-854cca8d8a6c None admin] PATH_INFO: `/v3/domains/default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:10.240850 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e74474-324b-4004-821b-e09a802d62a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:10.241941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e74474-324b-4004-821b-e09a802d62a4 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:10.242377 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e74474-324b-4004-821b-e09a802d62a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:10.242793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e74474-324b-4004-821b-e09a802d62a4 None admin] PATH_INFO: `/v3/users/0c42d09008734d94bf2a1073bbdfb052` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:10.242936 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ead7d-5bc3-4469-9d4e-854cca8d8a6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:10.245526 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ead7d-5bc3-4469-9d4e-854cca8d8a6c None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:10.246079 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 71/137] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:35:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:35:10.246581 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e74474-324b-4004-821b-e09a802d62a4 None admin] RBAC: Authorizing `identity:get_user(user_id=0c42d09008734d94bf2a1073bbdfb052)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:10.248371 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e74474-324b-4004-821b-e09a802d62a4 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:10.250245 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 67/138] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:35:09 2022] GET /identity/v3/users/0c42d09008734d94bf2a1073bbdfb052 => generated 275 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:10.259092 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ead7d-5bc3-4469-9d4e-854cca8d8a6c None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:10.271382 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e74474-324b-4004-821b-e09a802d62a4 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:10.342657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:10.354964 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:10.459087 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ead7d-5bc3-4469-9d4e-854cca8d8a6c None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:10.462032 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e74474-324b-4004-821b-e09a802d62a4 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:10.494831 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec08da-573c-4a3f-abeb-85cf5a30bb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:10.495429 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec08da-573c-4a3f-abeb-85cf5a30bb54 None admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:10.495916 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec08da-573c-4a3f-abeb-85cf5a30bb54 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:10.496076 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec08da-573c-4a3f-abeb-85cf5a30bb54 None admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:10.496807 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caec08da-573c-4a3f-abeb-85cf5a30bb54 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:10.503647 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caec08da-573c-4a3f-abeb-85cf5a30bb54 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:10.526444 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92922cce-5fb3-43c6-beae-b66972b822cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:10.527409 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92922cce-5fb3-43c6-beae-b66972b822cd None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:10.527684 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92922cce-5fb3-43c6-beae-b66972b822cd None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:10.528015 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92922cce-5fb3-43c6-beae-b66972b822cd None admin] PATH_INFO: `/v3/projects/e03d0b8a504a4625acde9366aa8adeac` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:10.530891 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92922cce-5fb3-43c6-beae-b66972b822cd None admin] RBAC: Authorizing `identity:get_project(project_id=e03d0b8a504a4625acde9366aa8adeac)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:10.533596 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92922cce-5fb3-43c6-beae-b66972b822cd None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:10.538795 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 68/139] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:10 2022] GET /identity/v3/projects/e03d0b8a504a4625acde9366aa8adeac => generated 312 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:35:10.541964 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4100b-fbe3-4466-9145-d19850811df7 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:10.542273 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4100b-fbe3-4466-9145-d19850811df7 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:10.542578 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4100b-fbe3-4466-9145-d19850811df7 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:10.545602 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 69/140] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:10.551059 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4100b-fbe3-4466-9145-d19850811df7 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:10.561995 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 72/141] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Jul 5 20:35:10 2022] POST /identity/v3/users => generated 283 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:35:10.569936 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb6cb8-6c52-4063-80ee-21d9b367e593 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:10.571445 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb6cb8-6c52-4063-80ee-21d9b367e593 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:10.571984 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb6cb8-6c52-4063-80ee-21d9b367e593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:10.616928 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-73cb6cb8-6c52-4063-80ee-21d9b367e593 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:10.621492 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-73cb6cb8-6c52-4063-80ee-21d9b367e593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:10.831196 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4100b-fbe3-4466-9145-d19850811df7 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:10.869108 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:10.907492 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac0868-a711-4920-91d9-4ea462d5414b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:10.908717 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac0868-a711-4920-91d9-4ea462d5414b None admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:10.909138 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac0868-a711-4920-91d9-4ea462d5414b None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:10.909547 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac0868-a711-4920-91d9-4ea462d5414b None admin] PATH_INFO: `/v3/projects/e03d0b8a504a4625acde9366aa8adeac/users/0c42d09008734d94bf2a1073bbdfb052/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:10.911993 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac0868-a711-4920-91d9-4ea462d5414b None admin] RBAC: Authorizing `identity:create_grant(project_id=e03d0b8a504a4625acde9366aa8adeac, user_id=0c42d09008734d94bf2a1073bbdfb052, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:10.913607 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac0868-a711-4920-91d9-4ea462d5414b None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:10.922453 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 73/142] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:10.956345 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 70/143] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 5 20:35:10 2022] PUT /identity/v3/projects/e03d0b8a504a4625acde9366aa8adeac/users/0c42d09008734d94bf2a1073bbdfb052/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:35:10.957765 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb6cb8-6c52-4063-80ee-21d9b367e593 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:11.005252 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:11.112596 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb6cb8-6c52-4063-80ee-21d9b367e593 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:11.155196 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655cabe6-e483-4e99-95f7-96622349a883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:11.156392 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655cabe6-e483-4e99-95f7-96622349a883 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:11.156898 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655cabe6-e483-4e99-95f7-96622349a883 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:11.157384 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655cabe6-e483-4e99-95f7-96622349a883 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:11.169393 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655cabe6-e483-4e99-95f7-96622349a883 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:11.178251 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-655cabe6-e483-4e99-95f7-96622349a883 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 20:35:11.178251 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:11.178251 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:11.178251 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:11.178251 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:11.178251 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:11.178251 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:11.178251 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:11.178251 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:11.178251 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:11.178251 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:11.178251 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:11.178251 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:11.178251 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:11.178251 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:11.178251 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:11.179189 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:11.179189 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:11.179189 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:11.179189 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:11.179189 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:11.179189 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:11.179189 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:11.179189 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:11.179189 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:11.179189 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:11.179189 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:11.179189 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:11.179189 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:11.179189 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:11.179189 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:11.179189 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:11.180012 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:11.180012 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:11.180012 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:11.180012 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:11.180012 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:11.180012 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:11.180012 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:11.180012 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:11.180012 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:11.180012 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:11.180012 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 20:35:11.180012 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:11.182685 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 74/144] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:35:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:11.188952 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac0868-a711-4920-91d9-4ea462d5414b None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:11.307840 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac0868-a711-4920-91d9-4ea462d5414b None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:11.344308 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f3c538-fb33-4cb7-842c-355bad362a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:11.345069 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3c538-fb33-4cb7-842c-355bad362a13 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:11.345263 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3c538-fb33-4cb7-842c-355bad362a13 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:11.345534 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3c538-fb33-4cb7-842c-355bad362a13 None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:11.346325 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f3c538-fb33-4cb7-842c-355bad362a13 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:11.346634 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f3c538-fb33-4cb7-842c-355bad362a13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:11.348036 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f3c538-fb33-4cb7-842c-355bad362a13 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:11.360714 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 71/145] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 5 20:35:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:11.366870 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655cabe6-e483-4e99-95f7-96622349a883 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:11.470224 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:11.491289 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655cabe6-e483-4e99-95f7-96622349a883 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:11.528690 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ee0ce-0872-42ac-a0ab-25316d407b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:11.529776 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ee0ce-0872-42ac-a0ab-25316d407b16 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:11.530280 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ee0ce-0872-42ac-a0ab-25316d407b16 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:11.530766 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ee0ce-0872-42ac-a0ab-25316d407b16 None admin] PATH_INFO: `/v3/users/8fba7c824655421394c750e3e30770e1` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:11.533214 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ee0ce-0872-42ac-a0ab-25316d407b16 None admin] RBAC: Authorizing `identity:get_user(user_id=8fba7c824655421394c750e3e30770e1)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:11.535865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ee0ce-0872-42ac-a0ab-25316d407b16 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:11.537814 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 75/146] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:35:11 2022] GET /identity/v3/users/8fba7c824655421394c750e3e30770e1 => generated 289 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:11.543686 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f3c538-fb33-4cb7-842c-355bad362a13 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:11.607796 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:11.684140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f3c538-fb33-4cb7-842c-355bad362a13 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:11.725595 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2f4d2-754f-4a2a-adb9-3b29e8f19ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:11.726530 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2f4d2-754f-4a2a-adb9-3b29e8f19ff2 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:11.726815 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2f4d2-754f-4a2a-adb9-3b29e8f19ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:11.727092 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2f4d2-754f-4a2a-adb9-3b29e8f19ff2 None admin] PATH_INFO: `/v3/projects/49b18126ef0a46788f631cd665c36e57` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:11.730678 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2f4d2-754f-4a2a-adb9-3b29e8f19ff2 None admin] RBAC: Authorizing `identity:get_project(project_id=49b18126ef0a46788f631cd665c36e57)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:11.732163 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2f4d2-754f-4a2a-adb9-3b29e8f19ff2 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:11.734340 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 72/147] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:11 2022] GET /identity/v3/projects/49b18126ef0a46788f631cd665c36e57 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:11.740260 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ee0ce-0872-42ac-a0ab-25316d407b16 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:11.889783 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ee0ce-0872-42ac-a0ab-25316d407b16 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:11.927634 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc4ec1-0916-4404-8a79-ae20df04965d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:11.928537 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc4ec1-0916-4404-8a79-ae20df04965d None admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:11.928815 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc4ec1-0916-4404-8a79-ae20df04965d None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:11.929086 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc4ec1-0916-4404-8a79-ae20df04965d None admin] PATH_INFO: `/v3/projects/49b18126ef0a46788f631cd665c36e57/users/8fba7c824655421394c750e3e30770e1/roles/ca2c6e2b56e14467bcd435e641e63880` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:11.933113 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cc4ec1-0916-4404-8a79-ae20df04965d None admin] RBAC: Authorizing `identity:create_grant(project_id=49b18126ef0a46788f631cd665c36e57, user_id=8fba7c824655421394c750e3e30770e1, role_id=ca2c6e2b56e14467bcd435e641e63880)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:11.934674 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cc4ec1-0916-4404-8a79-ae20df04965d None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:11.959790 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 76/148] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 5 20:35:11 2022] PUT /identity/v3/projects/49b18126ef0a46788f631cd665c36e57/users/8fba7c824655421394c750e3e30770e1/roles/ca2c6e2b56e14467bcd435e641e63880 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:35:12.159572 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef2a59-42af-465f-8831-fb55ab82301c None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:12.159955 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef2a59-42af-465f-8831-fb55ab82301c None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:12.160144 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef2a59-42af-465f-8831-fb55ab82301c None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:12.161502 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 73/149] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:12.167304 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af679d7-98ca-4c95-8f26-68e511806431 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:12.167617 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af679d7-98ca-4c95-8f26-68e511806431 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:12.167862 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af679d7-98ca-4c95-8f26-68e511806431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:12.191406 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-0af679d7-98ca-4c95-8f26-68e511806431 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:12.192560 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-0af679d7-98ca-4c95-8f26-68e511806431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:12.195731 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:12.269289 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 77/150] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:12.293274 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef2a59-42af-465f-8831-fb55ab82301c None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:12.400132 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85f1be-ca95-447d-9de8-30c34e03b232 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:12.400665 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85f1be-ca95-447d-9de8-30c34e03b232 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:12.400665 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85f1be-ca95-447d-9de8-30c34e03b232 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:12.406480 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 78/151] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:12.411905 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b8ef5-3b0f-4b9a-9f46-00b77d1e0a9f None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:12.412188 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b8ef5-3b0f-4b9a-9f46-00b77d1e0a9f None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:12.412460 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b8ef5-3b0f-4b9a-9f46-00b77d1e0a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:12.427475 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef2a59-42af-465f-8831-fb55ab82301c None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:12.435370 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:12.445992 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-994b8ef5-3b0f-4b9a-9f46-00b77d1e0a9f None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:12.447176 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-994b8ef5-3b0f-4b9a-9f46-00b77d1e0a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:12.495196 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aaf39c-34d4-4ef9-b9a2-caa6d6d5b39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:12.496025 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aaf39c-34d4-4ef9-b9a2-caa6d6d5b39f None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:12.496305 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aaf39c-34d4-4ef9-b9a2-caa6d6d5b39f None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:12.496578 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aaf39c-34d4-4ef9-b9a2-caa6d6d5b39f None admin] PATH_INFO: `/v3/roles/member` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:12.507622 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aaf39c-34d4-4ef9-b9a2-caa6d6d5b39f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:12.525980 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-54aaf39c-34d4-4ef9-b9a2-caa6d6d5b39f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:35:12.525980 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:12.525980 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:12.525980 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:12.525980 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:12.525980 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:12.525980 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:12.525980 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:12.525980 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:12.525980 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:12.525980 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:12.525980 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:12.525980 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:12.525980 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:12.525980 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:12.525980 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:12.526894 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:12.526894 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:12.526894 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:12.526894 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:12.526894 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:12.526894 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:12.526894 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:12.526894 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:12.526894 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:12.526894 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:12.526894 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:12.526894 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:12.526894 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:12.526894 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:12.526894 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:12.526894 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:12.527671 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:12.527671 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:12.527671 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:12.527671 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:12.527671 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:12.527671 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:12.527671 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:12.527671 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:12.527671 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:12.527671 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:12.527671 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:35:12.527671 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:35:12.527671 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 74/152] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:35:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:12.542678 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aaf39c-34d4-4ef9-b9a2-caa6d6d5b39f None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:12.564637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 79/153] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:12.602985 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b8ef5-3b0f-4b9a-9f46-00b77d1e0a9f None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:12.700895 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aaf39c-34d4-4ef9-b9a2-caa6d6d5b39f None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:12.775877 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbaed6-128b-490e-83ee-b0989a65a4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:12.776574 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbaed6-128b-490e-83ee-b0989a65a4d8 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:12.776854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbaed6-128b-490e-83ee-b0989a65a4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:12.777127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbaed6-128b-490e-83ee-b0989a65a4d8 None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:12.777909 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cbaed6-128b-490e-83ee-b0989a65a4d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:12.778215 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cbaed6-128b-490e-83ee-b0989a65a4d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:12.780278 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cbaed6-128b-490e-83ee-b0989a65a4d8 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:12.793453 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 75/154] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 5 20:35:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:12.799616 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbaed6-128b-490e-83ee-b0989a65a4d8 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:12.813293 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:12.851019 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:12.908332 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b8ef5-3b0f-4b9a-9f46-00b77d1e0a9f None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:13.006707 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8c548-a7af-4c81-bbeb-4bc3a13b500c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:13.007452 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8c548-a7af-4c81-bbeb-4bc3a13b500c None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:13.007740 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8c548-a7af-4c81-bbeb-4bc3a13b500c None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:13.008013 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8c548-a7af-4c81-bbeb-4bc3a13b500c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:13.009856 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbaed6-128b-490e-83ee-b0989a65a4d8 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:13.023937 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8c548-a7af-4c81-bbeb-4bc3a13b500c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:13.039198 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-13c8c548-a7af-4c81-bbeb-4bc3a13b500c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:35:13.039198 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:13.039198 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:13.039198 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:13.039198 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:13.039198 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:13.039198 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:13.039198 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:13.039198 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:13.039198 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:13.039198 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:13.039198 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:13.039198 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:13.039198 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:13.039198 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:13.039198 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:13.040118 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:13.040118 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:13.040118 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:13.040118 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:13.040118 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:13.040118 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:13.040118 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:13.040118 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:13.040118 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:13.040118 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:13.040118 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:13.040118 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:13.040118 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:13.040118 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:13.040118 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:13.040118 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:13.041084 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:13.041084 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:13.041084 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:13.041084 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:13.041084 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:13.041084 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:13.041084 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:13.041084 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:13.041084 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:13.041084 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:13.041084 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:35:13.041084 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:13.041084 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 80/155] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 5 20:35:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 438 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:13.042891 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73547db-e520-43d4-b74a-bf7e066970cf None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:13.042891 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73547db-e520-43d4-b74a-bf7e066970cf None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:13.042891 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73547db-e520-43d4-b74a-bf7e066970cf None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:13.043836 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 81/156] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:13.050049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd9d63-353f-4987-b372-fd444c5f8321 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:13.050864 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd9d63-353f-4987-b372-fd444c5f8321 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:13.051277 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd9d63-353f-4987-b372-fd444c5f8321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:13.081630 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf54b0e-7bbe-4541-b76b-69d94c8c5e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:13.082606 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf54b0e-7bbe-4541-b76b-69d94c8c5e93 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:13.082892 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf54b0e-7bbe-4541-b76b-69d94c8c5e93 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:13.083135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-4bcd9d63-353f-4987-b372-fd444c5f8321 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:13.083252 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf54b0e-7bbe-4541-b76b-69d94c8c5e93 None admin] PATH_INFO: `/v3/users/0c42d09008734d94bf2a1073bbdfb052` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:13.084734 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-4bcd9d63-353f-4987-b372-fd444c5f8321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:13.087517 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf54b0e-7bbe-4541-b76b-69d94c8c5e93 None admin] RBAC: Authorizing `identity:get_user(user_id=0c42d09008734d94bf2a1073bbdfb052)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:13.089064 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf54b0e-7bbe-4541-b76b-69d94c8c5e93 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:13.093867 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 76/157] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:35:12 2022] GET /identity/v3/users/0c42d09008734d94bf2a1073bbdfb052 => generated 275 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:35:13.093867 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf54b0e-7bbe-4541-b76b-69d94c8c5e93 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:13.233050 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 82/158] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:35:13.233806 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd9d63-353f-4987-b372-fd444c5f8321 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:13.330873 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:13.343826 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf54b0e-7bbe-4541-b76b-69d94c8c5e93 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:13.352269 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:13.419906 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861dd7fa-ce7c-4193-a181-9b26f276da4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:13.420671 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861dd7fa-ce7c-4193-a181-9b26f276da4e None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:13.420954 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861dd7fa-ce7c-4193-a181-9b26f276da4e None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:13.421227 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861dd7fa-ce7c-4193-a181-9b26f276da4e None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:13.421585 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd9d63-353f-4987-b372-fd444c5f8321 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:13.422055 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861dd7fa-ce7c-4193-a181-9b26f276da4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:13.422323 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861dd7fa-ce7c-4193-a181-9b26f276da4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:13.423732 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861dd7fa-ce7c-4193-a181-9b26f276da4e None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:13.441375 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 77/159] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:35:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:13.442263 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861dd7fa-ce7c-4193-a181-9b26f276da4e None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:13.484878 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7c940-f9e5-4a23-858a-902dbb482e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:13.485645 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7c940-f9e5-4a23-858a-902dbb482e23 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:13.485956 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7c940-f9e5-4a23-858a-902dbb482e23 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:13.486234 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7c940-f9e5-4a23-858a-902dbb482e23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:13.612959 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f7c940-f9e5-4a23-858a-902dbb482e23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:13.614561 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f7c940-f9e5-4a23-858a-902dbb482e23 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:13.633545 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861dd7fa-ce7c-4193-a181-9b26f276da4e None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:13.722259 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:13.726643 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb923fa9-5938-42a0-a2e0-3c23bef8060d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:13.730149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb923fa9-5938-42a0-a2e0-3c23bef8060d None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:13.730149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb923fa9-5938-42a0-a2e0-3c23bef8060d None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:13.730149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb923fa9-5938-42a0-a2e0-3c23bef8060d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:13.767276 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb923fa9-5938-42a0-a2e0-3c23bef8060d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:13.780772 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-fb923fa9-5938-42a0-a2e0-3c23bef8060d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:35:13.780772 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:13.780772 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:13.780772 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:13.780772 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:13.780772 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:13.780772 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:13.780772 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:13.780772 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:13.780772 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:13.780772 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:13.780772 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:13.780772 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:13.780772 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:13.780772 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:13.780772 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:13.781681 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:13.781681 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:13.781681 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:13.781681 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:13.781681 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:13.781681 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:13.781681 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:13.781681 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:13.781681 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:13.781681 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:13.781681 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:13.781681 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:13.781681 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:13.781681 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:13.781681 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:13.781681 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:13.782499 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:13.782499 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:13.782499 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:13.782499 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:13.782499 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:13.782499 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:13.782499 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:13.782499 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:13.782499 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:13.782499 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:13.782499 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:35:13.782499 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:35:13.782499 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 78/160] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 5 20:35:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:13.783142 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb923fa9-5938-42a0-a2e0-3c23bef8060d None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:13.785992 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 83/161] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:35:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:35:13.789919 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7c940-f9e5-4a23-858a-902dbb482e23 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:13.811912 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:13.972872 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb923fa9-5938-42a0-a2e0-3c23bef8060d None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:14.013716 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b279d-89af-43d3-8ddb-5130fcacf812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:14.014695 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b279d-89af-43d3-8ddb-5130fcacf812 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:14.014977 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b279d-89af-43d3-8ddb-5130fcacf812 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:14.015253 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b279d-89af-43d3-8ddb-5130fcacf812 None admin] PATH_INFO: `/v3/users/0aa59f315d9f4ee3a1a7a51f7ef6b880` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:14.018550 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b279d-89af-43d3-8ddb-5130fcacf812 None admin] RBAC: Authorizing `identity:get_user(user_id=0aa59f315d9f4ee3a1a7a51f7ef6b880)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:14.020577 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b279d-89af-43d3-8ddb-5130fcacf812 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:14.022694 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 79/162] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:35:13 2022] GET /identity/v3/users/0aa59f315d9f4ee3a1a7a51f7ef6b880 => generated 247 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:14.023474 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b279d-89af-43d3-8ddb-5130fcacf812 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:14.035911 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7c940-f9e5-4a23-858a-902dbb482e23 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:14.135469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd0c02-b204-45dd-9020-538bb5e9fab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:14.136191 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd0c02-b204-45dd-9020-538bb5e9fab6 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:14.136472 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd0c02-b204-45dd-9020-538bb5e9fab6 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:14.136745 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd0c02-b204-45dd-9020-538bb5e9fab6 None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:14.137487 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd0c02-b204-45dd-9020-538bb5e9fab6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:14.137803 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd0c02-b204-45dd-9020-538bb5e9fab6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:14.141042 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd0c02-b204-45dd-9020-538bb5e9fab6 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:14.159727 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 84/163] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:35:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:35:14.160581 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd0c02-b204-45dd-9020-538bb5e9fab6 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:14.187640 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:14.217651 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:14.224516 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b279d-89af-43d3-8ddb-5130fcacf812 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:14.317208 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1b132-0627-4507-825d-1bec749f3807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:14.318107 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1b132-0627-4507-825d-1bec749f3807 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:14.318383 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1b132-0627-4507-825d-1bec749f3807 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:14.318655 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1b132-0627-4507-825d-1bec749f3807 None admin] PATH_INFO: `/v3/projects/49b18126ef0a46788f631cd665c36e57` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:14.319847 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f1b132-0627-4507-825d-1bec749f3807 None admin] RBAC: Authorizing `identity:get_project(project_id=49b18126ef0a46788f631cd665c36e57)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:14.321315 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f1b132-0627-4507-825d-1bec749f3807 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:14.323228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 80/164] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:14 2022] GET /identity/v3/projects/49b18126ef0a46788f631cd665c36e57 => generated 298 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:14.328288 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1b132-0627-4507-825d-1bec749f3807 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:14.368964 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd0c02-b204-45dd-9020-538bb5e9fab6 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:14.451950 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955902b-841b-492d-b7a9-d31b07f9a45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:14.452746 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955902b-841b-492d-b7a9-d31b07f9a45e None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:14.452915 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955902b-841b-492d-b7a9-d31b07f9a45e None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:14.453151 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955902b-841b-492d-b7a9-d31b07f9a45e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:14.503888 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1b132-0627-4507-825d-1bec749f3807 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:14.568281 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55c573-6503-49ff-9e0c-ce339839fe09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:14.569190 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55c573-6503-49ff-9e0c-ce339839fe09 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:14.569471 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55c573-6503-49ff-9e0c-ce339839fe09 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:14.569673 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955902b-841b-492d-b7a9-d31b07f9a45e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:14.569789 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55c573-6503-49ff-9e0c-ce339839fe09 None admin] PATH_INFO: `/v3/users/0c42d09008734d94bf2a1073bbdfb052` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:14.571262 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955902b-841b-492d-b7a9-d31b07f9a45e None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:14.574614 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55c573-6503-49ff-9e0c-ce339839fe09 None admin] RBAC: Authorizing `identity:get_user(user_id=0c42d09008734d94bf2a1073bbdfb052)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:14.576095 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55c573-6503-49ff-9e0c-ce339839fe09 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:14.577889 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 81/165] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:35:14 2022] GET /identity/v3/users/0c42d09008734d94bf2a1073bbdfb052 => generated 275 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:14.578672 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55c573-6503-49ff-9e0c-ce339839fe09 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:14.599461 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:14.632492 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:14.724462 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 85/166] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:35:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:35:14.725992 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719f44c-1234-45ce-8eef-029bf9c36e2e None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:14.726279 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719f44c-1234-45ce-8eef-029bf9c36e2e None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:14.726553 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719f44c-1234-45ce-8eef-029bf9c36e2e None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:14.728110 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 86/167] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:14.728815 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719f44c-1234-45ce-8eef-029bf9c36e2e None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:14.763514 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55c573-6503-49ff-9e0c-ce339839fe09 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:14.838599 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ffca3-12b4-4335-9f35-31796b0edcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:14.839287 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ffca3-12b4-4335-9f35-31796b0edcd5 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:14.839571 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ffca3-12b4-4335-9f35-31796b0edcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:14.839845 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ffca3-12b4-4335-9f35-31796b0edcd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:14.840720 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ffca3-12b4-4335-9f35-31796b0edcd5 None admin] RBAC: Adding query filter params (role.id=8dc2563a47c540cfa548eb210d02066e, scope.project.id=49b18126ef0a46788f631cd665c36e57, user.id=0c42d09008734d94bf2a1073bbdfb052) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:14.841031 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ffca3-12b4-4335-9f35-31796b0edcd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:14.842690 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ffca3-12b4-4335-9f35-31796b0edcd5 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:14.849861 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 82/168] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:35:14 2022] GET /identity/v3/role_assignments?user.id=0c42d09008734d94bf2a1073bbdfb052&scope.project.id=49b18126ef0a46788f631cd665c36e57&role.id=8dc2563a47c540cfa548eb210d02066e => generated 608 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:14.850672 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ffca3-12b4-4335-9f35-31796b0edcd5 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:14.914746 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719f44c-1234-45ce-8eef-029bf9c36e2e None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:14.948992 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:14.968998 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222caef7-49f2-4dea-b122-c4aa36079c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:14.969714 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222caef7-49f2-4dea-b122-c4aa36079c74 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:14.970016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222caef7-49f2-4dea-b122-c4aa36079c74 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:14.970290 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222caef7-49f2-4dea-b122-c4aa36079c74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:15.090137 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222caef7-49f2-4dea-b122-c4aa36079c74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:15.091220 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:15.095778 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222caef7-49f2-4dea-b122-c4aa36079c74 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:15.129608 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ffca3-12b4-4335-9f35-31796b0edcd5 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:15.211528 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf2916-f7a2-43b2-963d-a7a1e62f69a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:15.212419 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf2916-f7a2-43b2-963d-a7a1e62f69a6 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:15.212695 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf2916-f7a2-43b2-963d-a7a1e62f69a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:15.212964 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf2916-f7a2-43b2-963d-a7a1e62f69a6 None admin] PATH_INFO: `/v3/projects/49b18126ef0a46788f631cd665c36e57` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:15.215174 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf2916-f7a2-43b2-963d-a7a1e62f69a6 None admin] RBAC: Authorizing `identity:get_project(project_id=49b18126ef0a46788f631cd665c36e57)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:15.216641 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf2916-f7a2-43b2-963d-a7a1e62f69a6 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:15.218599 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 83/169] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:14 2022] GET /identity/v3/projects/49b18126ef0a46788f631cd665c36e57 => generated 298 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:15.219575 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010f564-298e-43dc-8eab-4c020af3d1a2 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:15.219853 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010f564-298e-43dc-8eab-4c020af3d1a2 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:15.220124 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010f564-298e-43dc-8eab-4c020af3d1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:15.261143 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 87/170] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:35:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:35:15.262516 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697d946-4175-4ba5-bef9-4741f0b205fe None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:15.262798 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697d946-4175-4ba5-bef9-4741f0b205fe None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:15.263069 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697d946-4175-4ba5-bef9-4741f0b205fe None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:15.264597 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 88/171] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:15.265140 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697d946-4175-4ba5-bef9-4741f0b205fe None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:15.266092 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-4010f564-298e-43dc-8eab-4c020af3d1a2 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:15.267304 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-4010f564-298e-43dc-8eab-4c020af3d1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:15.317742 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:15.381084 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 84/172] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:15.382432 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f580646-6dfc-4d70-befa-910f7e05d34f None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:15.382719 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f580646-6dfc-4d70-befa-910f7e05d34f None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:15.383000 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f580646-6dfc-4d70-befa-910f7e05d34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:15.399941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-5f580646-6dfc-4d70-befa-910f7e05d34f None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:15.401178 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-5f580646-6dfc-4d70-befa-910f7e05d34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:15.412404 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697d946-4175-4ba5-bef9-4741f0b205fe None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:15.448746 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fac28e-3a42-403d-93f9-38fae01174f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:15.449403 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fac28e-3a42-403d-93f9-38fae01174f1 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:15.449681 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fac28e-3a42-403d-93f9-38fae01174f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:15.449985 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fac28e-3a42-403d-93f9-38fae01174f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:15.450824 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fac28e-3a42-403d-93f9-38fae01174f1 None admin] RBAC: Adding query filter params (role.id=37ba4a62052348d4811b560c19a07e02, scope.project.id=49b18126ef0a46788f631cd665c36e57, user.id=0aa59f315d9f4ee3a1a7a51f7ef6b880) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:15.451129 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fac28e-3a42-403d-93f9-38fae01174f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:15.452663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fac28e-3a42-403d-93f9-38fae01174f1 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:15.459247 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 89/173] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:35:15 2022] GET /identity/v3/role_assignments?user.id=0aa59f315d9f4ee3a1a7a51f7ef6b880&scope.project.id=49b18126ef0a46788f631cd665c36e57&role.id=37ba4a62052348d4811b560c19a07e02 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:15.460130 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fac28e-3a42-403d-93f9-38fae01174f1 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:15.473740 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 85/174] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:15.475106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ae55b-64e4-460b-8b8d-7d1bc3633ece None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:15.475312 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ae55b-64e4-460b-8b8d-7d1bc3633ece None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:15.475590 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ae55b-64e4-460b-8b8d-7d1bc3633ece None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:15.477133 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 86/175] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:15.477750 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ae55b-64e4-460b-8b8d-7d1bc3633ece None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:15.499650 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:15.555105 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:15.573538 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fac28e-3a42-403d-93f9-38fae01174f1 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:15.622393 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024dba55-3a57-4f4e-b5f3-aeba44788845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:15.623796 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024dba55-3a57-4f4e-b5f3-aeba44788845 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:15.624219 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024dba55-3a57-4f4e-b5f3-aeba44788845 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:15.624329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ae55b-64e4-460b-8b8d-7d1bc3633ece None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:15.625079 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024dba55-3a57-4f4e-b5f3-aeba44788845 None admin] PATH_INFO: `/v3/projects/49b18126ef0a46788f631cd665c36e57` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:15.627864 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024dba55-3a57-4f4e-b5f3-aeba44788845 None admin] RBAC: Authorizing `identity:get_project(project_id=49b18126ef0a46788f631cd665c36e57)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:15.629586 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024dba55-3a57-4f4e-b5f3-aeba44788845 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:15.631692 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 90/176] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:15 2022] GET /identity/v3/projects/49b18126ef0a46788f631cd665c36e57 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:15.633990 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab0582-bc42-4fbd-b733-bf0adfada523 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:15.634443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab0582-bc42-4fbd-b733-bf0adfada523 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:15.634883 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab0582-bc42-4fbd-b733-bf0adfada523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:15.660591 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-4bab0582-bc42-4fbd-b733-bf0adfada523 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:15.662397 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-4bab0582-bc42-4fbd-b733-bf0adfada523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:15.665521 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbdfd9a-b104-47d2-b0f7-c762bed5a3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:15.666512 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdfd9a-b104-47d2-b0f7-c762bed5a3f7 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:15.666788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdfd9a-b104-47d2-b0f7-c762bed5a3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:15.667053 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdfd9a-b104-47d2-b0f7-c762bed5a3f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:15.680848 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbdfd9a-b104-47d2-b0f7-c762bed5a3f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:15.689432 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-adbdfd9a-b104-47d2-b0f7-c762bed5a3f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:35:15.689432 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:15.689432 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:15.689432 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:15.689432 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:15.689432 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:15.689432 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:15.689432 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:15.689432 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:15.689432 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:15.689432 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:15.689432 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:15.689432 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:15.689432 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:15.689432 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:15.689432 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:15.690819 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:15.690819 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:15.690819 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:15.690819 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:15.690819 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:15.690819 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:15.690819 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:15.690819 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:15.690819 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:15.690819 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:15.690819 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:15.690819 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:15.690819 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:15.690819 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:15.690819 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:15.690819 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:15.691594 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:15.691594 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:15.691594 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:15.691594 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:15.691594 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:15.691594 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:15.691594 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:15.691594 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:15.691594 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:15.691594 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:15.691594 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:35:15.691594 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:35:15.691594 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 87/177] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:35:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:15.696098 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbdfd9a-b104-47d2-b0f7-c762bed5a3f7 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:15.746164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 91/178] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:15.747581 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c716d-08c0-4ade-98e5-71916a02a9a5 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:15.747865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c716d-08c0-4ade-98e5-71916a02a9a5 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:15.748259 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c716d-08c0-4ade-98e5-71916a02a9a5 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:15.749650 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 92/179] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:15.753743 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c716d-08c0-4ade-98e5-71916a02a9a5 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:15.805940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:15.834152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbdfd9a-b104-47d2-b0f7-c762bed5a3f7 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:15.852968 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:15.870152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857e6c2-7b06-43e3-be97-091dd1b5a13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:15.870960 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857e6c2-7b06-43e3-be97-091dd1b5a13d None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:15.871062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c716d-08c0-4ade-98e5-71916a02a9a5 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:15.871241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857e6c2-7b06-43e3-be97-091dd1b5a13d None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:15.871515 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857e6c2-7b06-43e3-be97-091dd1b5a13d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:15.882308 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8857e6c2-7b06-43e3-be97-091dd1b5a13d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:15.890130 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-8857e6c2-7b06-43e3-be97-091dd1b5a13d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:35:15.890130 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:15.890130 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:15.890130 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:15.890130 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:15.890130 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:15.890130 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:15.890130 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:15.890130 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:15.890130 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:15.890130 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:15.890130 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:15.890130 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:15.890130 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:15.890130 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:15.890130 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:15.891016 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:15.891016 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:15.891016 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:15.891016 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:15.891016 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:15.891016 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:15.891016 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:15.891016 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:15.891016 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:15.891016 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:15.891016 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:15.891016 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:15.891016 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:15.891016 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:15.891016 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:15.891016 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:15.891813 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:15.891813 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:15.891813 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:15.891813 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:15.891813 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:15.891813 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:15.891813 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:15.891813 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:15.891813 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:15.891813 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:15.891813 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:35:15.891813 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:35:15.891813 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 88/180] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 5 20:35:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:15.892474 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857e6c2-7b06-43e3-be97-091dd1b5a13d None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:15.911817 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c7d08-dcc8-4e92-a07e-ee1ad6f399fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:15.912552 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c7d08-dcc8-4e92-a07e-ee1ad6f399fc None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:15.912895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c7d08-dcc8-4e92-a07e-ee1ad6f399fc None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:15.913234 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c7d08-dcc8-4e92-a07e-ee1ad6f399fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:15.914186 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51c7d08-dcc8-4e92-a07e-ee1ad6f399fc None admin] RBAC: Adding query filter params (role.id=c403525d65944d2187540a6d893b91e7, scope.project.id=49b18126ef0a46788f631cd665c36e57, user.id=0c42d09008734d94bf2a1073bbdfb052) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:15.914558 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51c7d08-dcc8-4e92-a07e-ee1ad6f399fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:15.916078 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51c7d08-dcc8-4e92-a07e-ee1ad6f399fc None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:15.922196 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 93/181] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:35:15 2022] GET /identity/v3/role_assignments?user.id=0c42d09008734d94bf2a1073bbdfb052&scope.project.id=49b18126ef0a46788f631cd665c36e57&role.id=c403525d65944d2187540a6d893b91e7 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:15.923457 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c91bd-d9b9-445b-9d36-8c4b636e5071 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:15.923738 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c91bd-d9b9-445b-9d36-8c4b636e5071 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:15.924008 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c91bd-d9b9-445b-9d36-8c4b636e5071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:15.953497 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-9a9c91bd-d9b9-445b-9d36-8c4b636e5071 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:15.954306 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-9a9c91bd-d9b9-445b-9d36-8c4b636e5071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:16.030338 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857e6c2-7b06-43e3-be97-091dd1b5a13d None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:16.034095 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 94/182] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:16.034095 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c91bd-d9b9-445b-9d36-8c4b636e5071 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:16.070912 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda74a8-3fbc-478c-a7ff-206bed290cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:16.071608 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda74a8-3fbc-478c-a7ff-206bed290cb1 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:16.071892 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda74a8-3fbc-478c-a7ff-206bed290cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:16.072172 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda74a8-3fbc-478c-a7ff-206bed290cb1 None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:16.072945 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda74a8-3fbc-478c-a7ff-206bed290cb1 None admin] RBAC: Adding query filter params (name=member) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:16.073260 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda74a8-3fbc-478c-a7ff-206bed290cb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:16.074852 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda74a8-3fbc-478c-a7ff-206bed290cb1 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:16.076664 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:16.090002 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 89/183] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 5 20:35:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:16.091346 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda74a8-3fbc-478c-a7ff-206bed290cb1 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:16.122182 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:16.148113 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c91bd-d9b9-445b-9d36-8c4b636e5071 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:16.182454 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e12f5c-704b-4367-bdfb-5486622adf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:16.183266 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e12f5c-704b-4367-bdfb-5486622adf3b None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:16.183572 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e12f5c-704b-4367-bdfb-5486622adf3b None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:16.183843 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e12f5c-704b-4367-bdfb-5486622adf3b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:16.194690 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e12f5c-704b-4367-bdfb-5486622adf3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:16.202386 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda74a8-3fbc-478c-a7ff-206bed290cb1 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:16.202533 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-20e12f5c-704b-4367-bdfb-5486622adf3b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 20:35:16.202533 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:16.202533 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:16.202533 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:16.202533 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:16.202533 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:16.202533 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:16.202533 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:16.202533 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:16.202533 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:16.202533 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:16.202533 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:16.202533 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:16.202533 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:16.202533 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:16.202533 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:16.203517 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:16.203517 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:16.203517 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:16.203517 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:16.203517 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:16.203517 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:16.203517 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:16.203517 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:16.203517 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:16.203517 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:16.203517 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:16.203517 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:16.203517 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:16.203517 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:16.203517 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:16.203517 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:16.209240 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:16.209240 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:16.209240 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:16.209240 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:16.209240 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:16.209240 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:16.209240 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:16.209240 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:16.209240 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:16.209240 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:16.209240 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 20:35:16.209240 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:16.209240 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 95/184] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:35:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:16.209240 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e574e-a5b6-4f4c-a717-bc9fb2a4a833 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:16.210121 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e574e-a5b6-4f4c-a717-bc9fb2a4a833 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:16.210121 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e574e-a5b6-4f4c-a717-bc9fb2a4a833 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:16.210121 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 96/185] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:16.210121 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e574e-a5b6-4f4c-a717-bc9fb2a4a833 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:16.246415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01783fc2-6323-4ecb-a958-12fb2e296ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:16.247091 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01783fc2-6323-4ecb-a958-12fb2e296ff2 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:16.247373 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01783fc2-6323-4ecb-a958-12fb2e296ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:16.247649 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01783fc2-6323-4ecb-a958-12fb2e296ff2 None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:16.248423 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01783fc2-6323-4ecb-a958-12fb2e296ff2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:16.248728 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01783fc2-6323-4ecb-a958-12fb2e296ff2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:16.250167 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01783fc2-6323-4ecb-a958-12fb2e296ff2 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:16.258806 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 90/186] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:35:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:16.259591 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01783fc2-6323-4ecb-a958-12fb2e296ff2 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:16.315305 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:16.316027 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e574e-a5b6-4f4c-a717-bc9fb2a4a833 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:16.349723 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73b080-4ed5-4ebf-b4d3-8235eea0d02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:16.350557 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73b080-4ed5-4ebf-b4d3-8235eea0d02a None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:16.350836 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73b080-4ed5-4ebf-b4d3-8235eea0d02a None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:16.351108 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73b080-4ed5-4ebf-b4d3-8235eea0d02a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:16.356866 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01783fc2-6323-4ecb-a958-12fb2e296ff2 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:16.357928 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:16.362935 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73b080-4ed5-4ebf-b4d3-8235eea0d02a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:16.371243 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-ec73b080-4ed5-4ebf-b4d3-8235eea0d02a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:35:16.371243 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:16.371243 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:16.371243 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:16.371243 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:16.371243 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:16.371243 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:16.371243 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:16.371243 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:16.371243 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:16.371243 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:16.371243 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:16.371243 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:16.371243 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:16.371243 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:16.371243 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:16.372125 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:16.372125 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:16.372125 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:16.372125 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:16.372125 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:16.372125 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:16.372125 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:16.372125 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:16.372125 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:16.372125 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:16.372125 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:16.372125 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:16.372125 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:16.372125 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:16.372125 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:16.372125 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:16.372936 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:16.372936 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:16.372936 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:16.372936 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:16.372936 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:16.372936 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:16.372936 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:16.372936 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:16.372936 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:16.372936 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:16.372936 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:35:16.372936 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:16.372936 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 97/187] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 5 20:35:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:16.374968 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73b080-4ed5-4ebf-b4d3-8235eea0d02a None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:16.391554 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113dc61-b47c-44c3-972b-e78ce2ddbd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:16.392443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113dc61-b47c-44c3-972b-e78ce2ddbd49 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:16.392726 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113dc61-b47c-44c3-972b-e78ce2ddbd49 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:16.393009 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113dc61-b47c-44c3-972b-e78ce2ddbd49 None admin] PATH_INFO: `/v3/users/0c42d09008734d94bf2a1073bbdfb052` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:16.394302 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113dc61-b47c-44c3-972b-e78ce2ddbd49 None admin] RBAC: Authorizing `identity:get_user(user_id=0c42d09008734d94bf2a1073bbdfb052)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:16.395723 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113dc61-b47c-44c3-972b-e78ce2ddbd49 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:16.397375 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 91/188] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:35:16 2022] GET /identity/v3/users/0c42d09008734d94bf2a1073bbdfb052 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:16.402994 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e26e3-97ad-4f16-9243-56f15e932dd0 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:16.403282 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e26e3-97ad-4f16-9243-56f15e932dd0 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:16.403568 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e26e3-97ad-4f16-9243-56f15e932dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:16.419512 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-b00e26e3-97ad-4f16-9243-56f15e932dd0 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:16.420698 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-b00e26e3-97ad-4f16-9243-56f15e932dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:16.473141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73b080-4ed5-4ebf-b4d3-8235eea0d02a None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:16.486467 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 92/189] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:16.494219 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e26e3-97ad-4f16-9243-56f15e932dd0 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:16.519006 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f0617-3056-4583-a7d0-28bf6958ed1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:16.519661 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f0617-3056-4583-a7d0-28bf6958ed1b None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:16.519947 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f0617-3056-4583-a7d0-28bf6958ed1b None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:16.520203 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f0617-3056-4583-a7d0-28bf6958ed1b None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:16.520941 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f0617-3056-4583-a7d0-28bf6958ed1b None admin] RBAC: Adding query filter params (name=reader) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:16.521234 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f0617-3056-4583-a7d0-28bf6958ed1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:16.522647 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f0617-3056-4583-a7d0-28bf6958ed1b None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:16.531033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 98/190] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 5 20:35:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:16.531997 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f0617-3056-4583-a7d0-28bf6958ed1b None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:16.542381 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:16.586081 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e26e3-97ad-4f16-9243-56f15e932dd0 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:16.589680 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:16.620211 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0976e-5015-440b-865e-a8764cd53546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:16.621096 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0976e-5015-440b-865e-a8764cd53546 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:16.621374 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0976e-5015-440b-865e-a8764cd53546 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:16.621650 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0976e-5015-440b-865e-a8764cd53546 None admin] PATH_INFO: `/v3/users/59456331eb9a4f23af59a0bd248a36fa` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:16.629914 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f0617-3056-4583-a7d0-28bf6958ed1b None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:16.635233 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b0976e-5015-440b-865e-a8764cd53546 None admin] RBAC: Authorizing `identity:get_user(user_id=59456331eb9a4f23af59a0bd248a36fa)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:16.636719 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b0976e-5015-440b-865e-a8764cd53546 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:16.638604 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 93/191] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:35:16 2022] GET /identity/v3/users/59456331eb9a4f23af59a0bd248a36fa => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:16.639401 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0976e-5015-440b-865e-a8764cd53546 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:16.663708 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe80ed5-4d79-4d36-ad15-e7dfcdcd34bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:16.664304 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe80ed5-4d79-4d36-ad15-e7dfcdcd34bb None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:16.664584 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe80ed5-4d79-4d36-ad15-e7dfcdcd34bb None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:16.664856 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe80ed5-4d79-4d36-ad15-e7dfcdcd34bb None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:16.665607 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe80ed5-4d79-4d36-ad15-e7dfcdcd34bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:16.665944 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe80ed5-4d79-4d36-ad15-e7dfcdcd34bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:16.667368 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe80ed5-4d79-4d36-ad15-e7dfcdcd34bb None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:16.675600 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 99/192] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:35:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:16.677482 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe80ed5-4d79-4d36-ad15-e7dfcdcd34bb None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:16.740603 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0976e-5015-440b-865e-a8764cd53546 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:16.755288 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:16.774422 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b600347-f59f-4082-8e9d-aac97297da7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:16.775071 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b600347-f59f-4082-8e9d-aac97297da7e None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:16.775353 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b600347-f59f-4082-8e9d-aac97297da7e None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:16.775630 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b600347-f59f-4082-8e9d-aac97297da7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:16.785582 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe80ed5-4d79-4d36-ad15-e7dfcdcd34bb None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:16.809251 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:16.821148 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca4e30-de6d-4aff-8ae8-59f7b7831e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:16.821974 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca4e30-de6d-4aff-8ae8-59f7b7831e5a None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:16.822256 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca4e30-de6d-4aff-8ae8-59f7b7831e5a None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:16.822528 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca4e30-de6d-4aff-8ae8-59f7b7831e5a None admin] PATH_INFO: `/v3/domains/default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:16.823696 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dca4e30-de6d-4aff-8ae8-59f7b7831e5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:16.825196 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dca4e30-de6d-4aff-8ae8-59f7b7831e5a None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:16.826945 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 100/193] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:35:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:16.827706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca4e30-de6d-4aff-8ae8-59f7b7831e5a None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:16.844504 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b600347-f59f-4082-8e9d-aac97297da7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:16.846044 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b600347-f59f-4082-8e9d-aac97297da7e None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:16.927307 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca4e30-de6d-4aff-8ae8-59f7b7831e5a None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:16.942298 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 94/194] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:35:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:35:16.947620 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b600347-f59f-4082-8e9d-aac97297da7e None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:16.962422 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:16.963692 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a873bc-9561-4805-a639-8f4da35ca422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:16.964583 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a873bc-9561-4805-a639-8f4da35ca422 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:16.964892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a873bc-9561-4805-a639-8f4da35ca422 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:16.965196 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a873bc-9561-4805-a639-8f4da35ca422 None admin] PATH_INFO: `/v3/users/8fba7c824655421394c750e3e30770e1` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:16.966517 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a873bc-9561-4805-a639-8f4da35ca422 None admin] RBAC: Authorizing `identity:get_user(user_id=8fba7c824655421394c750e3e30770e1)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:16.967988 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a873bc-9561-4805-a639-8f4da35ca422 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:16.969815 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 101/195] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:35:16 2022] GET /identity/v3/users/8fba7c824655421394c750e3e30770e1 => generated 289 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:16.970487 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a873bc-9561-4805-a639-8f4da35ca422 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:17.036646 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:17.058863 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b600347-f59f-4082-8e9d-aac97297da7e None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:17.086095 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a873bc-9561-4805-a639-8f4da35ca422 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:17.093870 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6a392-24fd-46d9-9e74-a7147672ef03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:17.094547 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6a392-24fd-46d9-9e74-a7147672ef03 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:17.094829 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6a392-24fd-46d9-9e74-a7147672ef03 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:17.095100 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6a392-24fd-46d9-9e74-a7147672ef03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:17.120946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37777d61-7c90-46b5-ab80-9f68b486a53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:17.121860 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37777d61-7c90-46b5-ab80-9f68b486a53d None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:17.122172 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37777d61-7c90-46b5-ab80-9f68b486a53d None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:17.122449 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37777d61-7c90-46b5-ab80-9f68b486a53d None admin] PATH_INFO: `/v3/users/59456331eb9a4f23af59a0bd248a36fa` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:17.123725 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37777d61-7c90-46b5-ab80-9f68b486a53d None admin] RBAC: Authorizing `identity:get_user(user_id=59456331eb9a4f23af59a0bd248a36fa)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:17.125195 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37777d61-7c90-46b5-ab80-9f68b486a53d None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:17.126874 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 102/196] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:35:16 2022] GET /identity/v3/users/59456331eb9a4f23af59a0bd248a36fa => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:17.127615 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37777d61-7c90-46b5-ab80-9f68b486a53d None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:17.169930 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a6a392-24fd-46d9-9e74-a7147672ef03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:17.171440 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a6a392-24fd-46d9-9e74-a7147672ef03 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:17.189221 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:17.234112 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37777d61-7c90-46b5-ab80-9f68b486a53d None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:17.259492 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:17.269411 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2d87e-6909-46d8-b724-d172321fc2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:17.270110 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2d87e-6909-46d8-b724-d172321fc2ec None admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:17.270389 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2d87e-6909-46d8-b724-d172321fc2ec None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:17.270659 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2d87e-6909-46d8-b724-d172321fc2ec None admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:17.271367 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce2d87e-6909-46d8-b724-d172321fc2ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:17.272783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 95/197] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:35:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:35:17.272883 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce2d87e-6909-46d8-b724-d172321fc2ec None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:17.273633 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6a392-24fd-46d9-9e74-a7147672ef03 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:17.293004 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 103/198] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Jul 5 20:35:17 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:35:17.293957 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2d87e-6909-46d8-b724-d172321fc2ec None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:17.392172 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6a392-24fd-46d9-9e74-a7147672ef03 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:17.408383 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:17.430464 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2d87e-6909-46d8-b724-d172321fc2ec None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:17.432028 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deab818-d68b-4198-9b7c-32dec75847b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:17.432988 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deab818-d68b-4198-9b7c-32dec75847b8 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:17.433341 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deab818-d68b-4198-9b7c-32dec75847b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:17.433676 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deab818-d68b-4198-9b7c-32dec75847b8 None admin] PATH_INFO: `/v3/projects/e03d0b8a504a4625acde9366aa8adeac` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:17.435037 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deab818-d68b-4198-9b7c-32dec75847b8 None admin] RBAC: Authorizing `identity:get_project(project_id=e03d0b8a504a4625acde9366aa8adeac)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:17.436653 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deab818-d68b-4198-9b7c-32dec75847b8 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:17.443351 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 96/199] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:17 2022] GET /identity/v3/projects/e03d0b8a504a4625acde9366aa8adeac => generated 312 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:17.443351 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deab818-d68b-4198-9b7c-32dec75847b8 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:17.482973 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10d3d8-9e62-4da4-bbe0-eea6e97912a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:17.484063 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10d3d8-9e62-4da4-bbe0-eea6e97912a1 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:17.484348 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10d3d8-9e62-4da4-bbe0-eea6e97912a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:17.484648 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10d3d8-9e62-4da4-bbe0-eea6e97912a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:17.544300 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:17.558771 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deab818-d68b-4198-9b7c-32dec75847b8 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:17.575084 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c10d3d8-9e62-4da4-bbe0-eea6e97912a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:17.577483 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c10d3d8-9e62-4da4-bbe0-eea6e97912a1 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:17.602896 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b483a39-cf3e-47a8-b234-fb8bb19bbd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:17.603576 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b483a39-cf3e-47a8-b234-fb8bb19bbd8d None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:17.604120 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b483a39-cf3e-47a8-b234-fb8bb19bbd8d None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:17.605148 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b483a39-cf3e-47a8-b234-fb8bb19bbd8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:17.667354 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:17.693964 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b483a39-cf3e-47a8-b234-fb8bb19bbd8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:17.695393 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b483a39-cf3e-47a8-b234-fb8bb19bbd8d None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:17.695711 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 104/200] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:35:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:35:17.696747 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10d3d8-9e62-4da4-bbe0-eea6e97912a1 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:17.787618 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:17.808813 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10d3d8-9e62-4da4-bbe0-eea6e97912a1 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:17.826162 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 97/201] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:35:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:35:17.827519 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b483a39-cf3e-47a8-b234-fb8bb19bbd8d None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:17.847801 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d89ed-3b8d-40aa-bf86-1c129b1b6648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:17.848772 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d89ed-3b8d-40aa-bf86-1c129b1b6648 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:17.849247 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d89ed-3b8d-40aa-bf86-1c129b1b6648 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:17.849861 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d89ed-3b8d-40aa-bf86-1c129b1b6648 None admin] PATH_INFO: `/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:17.851755 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d89ed-3b8d-40aa-bf86-1c129b1b6648 None admin] RBAC: Authorizing `identity:get_project(project_id=2ceac2e500814d1f9e4b6160e2b6b2bb)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:17.854234 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d89ed-3b8d-40aa-bf86-1c129b1b6648 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:17.856041 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 105/202] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:17 2022] GET /identity/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:17.861711 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d89ed-3b8d-40aa-bf86-1c129b1b6648 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:17.929498 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:17.951572 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b483a39-cf3e-47a8-b234-fb8bb19bbd8d None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:17.985614 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d89ed-3b8d-40aa-bf86-1c129b1b6648 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:17.987389 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a123d4-19ac-4726-bb1f-a8f1a794a2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:17.988153 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a123d4-19ac-4726-bb1f-a8f1a794a2ec None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:17.988433 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a123d4-19ac-4726-bb1f-a8f1a794a2ec None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:17.988705 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a123d4-19ac-4726-bb1f-a8f1a794a2ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:17.989748 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a123d4-19ac-4726-bb1f-a8f1a794a2ec None admin] RBAC: Adding query filter params (role.id=8dc2563a47c540cfa548eb210d02066e, scope.project.id=e03d0b8a504a4625acde9366aa8adeac, user.id=0c42d09008734d94bf2a1073bbdfb052) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:17.989882 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a123d4-19ac-4726-bb1f-a8f1a794a2ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:17.991340 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a123d4-19ac-4726-bb1f-a8f1a794a2ec None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:17.997855 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 98/203] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:35:17 2022] GET /identity/v3/role_assignments?user.id=0c42d09008734d94bf2a1073bbdfb052&scope.project.id=e03d0b8a504a4625acde9366aa8adeac&role.id=8dc2563a47c540cfa548eb210d02066e => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:17.998790 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a123d4-19ac-4726-bb1f-a8f1a794a2ec None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:18.031076 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12237e90-806e-45e2-8ba5-7978a3f7cfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:18.032841 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12237e90-806e-45e2-8ba5-7978a3f7cfbd None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:18.033262 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12237e90-806e-45e2-8ba5-7978a3f7cfbd None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:18.033671 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12237e90-806e-45e2-8ba5-7978a3f7cfbd None admin] PATH_INFO: `/v3/projects/49b18126ef0a46788f631cd665c36e57` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:18.035281 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12237e90-806e-45e2-8ba5-7978a3f7cfbd None admin] RBAC: Authorizing `identity:get_project(project_id=49b18126ef0a46788f631cd665c36e57)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:18.037791 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12237e90-806e-45e2-8ba5-7978a3f7cfbd None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:18.039809 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 106/204] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:17 2022] GET /identity/v3/projects/49b18126ef0a46788f631cd665c36e57 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:18.040754 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12237e90-806e-45e2-8ba5-7978a3f7cfbd None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:18.088396 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:18.169075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a123d4-19ac-4726-bb1f-a8f1a794a2ec None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:18.234455 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3c294-972f-4349-b915-4ddb39393ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:18.235271 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3c294-972f-4349-b915-4ddb39393ac6 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:18.235548 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3c294-972f-4349-b915-4ddb39393ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:18.235826 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3c294-972f-4349-b915-4ddb39393ac6 None admin] PATH_INFO: `/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:18.240093 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12237e90-806e-45e2-8ba5-7978a3f7cfbd None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:18.242010 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3c294-972f-4349-b915-4ddb39393ac6 None admin] RBAC: Authorizing `identity:get_project(project_id=2ceac2e500814d1f9e4b6160e2b6b2bb)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:18.244640 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3c294-972f-4349-b915-4ddb39393ac6 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:18.246616 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 99/205] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:17 2022] GET /identity/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:18.247605 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3c294-972f-4349-b915-4ddb39393ac6 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:18.274354 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:18.287485 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6d5ce-7022-41c1-93c7-b804576da834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:18.288407 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6d5ce-7022-41c1-93c7-b804576da834 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:18.288695 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6d5ce-7022-41c1-93c7-b804576da834 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:18.288971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6d5ce-7022-41c1-93c7-b804576da834 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:18.289836 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6d5ce-7022-41c1-93c7-b804576da834 None admin] RBAC: Adding query filter params (role.id=37ba4a62052348d4811b560c19a07e02, scope.project.id=2ceac2e500814d1f9e4b6160e2b6b2bb, user.id=59456331eb9a4f23af59a0bd248a36fa) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:18.290290 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6d5ce-7022-41c1-93c7-b804576da834 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:18.292085 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6d5ce-7022-41c1-93c7-b804576da834 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:18.301167 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 107/206] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:35:18 2022] GET /identity/v3/role_assignments?user.id=59456331eb9a4f23af59a0bd248a36fa&scope.project.id=2ceac2e500814d1f9e4b6160e2b6b2bb&role.id=37ba4a62052348d4811b560c19a07e02 => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:18.301167 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6d5ce-7022-41c1-93c7-b804576da834 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:18.403960 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:18.420928 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6d5ce-7022-41c1-93c7-b804576da834 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:18.433971 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3c294-972f-4349-b915-4ddb39393ac6 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:18.463219 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81589bbb-8788-40f3-8b9e-84f6e8494f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:18.463973 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81589bbb-8788-40f3-8b9e-84f6e8494f89 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:18.464322 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81589bbb-8788-40f3-8b9e-84f6e8494f89 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:18.464659 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81589bbb-8788-40f3-8b9e-84f6e8494f89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:18.466108 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81589bbb-8788-40f3-8b9e-84f6e8494f89 None admin] RBAC: Adding query filter params (role.id=c403525d65944d2187540a6d893b91e7, scope.project.id=2ceac2e500814d1f9e4b6160e2b6b2bb, user.id=59456331eb9a4f23af59a0bd248a36fa) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:18.466489 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81589bbb-8788-40f3-8b9e-84f6e8494f89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:18.468261 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81589bbb-8788-40f3-8b9e-84f6e8494f89 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:18.475942 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 108/207] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:35:18 2022] GET /identity/v3/role_assignments?user.id=59456331eb9a4f23af59a0bd248a36fa&scope.project.id=2ceac2e500814d1f9e4b6160e2b6b2bb&role.id=c403525d65944d2187540a6d893b91e7 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:18.497861 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3de2e-36a5-404c-97a0-5ed4a7e2c17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:18.498868 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3de2e-36a5-404c-97a0-5ed4a7e2c17c None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:18.499288 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3de2e-36a5-404c-97a0-5ed4a7e2c17c None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:18.499699 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3de2e-36a5-404c-97a0-5ed4a7e2c17c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:18.500700 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3de2e-36a5-404c-97a0-5ed4a7e2c17c None admin] RBAC: Adding query filter params (role.id=ca2c6e2b56e14467bcd435e641e63880, scope.project.id=49b18126ef0a46788f631cd665c36e57, user.id=8fba7c824655421394c750e3e30770e1) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:18.501155 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3de2e-36a5-404c-97a0-5ed4a7e2c17c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:18.502858 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3de2e-36a5-404c-97a0-5ed4a7e2c17c None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:18.516004 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 100/208] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:35:18 2022] GET /identity/v3/role_assignments?user.id=8fba7c824655421394c750e3e30770e1&scope.project.id=49b18126ef0a46788f631cd665c36e57&role.id=ca2c6e2b56e14467bcd435e641e63880 => generated 608 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:19.575427 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd9fec-5d9c-40e4-a742-a19e07d746c5 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:19.576449 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd9fec-5d9c-40e4-a742-a19e07d746c5 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:19.576946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd9fec-5d9c-40e4-a742-a19e07d746c5 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:19.578792 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 109/209] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:19.584498 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b5b61-d710-4d19-8ffd-c049ee64b8cb None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:19.584925 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b5b61-d710-4d19-8ffd-c049ee64b8cb None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:19.585152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b5b61-d710-4d19-8ffd-c049ee64b8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:19.591112 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ced7f8-7b3f-47d4-9c00-9b9c87574049 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:19.591400 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ced7f8-7b3f-47d4-9c00-9b9c87574049 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:19.591676 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ced7f8-7b3f-47d4-9c00-9b9c87574049 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:19.593378 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 110/210] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:35:19.598193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3da5ad-24d5-4fc1-948e-a1ce755e4509 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:19.598480 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3da5ad-24d5-4fc1-948e-a1ce755e4509 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:19.598761 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3da5ad-24d5-4fc1-948e-a1ce755e4509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:19.603925 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-be8b5b61-d710-4d19-8ffd-c049ee64b8cb None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:19.605490 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-be8b5b61-d710-4d19-8ffd-c049ee64b8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:19.616101 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-bc3da5ad-24d5-4fc1-948e-a1ce755e4509 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:19.617335 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-bc3da5ad-24d5-4fc1-948e-a1ce755e4509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:19.697917 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 101/211] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:19.698622 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 111/212] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:35:19.714169 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b5b61-d710-4d19-8ffd-c049ee64b8cb None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:19.722906 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3da5ad-24d5-4fc1-948e-a1ce755e4509 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:19.726636 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:19.820976 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b5b61-d710-4d19-8ffd-c049ee64b8cb None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:19.822047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:19.851089 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3da5ad-24d5-4fc1-948e-a1ce755e4509 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:19.858924 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7456a1-b958-4f9e-b5e5-19e39d2fa73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:19.860106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7456a1-b958-4f9e-b5e5-19e39d2fa73f None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:19.860639 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7456a1-b958-4f9e-b5e5-19e39d2fa73f None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:19.861097 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7456a1-b958-4f9e-b5e5-19e39d2fa73f None admin] PATH_INFO: `/v3/domains/default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:19.862572 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7456a1-b958-4f9e-b5e5-19e39d2fa73f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:19.864317 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7456a1-b958-4f9e-b5e5-19e39d2fa73f None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:19.866349 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 102/213] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:35:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:19.871941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7456a1-b958-4f9e-b5e5-19e39d2fa73f None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:19.890071 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15416e-1bc7-4d4a-8935-01cff048a4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:19.891901 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15416e-1bc7-4d4a-8935-01cff048a4ee None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:19.892523 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15416e-1bc7-4d4a-8935-01cff048a4ee None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:19.894021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15416e-1bc7-4d4a-8935-01cff048a4ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:19.905700 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15416e-1bc7-4d4a-8935-01cff048a4ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:19.914263 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-7a15416e-1bc7-4d4a-8935-01cff048a4ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:35:19.914263 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:19.914263 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:19.914263 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:19.914263 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:19.914263 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:19.914263 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:19.914263 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:19.914263 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:19.914263 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:19.914263 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:19.914263 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:19.914263 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:19.914263 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:19.914263 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:19.914263 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:19.915139 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:19.915139 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:19.915139 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:19.915139 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:19.915139 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:19.915139 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:19.915139 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:19.915139 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:19.915139 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:19.915139 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:19.915139 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:19.915139 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:19.915139 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:19.915139 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:19.915139 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:19.915139 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:19.915943 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:19.915943 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:19.915943 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:19.915943 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:19.915943 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:19.915943 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:19.915943 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:19.915943 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:19.915943 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:19.915943 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:19.915943 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:35:19.915943 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:19.918324 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 112/214] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:35:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:19.924750 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15416e-1bc7-4d4a-8935-01cff048a4ee None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:19.968425 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:19.996613 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7456a1-b958-4f9e-b5e5-19e39d2fa73f None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:20.033322 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddbd2d8-dd97-455e-9172-dac5c0bbb388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:20.034385 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbd2d8-dd97-455e-9172-dac5c0bbb388 None admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:20.034952 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbd2d8-dd97-455e-9172-dac5c0bbb388 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:20.035415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbd2d8-dd97-455e-9172-dac5c0bbb388 None admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:20.036386 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddbd2d8-dd97-455e-9172-dac5c0bbb388 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:20.038153 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddbd2d8-dd97-455e-9172-dac5c0bbb388 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:20.041280 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15416e-1bc7-4d4a-8935-01cff048a4ee None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:20.063271 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 103/215] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Jul 5 20:35:19 2022] POST /identity/v3/users => generated 297 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:35:20.080101 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce5cf4-5d25-4ae5-85c2-4f7792be21c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:20.080799 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce5cf4-5d25-4ae5-85c2-4f7792be21c2 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:20.081079 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce5cf4-5d25-4ae5-85c2-4f7792be21c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:20.081350 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce5cf4-5d25-4ae5-85c2-4f7792be21c2 None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:20.082158 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce5cf4-5d25-4ae5-85c2-4f7792be21c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:20.082460 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce5cf4-5d25-4ae5-85c2-4f7792be21c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:20.083955 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce5cf4-5d25-4ae5-85c2-4f7792be21c2 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:20.086825 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:20.100718 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 113/216] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 5 20:35:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:35:20.102362 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddbd2d8-dd97-455e-9172-dac5c0bbb388 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:20.220556 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddbd2d8-dd97-455e-9172-dac5c0bbb388 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:20.252364 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:20.258633 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7af19-c344-4934-a54e-109441c33b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:20.259842 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7af19-c344-4934-a54e-109441c33b69 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:20.260320 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7af19-c344-4934-a54e-109441c33b69 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:20.260787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7af19-c344-4934-a54e-109441c33b69 None admin] PATH_INFO: `/v3/users/4287e2b13f0141d98f45310547cc5fe1` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:20.275691 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7af19-c344-4934-a54e-109441c33b69 None admin] RBAC: Authorizing `identity:get_user(user_id=4287e2b13f0141d98f45310547cc5fe1)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:20.277650 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7af19-c344-4934-a54e-109441c33b69 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:20.280515 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 104/217] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:35:20 2022] GET /identity/v3/users/4287e2b13f0141d98f45310547cc5fe1 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:20.286409 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce5cf4-5d25-4ae5-85c2-4f7792be21c2 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:20.406597 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce5cf4-5d25-4ae5-85c2-4f7792be21c2 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:20.445755 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03bc86-0b47-4d24-8f1a-5fba85d267a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:20.446477 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03bc86-0b47-4d24-8f1a-5fba85d267a9 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:20.446754 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03bc86-0b47-4d24-8f1a-5fba85d267a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:20.447033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03bc86-0b47-4d24-8f1a-5fba85d267a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:20.519003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:20.522511 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03bc86-0b47-4d24-8f1a-5fba85d267a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:20.524036 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03bc86-0b47-4d24-8f1a-5fba85d267a9 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:20.572419 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb6721-38f1-4a6d-8217-a36b8e43167e None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:20.572763 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb6721-38f1-4a6d-8217-a36b8e43167e None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:20.572992 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb6721-38f1-4a6d-8217-a36b8e43167e None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:20.578846 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 105/218] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:35:20.589460 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab23db-f05e-42b4-823e-bd9eebdc8040 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:20.590080 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab23db-f05e-42b4-823e-bd9eebdc8040 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:20.590080 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab23db-f05e-42b4-823e-bd9eebdc8040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:20.624861 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-cbab23db-f05e-42b4-823e-bd9eebdc8040 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:20.626086 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-cbab23db-f05e-42b4-823e-bd9eebdc8040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:20.637892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 114/219] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:35:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:35:20.643613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03bc86-0b47-4d24-8f1a-5fba85d267a9 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:20.727447 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 106/220] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:20.728986 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537534f7-1e47-4005-9b55-f65ce4b5c8e3 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:20.729269 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537534f7-1e47-4005-9b55-f65ce4b5c8e3 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:20.729645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537534f7-1e47-4005-9b55-f65ce4b5c8e3 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:20.730955 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 107/221] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:20.736824 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d3eba-2c9b-4ea4-91e7-72535443c99e None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:20.737196 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d3eba-2c9b-4ea4-91e7-72535443c99e None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:20.737529 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d3eba-2c9b-4ea4-91e7-72535443c99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:20.752864 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:20.756047 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-ef4d3eba-2c9b-4ea4-91e7-72535443c99e None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:20.756783 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03bc86-0b47-4d24-8f1a-5fba85d267a9 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:20.757264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-ef4d3eba-2c9b-4ea4-91e7-72535443c99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:20.794318 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abfc6ee-26cd-4114-9d87-eadad66bc699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:20.795264 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfc6ee-26cd-4114-9d87-eadad66bc699 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:20.795644 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfc6ee-26cd-4114-9d87-eadad66bc699 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:20.795918 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfc6ee-26cd-4114-9d87-eadad66bc699 None admin] PATH_INFO: `/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:20.797252 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abfc6ee-26cd-4114-9d87-eadad66bc699 None admin] RBAC: Authorizing `identity:get_project(project_id=2ceac2e500814d1f9e4b6160e2b6b2bb)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:20.798770 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abfc6ee-26cd-4114-9d87-eadad66bc699 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:20.801191 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 115/222] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:20 2022] GET /identity/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:20.802007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abfc6ee-26cd-4114-9d87-eadad66bc699 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:20.837986 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 108/223] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:20.839201 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d3eba-2c9b-4ea4-91e7-72535443c99e None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:20.909267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abfc6ee-26cd-4114-9d87-eadad66bc699 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:20.945606 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274b043-42b0-42ac-a49f-2dd9c2197bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:20.946232 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:20.946800 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274b043-42b0-42ac-a49f-2dd9c2197bdb None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:20.947086 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274b043-42b0-42ac-a49f-2dd9c2197bdb None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:20.947369 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274b043-42b0-42ac-a49f-2dd9c2197bdb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:20.960785 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274b043-42b0-42ac-a49f-2dd9c2197bdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:20.967727 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d3eba-2c9b-4ea4-91e7-72535443c99e None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:20.970971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-1274b043-42b0-42ac-a49f-2dd9c2197bdb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:35:20.970971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:20.970971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:20.970971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:20.970971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:20.970971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:20.970971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:20.970971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:20.970971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:20.970971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:20.970971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:20.970971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:20.970971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:20.970971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:20.970971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:20.970971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:20.971822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:20.971822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:20.971822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:20.971822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:20.971822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:20.971822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:20.971822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:20.971822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:20.971822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:20.971822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:20.971822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:20.971822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:20.971822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:20.971822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:20.971822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:20.971822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:20.972606 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:20.972606 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:20.972606 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:20.972606 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:20.972606 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:20.972606 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:20.972606 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:20.972606 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:20.972606 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:20.972606 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:20.972606 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:35:20.972606 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:20.972606 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 116/224] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 5 20:35:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:20.973756 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274b043-42b0-42ac-a49f-2dd9c2197bdb None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:21.008963 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:21.017890 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d338e9-1416-4f18-9667-3eb137a7851c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:21.018586 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d338e9-1416-4f18-9667-3eb137a7851c None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:21.018869 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d338e9-1416-4f18-9667-3eb137a7851c None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:21.019142 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d338e9-1416-4f18-9667-3eb137a7851c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:21.020722 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d338e9-1416-4f18-9667-3eb137a7851c None admin] RBAC: Adding query filter params (role.id=8dc2563a47c540cfa548eb210d02066e, scope.project.id=2ceac2e500814d1f9e4b6160e2b6b2bb, user.id=4287e2b13f0141d98f45310547cc5fe1) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:21.021295 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d338e9-1416-4f18-9667-3eb137a7851c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:21.023095 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d338e9-1416-4f18-9667-3eb137a7851c None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:21.029365 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 109/225] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:35:20 2022] GET /identity/v3/role_assignments?user.id=4287e2b13f0141d98f45310547cc5fe1&scope.project.id=2ceac2e500814d1f9e4b6160e2b6b2bb&role.id=8dc2563a47c540cfa548eb210d02066e => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:21.038641 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d338e9-1416-4f18-9667-3eb137a7851c None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:21.100488 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274b043-42b0-42ac-a49f-2dd9c2197bdb None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:21.147433 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9038370-cea4-4bef-a5b2-561a4c496088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:21.150633 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9038370-cea4-4bef-a5b2-561a4c496088 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:21.150633 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9038370-cea4-4bef-a5b2-561a4c496088 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:21.150633 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9038370-cea4-4bef-a5b2-561a4c496088 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:21.176835 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9038370-cea4-4bef-a5b2-561a4c496088 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:21.196021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-d9038370-cea4-4bef-a5b2-561a4c496088 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:35:21.196021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:21.196021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:21.196021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:21.196021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:21.196021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:21.196021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:21.196021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:21.196021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:21.196021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:21.196021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:21.196021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:21.196021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:21.196021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:21.196021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:21.196021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:21.197164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:21.197164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:21.197164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:21.197164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:21.197164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:21.197164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:21.197164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:21.197164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:21.197164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:21.197164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:21.197164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:21.197164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:21.197164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:21.197164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:21.197164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:21.197164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:21.198056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:21.198056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:21.198056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:21.198056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:21.198056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:21.198056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:21.198056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:21.198056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:21.198056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:21.198056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:21.198056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:35:21.198056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:21.198056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 117/226] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 5 20:35:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:21.204081 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9038370-cea4-4bef-a5b2-561a4c496088 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:21.205780 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d338e9-1416-4f18-9667-3eb137a7851c None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:21.221569 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:21.243231 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98338372-e1c7-4457-8f62-91c3c20da779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:21.243917 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98338372-e1c7-4457-8f62-91c3c20da779 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:21.244410 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98338372-e1c7-4457-8f62-91c3c20da779 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:21.244524 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98338372-e1c7-4457-8f62-91c3c20da779 None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:21.245233 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98338372-e1c7-4457-8f62-91c3c20da779 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:21.245534 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98338372-e1c7-4457-8f62-91c3c20da779 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:21.246968 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98338372-e1c7-4457-8f62-91c3c20da779 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:21.255967 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 110/227] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:35:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:21.262209 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98338372-e1c7-4457-8f62-91c3c20da779 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:21.309782 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:21.329133 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9038370-cea4-4bef-a5b2-561a4c496088 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:21.366830 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f636c6-e559-4e85-a83c-32bef80ff937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:21.367758 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f636c6-e559-4e85-a83c-32bef80ff937 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:21.368210 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f636c6-e559-4e85-a83c-32bef80ff937 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:21.368725 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f636c6-e559-4e85-a83c-32bef80ff937 None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:21.369727 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f636c6-e559-4e85-a83c-32bef80ff937 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:21.370202 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f636c6-e559-4e85-a83c-32bef80ff937 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:21.371783 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f636c6-e559-4e85-a83c-32bef80ff937 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:21.375788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98338372-e1c7-4457-8f62-91c3c20da779 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:21.381101 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 118/228] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:35:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:35:21.387219 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f636c6-e559-4e85-a83c-32bef80ff937 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:21.430371 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb8475-cf5c-4176-9249-bb20bba55905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:21.431116 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb8475-cf5c-4176-9249-bb20bba55905 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:21.431395 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb8475-cf5c-4176-9249-bb20bba55905 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:21.431721 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb8475-cf5c-4176-9249-bb20bba55905 None admin] PATH_INFO: `/v3/users/59456331eb9a4f23af59a0bd248a36fa` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:21.432930 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb8475-cf5c-4176-9249-bb20bba55905 None admin] RBAC: Authorizing `identity:get_user(user_id=59456331eb9a4f23af59a0bd248a36fa)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:21.434602 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb8475-cf5c-4176-9249-bb20bba55905 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:21.436768 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 111/229] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:35:21 2022] GET /identity/v3/users/59456331eb9a4f23af59a0bd248a36fa => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:21.443195 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb8475-cf5c-4176-9249-bb20bba55905 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:21.495930 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f636c6-e559-4e85-a83c-32bef80ff937 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:21.500375 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:21.533081 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365767d-9f8c-480c-b6eb-ceefaf8be722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:21.534345 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365767d-9f8c-480c-b6eb-ceefaf8be722 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:21.534850 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365767d-9f8c-480c-b6eb-ceefaf8be722 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:21.535336 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365767d-9f8c-480c-b6eb-ceefaf8be722 None admin] PATH_INFO: `/v3/users/59456331eb9a4f23af59a0bd248a36fa` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:21.536744 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8365767d-9f8c-480c-b6eb-ceefaf8be722 None admin] RBAC: Authorizing `identity:get_user(user_id=59456331eb9a4f23af59a0bd248a36fa)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:21.538525 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8365767d-9f8c-480c-b6eb-ceefaf8be722 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:21.545035 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 119/230] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:35:21 2022] GET /identity/v3/users/59456331eb9a4f23af59a0bd248a36fa => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:21.546563 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365767d-9f8c-480c-b6eb-ceefaf8be722 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:21.574333 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:21.587168 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb8475-cf5c-4176-9249-bb20bba55905 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:21.654897 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ba965-b2b1-48aa-b801-17e01ae373b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:21.656579 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ba965-b2b1-48aa-b801-17e01ae373b0 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:21.657179 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ba965-b2b1-48aa-b801-17e01ae373b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:21.657652 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ba965-b2b1-48aa-b801-17e01ae373b0 None admin] PATH_INFO: `/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:21.659317 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ba965-b2b1-48aa-b801-17e01ae373b0 None admin] RBAC: Authorizing `identity:get_project(project_id=2ceac2e500814d1f9e4b6160e2b6b2bb)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:21.662297 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ba965-b2b1-48aa-b801-17e01ae373b0 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:21.669158 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 112/231] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:21 2022] GET /identity/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:21.671508 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ba965-b2b1-48aa-b801-17e01ae373b0 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:21.716575 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365767d-9f8c-480c-b6eb-ceefaf8be722 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:21.783536 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02969e48-d74b-42e5-9040-751eed89190a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:21.784804 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02969e48-d74b-42e5-9040-751eed89190a None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:21.785283 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02969e48-d74b-42e5-9040-751eed89190a None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:21.785770 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02969e48-d74b-42e5-9040-751eed89190a None admin] PATH_INFO: `/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:21.787199 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02969e48-d74b-42e5-9040-751eed89190a None admin] RBAC: Authorizing `identity:get_project(project_id=2ceac2e500814d1f9e4b6160e2b6b2bb)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:21.788877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02969e48-d74b-42e5-9040-751eed89190a None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:21.801865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 120/232] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:21 2022] GET /identity/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:35:21.802199 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ba965-b2b1-48aa-b801-17e01ae373b0 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:21.803355 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02969e48-d74b-42e5-9040-751eed89190a None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:21.822215 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:21.838583 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2639ec-8d7f-4bc2-8c12-6d397c8a6100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:21.839498 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2639ec-8d7f-4bc2-8c12-6d397c8a6100 None admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:21.839778 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2639ec-8d7f-4bc2-8c12-6d397c8a6100 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:21.840062 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2639ec-8d7f-4bc2-8c12-6d397c8a6100 None admin] PATH_INFO: `/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb/users/59456331eb9a4f23af59a0bd248a36fa/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:21.842258 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2639ec-8d7f-4bc2-8c12-6d397c8a6100 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ceac2e500814d1f9e4b6160e2b6b2bb, user_id=59456331eb9a4f23af59a0bd248a36fa, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:21.843905 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2639ec-8d7f-4bc2-8c12-6d397c8a6100 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:21.861795 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 113/233] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 5 20:35:21 2022] PUT /identity/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb/users/59456331eb9a4f23af59a0bd248a36fa/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:35:21.946224 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:21.968950 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02969e48-d74b-42e5-9040-751eed89190a None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:22.015583 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa816b-2b32-4c1e-b85e-7874930f1a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:22.016500 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa816b-2b32-4c1e-b85e-7874930f1a38 None admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:22.016781 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa816b-2b32-4c1e-b85e-7874930f1a38 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:22.017054 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa816b-2b32-4c1e-b85e-7874930f1a38 None admin] PATH_INFO: `/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb/users/59456331eb9a4f23af59a0bd248a36fa/roles/c403525d65944d2187540a6d893b91e7` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:22.023979 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa816b-2b32-4c1e-b85e-7874930f1a38 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ceac2e500814d1f9e4b6160e2b6b2bb, user_id=59456331eb9a4f23af59a0bd248a36fa, role_id=c403525d65944d2187540a6d893b91e7)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:22.025532 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa816b-2b32-4c1e-b85e-7874930f1a38 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:22.044272 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 121/234] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 5 20:35:21 2022] PUT /identity/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb/users/59456331eb9a4f23af59a0bd248a36fa/roles/c403525d65944d2187540a6d893b91e7 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:35:22.607999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69c9b1-a08c-4b7f-a386-02c978703b39 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:22.608412 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69c9b1-a08c-4b7f-a386-02c978703b39 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:22.608537 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69c9b1-a08c-4b7f-a386-02c978703b39 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:22.610252 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 114/235] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:22.615761 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c3bf2-de10-4909-b7a5-6f734b53f4ee None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:22.616060 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c3bf2-de10-4909-b7a5-6f734b53f4ee None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:22.616371 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c3bf2-de10-4909-b7a5-6f734b53f4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:22.638917 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-126c3bf2-de10-4909-b7a5-6f734b53f4ee None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:22.640161 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-126c3bf2-de10-4909-b7a5-6f734b53f4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:22.740147 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 122/236] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:35:22.763632 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69c9b1-a08c-4b7f-a386-02c978703b39 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:22.811759 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717bd15e-3f3c-43f1-a2a8-8c1905701215 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:22.812409 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717bd15e-3f3c-43f1-a2a8-8c1905701215 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:22.812896 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717bd15e-3f3c-43f1-a2a8-8c1905701215 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:22.814505 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 123/237] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:22.819786 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6696c40-eaf1-452a-abaf-f08be4a64a3e None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:22.820290 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6696c40-eaf1-452a-abaf-f08be4a64a3e None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:22.820780 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6696c40-eaf1-452a-abaf-f08be4a64a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:22.848326 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-b6696c40-eaf1-452a-abaf-f08be4a64a3e None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:22.851243 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-b6696c40-eaf1-452a-abaf-f08be4a64a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:22.919827 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69c9b1-a08c-4b7f-a386-02c978703b39 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:22.995778 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 124/238] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:22.996230 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041549c-c9e5-4b62-81f3-1d9abfa30f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:22.997051 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041549c-c9e5-4b62-81f3-1d9abfa30f18 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:22.997334 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041549c-c9e5-4b62-81f3-1d9abfa30f18 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:22.997611 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041549c-c9e5-4b62-81f3-1d9abfa30f18 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:23.021638 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041549c-c9e5-4b62-81f3-1d9abfa30f18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:23.021828 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6696c40-eaf1-452a-abaf-f08be4a64a3e None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:23.024904 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:23.030503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-3041549c-c9e5-4b62-81f3-1d9abfa30f18 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 20:35:23.030503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:23.030503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:23.030503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:23.030503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:23.030503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:23.030503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:23.030503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:23.030503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:23.030503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:23.030503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:23.030503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:23.030503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:23.030503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:23.030503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:23.030503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:23.031407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:23.031407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:23.031407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:23.031407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:23.031407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:23.031407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:23.031407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:23.031407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:23.031407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:23.031407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:23.031407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:23.031407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:23.031407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:23.031407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:23.031407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:23.031407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:23.032190 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:23.032190 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:23.032190 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:23.032190 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:23.032190 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:23.032190 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:23.032190 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:23.032190 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:23.032190 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:23.032190 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:23.032190 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 20:35:23.032190 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:35:23.034620 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 115/239] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:35:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:23.048756 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041549c-c9e5-4b62-81f3-1d9abfa30f18 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:23.118201 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:23.210993 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6696c40-eaf1-452a-abaf-f08be4a64a3e None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:23.265922 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041549c-c9e5-4b62-81f3-1d9abfa30f18 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:23.279323 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3551f-9e8e-43f4-a259-de2c24e7c11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:23.280148 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3551f-9e8e-43f4-a259-de2c24e7c11e None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:23.280426 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3551f-9e8e-43f4-a259-de2c24e7c11e None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:23.280697 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3551f-9e8e-43f4-a259-de2c24e7c11e None admin] PATH_INFO: `/v3/domains/default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:23.283666 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3551f-9e8e-43f4-a259-de2c24e7c11e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:23.285143 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3551f-9e8e-43f4-a259-de2c24e7c11e None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:23.289468 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 125/240] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:35:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:35:23.294389 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3551f-9e8e-43f4-a259-de2c24e7c11e None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:23.329410 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70330432-147d-4845-a8db-3413c5a24450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:23.330183 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70330432-147d-4845-a8db-3413c5a24450 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:23.330462 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70330432-147d-4845-a8db-3413c5a24450 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:23.330725 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70330432-147d-4845-a8db-3413c5a24450 None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:23.331489 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70330432-147d-4845-a8db-3413c5a24450 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:23.331787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70330432-147d-4845-a8db-3413c5a24450 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:23.333267 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70330432-147d-4845-a8db-3413c5a24450 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:23.342975 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 116/241] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 5 20:35:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:23.348358 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70330432-147d-4845-a8db-3413c5a24450 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:23.412790 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:23.463426 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3551f-9e8e-43f4-a259-de2c24e7c11e None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:23.486155 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:23.500906 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f500f2c-5b89-4ab2-a25e-3a2eef50247d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:23.501584 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f500f2c-5b89-4ab2-a25e-3a2eef50247d None admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:23.501876 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f500f2c-5b89-4ab2-a25e-3a2eef50247d None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:23.502291 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f500f2c-5b89-4ab2-a25e-3a2eef50247d None admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:23.503005 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f500f2c-5b89-4ab2-a25e-3a2eef50247d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:23.503926 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70330432-147d-4845-a8db-3413c5a24450 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:23.504448 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f500f2c-5b89-4ab2-a25e-3a2eef50247d None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:23.528405 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 126/242] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Jul 5 20:35:23 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:35:23.580193 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d6765-85ee-4aca-ac49-fec209e42b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:23.581377 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d6765-85ee-4aca-ac49-fec209e42b3c None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:23.581804 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d6765-85ee-4aca-ac49-fec209e42b3c None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:23.582268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d6765-85ee-4aca-ac49-fec209e42b3c None admin] PATH_INFO: `/v3/users/5ff855e96eef4cdc9b31c8200844b1ee` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:23.588046 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112d960-7e32-4bd9-af29-bb129c44a5d3 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:23.588046 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112d960-7e32-4bd9-af29-bb129c44a5d3 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:23.588046 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112d960-7e32-4bd9-af29-bb129c44a5d3 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:23.588046 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 127/243] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:35:23.595337 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a2a3c-b79d-44dc-bfb1-40712fa3ebb7 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:23.595737 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a2a3c-b79d-44dc-bfb1-40712fa3ebb7 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:23.596103 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a2a3c-b79d-44dc-bfb1-40712fa3ebb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:23.611123 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d6765-85ee-4aca-ac49-fec209e42b3c None admin] RBAC: Authorizing `identity:get_user(user_id=5ff855e96eef4cdc9b31c8200844b1ee)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:23.612862 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d6765-85ee-4aca-ac49-fec209e42b3c None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:23.614962 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 117/244] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:35:23 2022] GET /identity/v3/users/5ff855e96eef4cdc9b31c8200844b1ee => generated 297 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:23.618915 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-110a2a3c-b79d-44dc-bfb1-40712fa3ebb7 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:23.620244 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-110a2a3c-b79d-44dc-bfb1-40712fa3ebb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:23.629161 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d6765-85ee-4aca-ac49-fec209e42b3c None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:23.703215 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 128/245] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:23.726199 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a2a3c-b79d-44dc-bfb1-40712fa3ebb7 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:23.789878 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:23.839992 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d6765-85ee-4aca-ac49-fec209e42b3c None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:23.843821 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a2a3c-b79d-44dc-bfb1-40712fa3ebb7 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:23.882160 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf0e38-9897-4cc7-9077-053b9236fa58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:23.883188 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf0e38-9897-4cc7-9077-053b9236fa58 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:23.883681 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf0e38-9897-4cc7-9077-053b9236fa58 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:23.884136 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf0e38-9897-4cc7-9077-053b9236fa58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:23.886326 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a99252-f1fe-4933-9136-dee05f37fe33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:23.887176 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a99252-f1fe-4933-9136-dee05f37fe33 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:23.887520 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a99252-f1fe-4933-9136-dee05f37fe33 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:23.887800 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a99252-f1fe-4933-9136-dee05f37fe33 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:23.899445 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a99252-f1fe-4933-9136-dee05f37fe33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:23.908284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-77a99252-f1fe-4933-9136-dee05f37fe33 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:35:23.908284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:23.908284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:23.908284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:23.908284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:23.908284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:23.908284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:23.908284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:23.908284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:23.908284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:23.908284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:23.908284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:23.908284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:23.908284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:23.908284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:23.908284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:23.909408 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:23.909408 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:23.909408 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:23.909408 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:23.909408 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:23.909408 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:23.909408 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:23.909408 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:23.909408 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:23.909408 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:23.909408 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:23.909408 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:23.909408 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:23.909408 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:23.909408 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:23.909408 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:23.910371 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:23.910371 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:23.910371 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:23.910371 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:23.910371 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:23.910371 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:23.910371 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:23.910371 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:23.910371 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:23.910371 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:23.910371 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:35:23.910371 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:23.912515 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:23.914312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 129/246] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:35:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:35:23.920114 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a99252-f1fe-4933-9136-dee05f37fe33 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:23.990502 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf0e38-9897-4cc7-9077-053b9236fa58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:23.992920 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf0e38-9897-4cc7-9077-053b9236fa58 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:24.059034 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a99252-f1fe-4933-9136-dee05f37fe33 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:24.086305 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:24.097895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41ea55-46a2-404b-b05d-53cba399ee9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:24.098847 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41ea55-46a2-404b-b05d-53cba399ee9c None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:24.099273 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41ea55-46a2-404b-b05d-53cba399ee9c None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:24.099689 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41ea55-46a2-404b-b05d-53cba399ee9c None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:24.100590 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41ea55-46a2-404b-b05d-53cba399ee9c None admin] RBAC: Adding query filter params (name=member) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:24.101051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41ea55-46a2-404b-b05d-53cba399ee9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:24.102650 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41ea55-46a2-404b-b05d-53cba399ee9c None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:24.113053 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 130/247] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 5 20:35:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:24.120053 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41ea55-46a2-404b-b05d-53cba399ee9c None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:24.122967 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 118/248] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:35:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 20:35:24.128653 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf0e38-9897-4cc7-9077-053b9236fa58 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:24.189611 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:24.248073 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf0e38-9897-4cc7-9077-053b9236fa58 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:24.251983 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41ea55-46a2-404b-b05d-53cba399ee9c None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:24.291861 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aed683-8137-4dd8-9242-e5fb614dabbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:24.292844 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aed683-8137-4dd8-9242-e5fb614dabbe None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:24.293126 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aed683-8137-4dd8-9242-e5fb614dabbe None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:24.293395 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aed683-8137-4dd8-9242-e5fb614dabbe None admin] PATH_INFO: `/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:24.295670 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aed683-8137-4dd8-9242-e5fb614dabbe None admin] RBAC: Authorizing `identity:get_project(project_id=2ceac2e500814d1f9e4b6160e2b6b2bb)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:24.296782 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d935910-a136-4818-b464-5dd943333ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:24.297158 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aed683-8137-4dd8-9242-e5fb614dabbe None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:24.297673 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d935910-a136-4818-b464-5dd943333ede None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:24.298064 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d935910-a136-4818-b464-5dd943333ede None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:24.298363 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d935910-a136-4818-b464-5dd943333ede None admin] PATH_INFO: `/v3/users/4287e2b13f0141d98f45310547cc5fe1` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:24.299622 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 119/249] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:24 2022] GET /identity/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:24.299804 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d935910-a136-4818-b464-5dd943333ede None admin] RBAC: Authorizing `identity:get_user(user_id=4287e2b13f0141d98f45310547cc5fe1)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:24.301646 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d935910-a136-4818-b464-5dd943333ede None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:24.303567 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 131/250] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:35:24 2022] GET /identity/v3/users/4287e2b13f0141d98f45310547cc5fe1 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:35:24.305707 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aed683-8137-4dd8-9242-e5fb614dabbe None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:24.312324 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d935910-a136-4818-b464-5dd943333ede None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:24.378090 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:24.429298 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aed683-8137-4dd8-9242-e5fb614dabbe None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:24.445944 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d935910-a136-4818-b464-5dd943333ede None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:24.451477 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:24.469269 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064eaed0-bc6a-4f2b-98e8-b78734644e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:24.469963 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064eaed0-bc6a-4f2b-98e8-b78734644e85 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:24.470533 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064eaed0-bc6a-4f2b-98e8-b78734644e85 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:24.470639 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064eaed0-bc6a-4f2b-98e8-b78734644e85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:24.471410 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064eaed0-bc6a-4f2b-98e8-b78734644e85 None admin] RBAC: Adding query filter params (role.id=ca2c6e2b56e14467bcd435e641e63880, scope.project.id=2ceac2e500814d1f9e4b6160e2b6b2bb, user.id=5ff855e96eef4cdc9b31c8200844b1ee) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:24.471726 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064eaed0-bc6a-4f2b-98e8-b78734644e85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:24.473200 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064eaed0-bc6a-4f2b-98e8-b78734644e85 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:24.479371 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 120/251] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:35:24 2022] GET /identity/v3/role_assignments?user.id=5ff855e96eef4cdc9b31c8200844b1ee&scope.project.id=2ceac2e500814d1f9e4b6160e2b6b2bb&role.id=ca2c6e2b56e14467bcd435e641e63880 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:35:24.480635 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3afcd-aceb-43ff-ba38-0e6ecc3cb6bb None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:24.480915 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3afcd-aceb-43ff-ba38-0e6ecc3cb6bb None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:24.481187 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3afcd-aceb-43ff-ba38-0e6ecc3cb6bb None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:24.485875 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 121/252] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:24.488168 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc2b03-3201-4e7d-b51c-176dd031adbe None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:24.488456 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc2b03-3201-4e7d-b51c-176dd031adbe None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:24.488734 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc2b03-3201-4e7d-b51c-176dd031adbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:24.501608 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8459430-67fa-4880-acb4-6ba6c0b1ba82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:24.502935 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8459430-67fa-4880-acb4-6ba6c0b1ba82 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:24.503433 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8459430-67fa-4880-acb4-6ba6c0b1ba82 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:24.503901 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8459430-67fa-4880-acb4-6ba6c0b1ba82 None admin] PATH_INFO: `/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:24.505516 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8459430-67fa-4880-acb4-6ba6c0b1ba82 None admin] RBAC: Authorizing `identity:get_project(project_id=2ceac2e500814d1f9e4b6160e2b6b2bb)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:24.508521 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8459430-67fa-4880-acb4-6ba6c0b1ba82 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:24.511118 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 132/253] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:24 2022] GET /identity/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:24.512193 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-81cc2b03-3201-4e7d-b51c-176dd031adbe None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:24.513050 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270fa18-4070-4727-aa54-02e488ab845a None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:24.513502 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270fa18-4070-4727-aa54-02e488ab845a None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:24.513795 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-81cc2b03-3201-4e7d-b51c-176dd031adbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:24.514258 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270fa18-4070-4727-aa54-02e488ab845a None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:24.516580 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 133/254] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:24.518262 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270fa18-4070-4727-aa54-02e488ab845a None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:24.591771 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 122/255] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:24.593089 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277366eb-ee7d-4c65-8e16-831ab6ae40c7 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:24.593375 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277366eb-ee7d-4c65-8e16-831ab6ae40c7 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:24.593709 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277366eb-ee7d-4c65-8e16-831ab6ae40c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:24.633178 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-277366eb-ee7d-4c65-8e16-831ab6ae40c7 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:24.634486 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-277366eb-ee7d-4c65-8e16-831ab6ae40c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:24.683191 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270fa18-4070-4727-aa54-02e488ab845a None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:24.711852 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:24.727928 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 123/256] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:24.729519 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277366eb-ee7d-4c65-8e16-831ab6ae40c7 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:24.763282 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58918b7-62d6-4615-8a41-f8b63af0ac07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:24.764153 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58918b7-62d6-4615-8a41-f8b63af0ac07 None admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:24.764430 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58918b7-62d6-4615-8a41-f8b63af0ac07 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:24.764700 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58918b7-62d6-4615-8a41-f8b63af0ac07 None admin] PATH_INFO: `/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb/users/4287e2b13f0141d98f45310547cc5fe1/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:24.771504 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58918b7-62d6-4615-8a41-f8b63af0ac07 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ceac2e500814d1f9e4b6160e2b6b2bb, user_id=4287e2b13f0141d98f45310547cc5fe1, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:24.773014 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58918b7-62d6-4615-8a41-f8b63af0ac07 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:24.810278 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:24.813029 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 134/257] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 5 20:35:24 2022] PUT /identity/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb/users/4287e2b13f0141d98f45310547cc5fe1/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:35:24.814709 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58918b7-62d6-4615-8a41-f8b63af0ac07 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:24.888384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277366eb-ee7d-4c65-8e16-831ab6ae40c7 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:24.933061 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea683ae-41a4-4589-a969-940b6b6610f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:24.934408 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea683ae-41a4-4589-a969-940b6b6610f2 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:24.934879 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea683ae-41a4-4589-a969-940b6b6610f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:24.935330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea683ae-41a4-4589-a969-940b6b6610f2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:24.948050 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea683ae-41a4-4589-a969-940b6b6610f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:24.957584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-eea683ae-41a4-4589-a969-940b6b6610f2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:35:24.957584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:24.957584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:24.957584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:24.957584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:24.957584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:24.957584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:24.957584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:24.957584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:24.957584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:24.957584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:24.957584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:24.957584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:24.957584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:24.957584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:24.957584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:24.958787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:24.958787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:24.958787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:24.958787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:24.958787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:24.958787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:24.958787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:24.958787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:24.958787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:24.958787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:24.958787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:24.958787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:24.958787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:24.958787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:24.958787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:24.958787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:24.959769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:24.959769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:24.959769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:24.959769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:24.959769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:24.959769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:24.959769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:24.959769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:24.959769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:24.959769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:24.959769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:35:24.959769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:35:24.962273 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 124/258] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 5 20:35:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:24.971986 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea683ae-41a4-4589-a969-940b6b6610f2 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:25.096536 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea683ae-41a4-4589-a969-940b6b6610f2 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:25.122275 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:25.137629 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2c53c-68ef-4a7a-9061-0115dbd95f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:25.138662 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2c53c-68ef-4a7a-9061-0115dbd95f3f None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:25.139107 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2c53c-68ef-4a7a-9061-0115dbd95f3f None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:25.139537 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2c53c-68ef-4a7a-9061-0115dbd95f3f None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:25.140466 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf2c53c-68ef-4a7a-9061-0115dbd95f3f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:25.140903 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf2c53c-68ef-4a7a-9061-0115dbd95f3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:25.142578 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf2c53c-68ef-4a7a-9061-0115dbd95f3f None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:25.153816 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 125/259] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:35:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:35:25.159499 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2c53c-68ef-4a7a-9061-0115dbd95f3f None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:25.159806 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58918b7-62d6-4615-8a41-f8b63af0ac07 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:25.249990 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852ed16-3b6e-4315-8ee1-de9785d6283c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:25.250833 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852ed16-3b6e-4315-8ee1-de9785d6283c None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:25.251109 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852ed16-3b6e-4315-8ee1-de9785d6283c None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:25.251378 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852ed16-3b6e-4315-8ee1-de9785d6283c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:25.282505 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2c53c-68ef-4a7a-9061-0115dbd95f3f None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:25.282813 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852ed16-3b6e-4315-8ee1-de9785d6283c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:25.290455 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-4852ed16-3b6e-4315-8ee1-de9785d6283c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:35:25.290455 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:25.290455 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:25.290455 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:25.290455 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:25.290455 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:25.290455 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:25.290455 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:25.290455 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:25.290455 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:25.290455 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:25.290455 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:25.290455 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:25.290455 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:25.290455 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:25.290455 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:25.291382 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:25.291382 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:25.291382 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:25.291382 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:25.291382 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:25.291382 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:25.291382 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:25.291382 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:25.291382 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:25.291382 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:25.291382 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:25.291382 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:25.291382 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:25.291382 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:25.291382 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:25.291382 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:25.292255 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:25.292255 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:25.292255 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:25.292255 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:25.292255 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:25.292255 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:25.292255 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:25.292255 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:25.292255 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:25.292255 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:25.292255 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:35:25.292255 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:25.292255 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 135/260] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 5 20:35:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 478 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:25.298113 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852ed16-3b6e-4315-8ee1-de9785d6283c None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:25.327037 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba5126-e530-4f1c-8c82-d0d46ed2c717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:25.328847 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba5126-e530-4f1c-8c82-d0d46ed2c717 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:25.329510 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba5126-e530-4f1c-8c82-d0d46ed2c717 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:25.330024 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba5126-e530-4f1c-8c82-d0d46ed2c717 None admin] PATH_INFO: `/v3/users/59456331eb9a4f23af59a0bd248a36fa` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:25.331640 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddba5126-e530-4f1c-8c82-d0d46ed2c717 None admin] RBAC: Authorizing `identity:get_user(user_id=59456331eb9a4f23af59a0bd248a36fa)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:25.333546 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddba5126-e530-4f1c-8c82-d0d46ed2c717 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:25.336211 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 126/261] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:35:25 2022] GET /identity/v3/users/59456331eb9a4f23af59a0bd248a36fa => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:25.341434 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba5126-e530-4f1c-8c82-d0d46ed2c717 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:25.375766 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:25.390505 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:25.479945 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852ed16-3b6e-4315-8ee1-de9785d6283c None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:25.520265 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753ec08-2aa4-42ea-86c4-62c93c9e8d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:25.521012 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba5126-e530-4f1c-8c82-d0d46ed2c717 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:25.521639 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753ec08-2aa4-42ea-86c4-62c93c9e8d93 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:25.522159 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753ec08-2aa4-42ea-86c4-62c93c9e8d93 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:25.522852 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753ec08-2aa4-42ea-86c4-62c93c9e8d93 None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:25.523824 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753ec08-2aa4-42ea-86c4-62c93c9e8d93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:25.524333 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753ec08-2aa4-42ea-86c4-62c93c9e8d93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:25.526885 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753ec08-2aa4-42ea-86c4-62c93c9e8d93 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:25.537512 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 136/262] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:35:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:25.543030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753ec08-2aa4-42ea-86c4-62c93c9e8d93 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:25.566141 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502a7e2-b9ab-4ad1-948f-605cba7a19cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:25.567857 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502a7e2-b9ab-4ad1-948f-605cba7a19cc None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:25.568347 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502a7e2-b9ab-4ad1-948f-605cba7a19cc None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:25.568822 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502a7e2-b9ab-4ad1-948f-605cba7a19cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:25.651415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e502a7e2-b9ab-4ad1-948f-605cba7a19cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:25.653251 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e502a7e2-b9ab-4ad1-948f-605cba7a19cc None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:25.704723 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:25.722060 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:25.726664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753ec08-2aa4-42ea-86c4-62c93c9e8d93 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:25.778558 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371dc771-5d0d-44d6-8b4e-79cfcdac4f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:25.779747 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dc771-5d0d-44d6-8b4e-79cfcdac4f72 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:25.780231 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dc771-5d0d-44d6-8b4e-79cfcdac4f72 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:25.780679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371dc771-5d0d-44d6-8b4e-79cfcdac4f72 None admin] PATH_INFO: `/v3/users/59456331eb9a4f23af59a0bd248a36fa` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:25.782142 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371dc771-5d0d-44d6-8b4e-79cfcdac4f72 None admin] RBAC: Authorizing `identity:get_user(user_id=59456331eb9a4f23af59a0bd248a36fa)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:25.783752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371dc771-5d0d-44d6-8b4e-79cfcdac4f72 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:25.785590 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 137/263] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:35:25 2022] GET /identity/v3/users/59456331eb9a4f23af59a0bd248a36fa => generated 283 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:25.795076 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371dc771-5d0d-44d6-8b4e-79cfcdac4f72 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:25.818582 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 127/264] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:35:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 20:35:25.829872 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502a7e2-b9ab-4ad1-948f-605cba7a19cc None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:25.933823 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371dc771-5d0d-44d6-8b4e-79cfcdac4f72 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:25.978591 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7681a2a-cc83-4c56-9414-75835aebbd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:25.979575 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7681a2a-cc83-4c56-9414-75835aebbd0e None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:25.980055 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7681a2a-cc83-4c56-9414-75835aebbd0e None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:25.980508 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7681a2a-cc83-4c56-9414-75835aebbd0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:26.050147 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:26.060031 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502a7e2-b9ab-4ad1-948f-605cba7a19cc None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:26.134680 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7681a2a-cc83-4c56-9414-75835aebbd0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:26.136169 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7681a2a-cc83-4c56-9414-75835aebbd0e None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:26.157883 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e7a7de-68d3-497f-99e9-94eb10643e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:26.157883 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7a7de-68d3-497f-99e9-94eb10643e6c None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:26.157883 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7a7de-68d3-497f-99e9-94eb10643e6c None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:26.157883 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7a7de-68d3-497f-99e9-94eb10643e6c None admin] PATH_INFO: `/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:26.158261 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e7a7de-68d3-497f-99e9-94eb10643e6c None admin] RBAC: Authorizing `identity:get_project(project_id=2ceac2e500814d1f9e4b6160e2b6b2bb)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:26.159350 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e7a7de-68d3-497f-99e9-94eb10643e6c None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:26.165959 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 128/265] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:25 2022] GET /identity/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb => generated 302 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:35:26.170867 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e7a7de-68d3-497f-99e9-94eb10643e6c None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:26.173955 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:26.363191 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 138/266] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:35:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 20:35:26.369933 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7681a2a-cc83-4c56-9414-75835aebbd0e None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:26.393116 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e7a7de-68d3-497f-99e9-94eb10643e6c None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:26.453785 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4c72e-43d2-4443-b330-d3342baa5620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:26.454485 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4c72e-43d2-4443-b330-d3342baa5620 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:26.454764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4c72e-43d2-4443-b330-d3342baa5620 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:26.455039 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4c72e-43d2-4443-b330-d3342baa5620 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:26.455899 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f4c72e-43d2-4443-b330-d3342baa5620 None admin] RBAC: Adding query filter params (role.id=c403525d65944d2187540a6d893b91e7, scope.project.id=2ceac2e500814d1f9e4b6160e2b6b2bb, user.id=59456331eb9a4f23af59a0bd248a36fa) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:26.456212 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f4c72e-43d2-4443-b330-d3342baa5620 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:26.457701 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f4c72e-43d2-4443-b330-d3342baa5620 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:26.469195 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 129/267] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:35:26 2022] GET /identity/v3/role_assignments?user.id=59456331eb9a4f23af59a0bd248a36fa&scope.project.id=2ceac2e500814d1f9e4b6160e2b6b2bb&role.id=c403525d65944d2187540a6d893b91e7 => generated 608 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:35:26.485357 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:26.537184 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7681a2a-cc83-4c56-9414-75835aebbd0e None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:26.584266 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1ac9c-94a8-4d91-80a9-735740eca61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:26.585165 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1ac9c-94a8-4d91-80a9-735740eca61d None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:26.585449 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1ac9c-94a8-4d91-80a9-735740eca61d None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:26.585728 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1ac9c-94a8-4d91-80a9-735740eca61d None admin] PATH_INFO: `/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:26.587057 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec1ac9c-94a8-4d91-80a9-735740eca61d None admin] RBAC: Authorizing `identity:get_project(project_id=2ceac2e500814d1f9e4b6160e2b6b2bb)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:26.588586 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec1ac9c-94a8-4d91-80a9-735740eca61d None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:26.590752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 139/268] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:26 2022] GET /identity/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:35:26.597102 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4c72e-43d2-4443-b330-d3342baa5620 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:26.685753 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:26.723161 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4c72e-43d2-4443-b330-d3342baa5620 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:26.767434 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03bd34-b0cc-4765-8a06-8119d669f048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:26.768133 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03bd34-b0cc-4765-8a06-8119d669f048 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:26.768415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03bd34-b0cc-4765-8a06-8119d669f048 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:26.768690 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03bd34-b0cc-4765-8a06-8119d669f048 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:26.769565 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03bd34-b0cc-4765-8a06-8119d669f048 None admin] RBAC: Adding query filter params (role.id=37ba4a62052348d4811b560c19a07e02, scope.project.id=2ceac2e500814d1f9e4b6160e2b6b2bb, user.id=59456331eb9a4f23af59a0bd248a36fa) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:26.769908 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03bd34-b0cc-4765-8a06-8119d669f048 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:26.771453 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03bd34-b0cc-4765-8a06-8119d669f048 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:26.781046 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 130/269] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:35:26 2022] GET /identity/v3/role_assignments?user.id=59456331eb9a4f23af59a0bd248a36fa&scope.project.id=2ceac2e500814d1f9e4b6160e2b6b2bb&role.id=37ba4a62052348d4811b560c19a07e02 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:27.114455 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082f588-7986-4951-893c-d0e01a91031d None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:27.114964 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082f588-7986-4951-893c-d0e01a91031d None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:27.115040 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082f588-7986-4951-893c-d0e01a91031d None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:27.116633 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 140/270] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:27.121710 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6934ff-2933-41b8-b8eb-99c3196782e0 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:27.122175 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6934ff-2933-41b8-b8eb-99c3196782e0 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:27.122350 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6934ff-2933-41b8-b8eb-99c3196782e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:27.129480 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8af44-9eea-4bb7-9210-66d81000a930 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:27.129764 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8af44-9eea-4bb7-9210-66d81000a930 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:27.130627 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8af44-9eea-4bb7-9210-66d81000a930 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:27.131478 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 141/271] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:35:27.141015 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694260e0-be02-4106-bb71-77e287d968ba None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:27.141015 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694260e0-be02-4106-bb71-77e287d968ba None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:27.141015 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694260e0-be02-4106-bb71-77e287d968ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:27.159674 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-eb6934ff-2933-41b8-b8eb-99c3196782e0 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:27.161223 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-eb6934ff-2933-41b8-b8eb-99c3196782e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:27.170519 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-694260e0-be02-4106-bb71-77e287d968ba None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:27.172022 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-694260e0-be02-4106-bb71-77e287d968ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:27.245498 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 131/272] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:27.246890 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965a242-5610-4edd-8768-ae03c402ccd3 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:27.247444 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965a242-5610-4edd-8768-ae03c402ccd3 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:27.247903 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965a242-5610-4edd-8768-ae03c402ccd3 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:27.250433 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 132/273] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:27.260788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9335e-764f-48ef-ab1f-de42a29b5072 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:27.261042 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9335e-764f-48ef-ab1f-de42a29b5072 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:27.261320 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9335e-764f-48ef-ab1f-de42a29b5072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:27.264439 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 142/274] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:35:27.276595 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694260e0-be02-4106-bb71-77e287d968ba None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:27.280822 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-ccc9335e-764f-48ef-ab1f-de42a29b5072 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:27.282271 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-ccc9335e-764f-48ef-ab1f-de42a29b5072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:27.343709 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:27.345067 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:27.356431 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 133/275] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:35:27.357089 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9335e-764f-48ef-ab1f-de42a29b5072 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:27.398781 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694260e0-be02-4106-bb71-77e287d968ba None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:27.434186 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a11f2a-2d2c-410f-853c-30914c116ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:27.434980 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a11f2a-2d2c-410f-853c-30914c116ea3 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:27.435260 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a11f2a-2d2c-410f-853c-30914c116ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:27.435583 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a11f2a-2d2c-410f-853c-30914c116ea3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:27.436751 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a11f2a-2d2c-410f-853c-30914c116ea3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:27.438246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a11f2a-2d2c-410f-853c-30914c116ea3 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:27.440105 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 143/276] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:35:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:35:27.442668 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a11f2a-2d2c-410f-853c-30914c116ea3 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:27.461646 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9335e-764f-48ef-ab1f-de42a29b5072 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:27.497719 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c987e5-9b29-445b-8f1b-534bbaebbdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:27.498627 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c987e5-9b29-445b-8f1b-534bbaebbdfd None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:27.498914 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c987e5-9b29-445b-8f1b-534bbaebbdfd None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:27.499186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c987e5-9b29-445b-8f1b-534bbaebbdfd None admin] PATH_INFO: `/v3/roles/member` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:27.509946 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c987e5-9b29-445b-8f1b-534bbaebbdfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:27.517670 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-76c987e5-9b29-445b-8f1b-534bbaebbdfd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:35:27.517670 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:27.517670 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:27.517670 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:27.517670 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:27.517670 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:27.517670 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:27.517670 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:27.517670 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:27.517670 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:27.517670 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:27.517670 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:27.517670 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:27.517670 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:27.517670 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:27.517670 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:27.518749 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:27.518749 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:27.518749 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:27.518749 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:27.518749 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:27.518749 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:27.518749 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:27.518749 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:27.518749 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:27.518749 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:27.518749 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:27.518749 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:27.518749 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:27.518749 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:27.518749 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:27.518749 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:27.522713 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:27.522713 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:27.522713 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:27.522713 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:27.522713 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:27.522713 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:27.522713 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:27.522713 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:27.522713 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:27.522713 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:27.522713 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:35:27.522713 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:35:27.522713 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 134/277] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:35:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:27.522713 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c987e5-9b29-445b-8f1b-534bbaebbdfd None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:27.564492 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a11f2a-2d2c-410f-853c-30914c116ea3 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:27.576674 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:27.598213 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:27.604353 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6e941-e6c7-4cf3-93a8-829e73edccd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:27.605168 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6e941-e6c7-4cf3-93a8-829e73edccd8 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:27.605715 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6e941-e6c7-4cf3-93a8-829e73edccd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:27.605715 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6e941-e6c7-4cf3-93a8-829e73edccd8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:27.618074 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6e941-e6c7-4cf3-93a8-829e73edccd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:27.626921 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-d9e6e941-e6c7-4cf3-93a8-829e73edccd8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 20:35:27.626921 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:27.626921 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:27.626921 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:27.626921 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:27.626921 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:27.626921 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:27.626921 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:27.626921 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:27.626921 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:27.626921 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:27.626921 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:27.626921 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:27.626921 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:27.626921 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:27.626921 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:27.627774 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:27.627774 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:27.627774 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:27.627774 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:27.627774 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:27.627774 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:27.627774 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:27.627774 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:27.627774 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:27.627774 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:27.627774 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:27.627774 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:27.627774 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:27.627774 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:27.627774 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:27.627774 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:27.628596 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:27.628596 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:27.628596 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:27.628596 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:27.628596 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:27.628596 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:27.628596 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:27.628596 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:27.628596 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:27.628596 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:27.628596 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 20:35:27.628596 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:27.628596 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 144/278] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:35:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:27.629256 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6e941-e6c7-4cf3-93a8-829e73edccd8 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:27.632296 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c987e5-9b29-445b-8f1b-534bbaebbdfd None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:27.668360 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7da58-52a5-4b83-add9-4d75599fb309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:27.669385 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7da58-52a5-4b83-add9-4d75599fb309 None admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:27.670001 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7da58-52a5-4b83-add9-4d75599fb309 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:27.670466 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7da58-52a5-4b83-add9-4d75599fb309 None admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:27.671512 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7da58-52a5-4b83-add9-4d75599fb309 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:27.673290 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7da58-52a5-4b83-add9-4d75599fb309 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:27.696146 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 135/279] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Jul 5 20:35:27 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:35:27.697521 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7da58-52a5-4b83-add9-4d75599fb309 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:27.756858 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6e941-e6c7-4cf3-93a8-829e73edccd8 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:27.806445 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d99290-994d-4d35-bb0f-33c056e3c9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:27.808206 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d99290-994d-4d35-bb0f-33c056e3c9a2 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:27.808935 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d99290-994d-4d35-bb0f-33c056e3c9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:27.809397 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d99290-994d-4d35-bb0f-33c056e3c9a2 None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:27.810689 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d99290-994d-4d35-bb0f-33c056e3c9a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:27.811609 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d99290-994d-4d35-bb0f-33c056e3c9a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:27.813595 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d99290-994d-4d35-bb0f-33c056e3c9a2 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:27.814216 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7da58-52a5-4b83-add9-4d75599fb309 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:27.825997 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 145/280] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 5 20:35:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:27.831251 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d99290-994d-4d35-bb0f-33c056e3c9a2 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:27.831424 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:27.863567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72eb9bb-37d3-468a-ba4e-fa5c49ecb234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:27.864545 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72eb9bb-37d3-468a-ba4e-fa5c49ecb234 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:27.864964 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72eb9bb-37d3-468a-ba4e-fa5c49ecb234 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:27.865373 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72eb9bb-37d3-468a-ba4e-fa5c49ecb234 None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:27.866303 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72eb9bb-37d3-468a-ba4e-fa5c49ecb234 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:27.866744 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72eb9bb-37d3-468a-ba4e-fa5c49ecb234 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:27.868317 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72eb9bb-37d3-468a-ba4e-fa5c49ecb234 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:27.877512 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 136/281] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 5 20:35:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:27.883739 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72eb9bb-37d3-468a-ba4e-fa5c49ecb234 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:27.916691 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:27.970816 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d99290-994d-4d35-bb0f-33c056e3c9a2 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:28.012868 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72eb9bb-37d3-468a-ba4e-fa5c49ecb234 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:28.017489 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65bfa60-c1f6-4823-b14d-b3434ef583df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:28.018701 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bfa60-c1f6-4823-b14d-b3434ef583df None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:28.018988 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bfa60-c1f6-4823-b14d-b3434ef583df None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:28.019266 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bfa60-c1f6-4823-b14d-b3434ef583df None admin] PATH_INFO: `/v3/users/7ef800ddb6504350b3b4a5fbab4cf0f5` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:28.034368 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65bfa60-c1f6-4823-b14d-b3434ef583df None admin] RBAC: Authorizing `identity:get_user(user_id=7ef800ddb6504350b3b4a5fbab4cf0f5)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:28.035882 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65bfa60-c1f6-4823-b14d-b3434ef583df None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:28.038022 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 146/282] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:35:27 2022] GET /identity/v3/users/7ef800ddb6504350b3b4a5fbab4cf0f5 => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:35:28.039285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d47f8a-c996-431c-84ac-0393f837014c None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:28.039535 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d47f8a-c996-431c-84ac-0393f837014c None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:28.039812 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d47f8a-c996-431c-84ac-0393f837014c None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:28.041198 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 147/283] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:28.044402 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d47f8a-c996-431c-84ac-0393f837014c None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:28.061610 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e67ae-fe70-470f-b4e2-98c9bb88e847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:28.062695 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e67ae-fe70-470f-b4e2-98c9bb88e847 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:28.062980 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e67ae-fe70-470f-b4e2-98c9bb88e847 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:28.063625 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e67ae-fe70-470f-b4e2-98c9bb88e847 None admin] PATH_INFO: `/v3/users/5ff855e96eef4cdc9b31c8200844b1ee` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:28.064834 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e67ae-fe70-470f-b4e2-98c9bb88e847 None admin] RBAC: Authorizing `identity:get_user(user_id=5ff855e96eef4cdc9b31c8200844b1ee)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:28.066348 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e67ae-fe70-470f-b4e2-98c9bb88e847 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:28.068486 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 137/284] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:35:27 2022] GET /identity/v3/users/5ff855e96eef4cdc9b31c8200844b1ee => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:35:28.069870 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5854fd-5b28-4434-8153-4b9c6240b673 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:28.070302 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5854fd-5b28-4434-8153-4b9c6240b673 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:28.070720 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5854fd-5b28-4434-8153-4b9c6240b673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:28.089018 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-9d5854fd-5b28-4434-8153-4b9c6240b673 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:28.090541 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-9d5854fd-5b28-4434-8153-4b9c6240b673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:28.122735 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:28.172295 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d47f8a-c996-431c-84ac-0393f837014c None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:28.186523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 138/285] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:28.187444 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5854fd-5b28-4434-8153-4b9c6240b673 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:28.189284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:28.221975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d93f9-1566-4f46-b2ff-22efe3c81a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:28.221975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d93f9-1566-4f46-b2ff-22efe3c81a11 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:28.221975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d93f9-1566-4f46-b2ff-22efe3c81a11 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:28.221975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d93f9-1566-4f46-b2ff-22efe3c81a11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:28.222343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d93f9-1566-4f46-b2ff-22efe3c81a11 None admin] RBAC: Adding query filter params (role.id=8dc2563a47c540cfa548eb210d02066e, user.id=7ef800ddb6504350b3b4a5fbab4cf0f5, scope.system=all) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:28.222343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d93f9-1566-4f46-b2ff-22efe3c81a11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:28.222343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d93f9-1566-4f46-b2ff-22efe3c81a11 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:28.233265 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 148/286] 10.222.0.27 () {56 vars in 1308 bytes} [Tue Jul 5 20:35:28 2022] GET /identity/v3/role_assignments?user.id=7ef800ddb6504350b3b4a5fbab4cf0f5&scope.system=all&role.id=8dc2563a47c540cfa548eb210d02066e => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:35:28.234173 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d93f9-1566-4f46-b2ff-22efe3c81a11 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:28.306024 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5854fd-5b28-4434-8153-4b9c6240b673 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:28.346773 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ac23f-23fb-4ec1-8e17-49dbe7398c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:28.348077 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ac23f-23fb-4ec1-8e17-49dbe7398c61 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:28.348555 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ac23f-23fb-4ec1-8e17-49dbe7398c61 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:28.349024 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ac23f-23fb-4ec1-8e17-49dbe7398c61 None admin] PATH_INFO: `/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:28.350660 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ac23f-23fb-4ec1-8e17-49dbe7398c61 None admin] RBAC: Authorizing `identity:get_project(project_id=2ceac2e500814d1f9e4b6160e2b6b2bb)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:28.352466 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ac23f-23fb-4ec1-8e17-49dbe7398c61 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:28.354676 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 139/287] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:28 2022] GET /identity/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:28.360658 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ac23f-23fb-4ec1-8e17-49dbe7398c61 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:28.380781 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d93f9-1566-4f46-b2ff-22efe3c81a11 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:28.439556 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:28.462271 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27569ab8-aeb0-4ab3-a60c-7ebe76d87de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:28.463096 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27569ab8-aeb0-4ab3-a60c-7ebe76d87de3 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:28.463436 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27569ab8-aeb0-4ab3-a60c-7ebe76d87de3 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:28.463710 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27569ab8-aeb0-4ab3-a60c-7ebe76d87de3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:28.477007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27569ab8-aeb0-4ab3-a60c-7ebe76d87de3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:28.484935 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-27569ab8-aeb0-4ab3-a60c-7ebe76d87de3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:35:28.484935 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:28.484935 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:28.484935 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:28.484935 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:28.484935 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:28.484935 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:28.484935 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:28.484935 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:28.484935 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:28.484935 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:28.484935 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:28.484935 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:28.484935 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:28.484935 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:28.484935 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:28.485828 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:28.485828 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:28.485828 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:28.485828 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:28.485828 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:28.485828 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:28.485828 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:28.485828 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:28.485828 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:28.485828 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:28.485828 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:28.485828 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:28.485828 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:28.485828 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:28.485828 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:28.485828 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:28.486664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:28.486664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:28.486664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:28.486664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:28.486664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:28.486664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:28.486664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:28.486664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:28.486664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:28.486664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:28.486664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:35:28.486664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:28.487275 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 149/288] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:35:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:28.493694 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27569ab8-aeb0-4ab3-a60c-7ebe76d87de3 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:28.543167 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ac23f-23fb-4ec1-8e17-49dbe7398c61 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:28.574033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:28.583202 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d738c-448d-40dd-82df-680cc393b3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:28.584240 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d738c-448d-40dd-82df-680cc393b3c8 None admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:28.584526 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d738c-448d-40dd-82df-680cc393b3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:28.584803 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d738c-448d-40dd-82df-680cc393b3c8 None admin] PATH_INFO: `/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb/users/5ff855e96eef4cdc9b31c8200844b1ee/roles/ca2c6e2b56e14467bcd435e641e63880` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:28.587835 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d738c-448d-40dd-82df-680cc393b3c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ceac2e500814d1f9e4b6160e2b6b2bb, user_id=5ff855e96eef4cdc9b31c8200844b1ee, role_id=ca2c6e2b56e14467bcd435e641e63880)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:28.590100 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d738c-448d-40dd-82df-680cc393b3c8 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:28.616432 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 140/289] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 5 20:35:28 2022] PUT /identity/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb/users/5ff855e96eef4cdc9b31c8200844b1ee/roles/ca2c6e2b56e14467bcd435e641e63880 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:35:28.695945 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27569ab8-aeb0-4ab3-a60c-7ebe76d87de3 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:28.755856 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49efd0-46b7-4631-85a0-3f81c5f56abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:28.756443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49efd0-46b7-4631-85a0-3f81c5f56abf None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:28.756725 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49efd0-46b7-4631-85a0-3f81c5f56abf None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:28.757003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49efd0-46b7-4631-85a0-3f81c5f56abf None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:28.757757 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c49efd0-46b7-4631-85a0-3f81c5f56abf None admin] RBAC: Adding query filter params (name=member) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:28.758097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c49efd0-46b7-4631-85a0-3f81c5f56abf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:28.759514 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c49efd0-46b7-4631-85a0-3f81c5f56abf None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:28.773981 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 150/290] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 5 20:35:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:35:28.780304 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d738c-448d-40dd-82df-680cc393b3c8 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:28.916847 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:28.926524 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d738c-448d-40dd-82df-680cc393b3c8 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:28.962445 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699db8d-b6db-4e53-ad58-d1de182ca256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:28.963334 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699db8d-b6db-4e53-ad58-d1de182ca256 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:28.963617 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699db8d-b6db-4e53-ad58-d1de182ca256 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:28.963894 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699db8d-b6db-4e53-ad58-d1de182ca256 None admin] PATH_INFO: `/v3/users/4287e2b13f0141d98f45310547cc5fe1` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:28.965105 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699db8d-b6db-4e53-ad58-d1de182ca256 None admin] RBAC: Authorizing `identity:get_user(user_id=4287e2b13f0141d98f45310547cc5fe1)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:28.966620 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699db8d-b6db-4e53-ad58-d1de182ca256 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:28.968351 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 141/291] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:35:28 2022] GET /identity/v3/users/4287e2b13f0141d98f45310547cc5fe1 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:28.974171 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49efd0-46b7-4631-85a0-3f81c5f56abf None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:29.109831 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:29.114257 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49efd0-46b7-4631-85a0-3f81c5f56abf None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:29.167244 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfc372-b36b-4f3a-9eeb-212afe664d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:29.168400 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfc372-b36b-4f3a-9eeb-212afe664d7e None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:29.168887 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfc372-b36b-4f3a-9eeb-212afe664d7e None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:29.169359 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfc372-b36b-4f3a-9eeb-212afe664d7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:29.274058 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdfc372-b36b-4f3a-9eeb-212afe664d7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:29.275537 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdfc372-b36b-4f3a-9eeb-212afe664d7e None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:29.377081 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:29.381775 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 151/292] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:35:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:35:29.387589 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699db8d-b6db-4e53-ad58-d1de182ca256 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:29.515560 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699db8d-b6db-4e53-ad58-d1de182ca256 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:29.548801 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b747529-5a63-4e72-b015-5708528bcaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:29.549670 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b747529-5a63-4e72-b015-5708528bcaa4 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:29.549973 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b747529-5a63-4e72-b015-5708528bcaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:29.550243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b747529-5a63-4e72-b015-5708528bcaa4 None admin] PATH_INFO: `/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:29.551793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b747529-5a63-4e72-b015-5708528bcaa4 None admin] RBAC: Authorizing `identity:get_project(project_id=2ceac2e500814d1f9e4b6160e2b6b2bb)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:29.553252 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b747529-5a63-4e72-b015-5708528bcaa4 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:29.555285 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 142/293] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:29 2022] GET /identity/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:29.561320 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfc372-b36b-4f3a-9eeb-212afe664d7e None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:29.702156 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfc372-b36b-4f3a-9eeb-212afe664d7e None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:29.750715 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ba16f-827a-4d30-9cc4-c08eb56e6086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:29.751763 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ba16f-827a-4d30-9cc4-c08eb56e6086 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:29.752233 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ba16f-827a-4d30-9cc4-c08eb56e6086 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:29.752706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ba16f-827a-4d30-9cc4-c08eb56e6086 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:29.753726 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ba16f-827a-4d30-9cc4-c08eb56e6086 None admin] RBAC: Adding query filter params (role.id=8dc2563a47c540cfa548eb210d02066e, scope.project.id=2ceac2e500814d1f9e4b6160e2b6b2bb, user.id=4287e2b13f0141d98f45310547cc5fe1) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:29.754241 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ba16f-827a-4d30-9cc4-c08eb56e6086 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:29.755898 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ba16f-827a-4d30-9cc4-c08eb56e6086 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:29.766684 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 152/294] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:35:29 2022] GET /identity/v3/role_assignments?user.id=4287e2b13f0141d98f45310547cc5fe1&scope.project.id=2ceac2e500814d1f9e4b6160e2b6b2bb&role.id=8dc2563a47c540cfa548eb210d02066e => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:35:30.235562 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f124d3-18b2-45c5-bcef-bb5f8ede928f None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:30.236186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f124d3-18b2-45c5-bcef-bb5f8ede928f None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:30.236676 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f124d3-18b2-45c5-bcef-bb5f8ede928f None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:30.238573 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 143/295] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:30.244128 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03285290-649e-4736-96b3-4a632521bee2 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:30.244673 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03285290-649e-4736-96b3-4a632521bee2 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:30.245140 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03285290-649e-4736-96b3-4a632521bee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:30.265648 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-03285290-649e-4736-96b3-4a632521bee2 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:30.267226 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-03285290-649e-4736-96b3-4a632521bee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:30.316912 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac19ba9-6213-4124-a76b-14c9d1a1706a None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:30.317540 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac19ba9-6213-4124-a76b-14c9d1a1706a None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:30.318032 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac19ba9-6213-4124-a76b-14c9d1a1706a None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:30.319678 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 144/296] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:30.327659 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52918e1f-213d-4eae-bfdb-64ff3f7401d6 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:30.328277 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52918e1f-213d-4eae-bfdb-64ff3f7401d6 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:30.328808 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52918e1f-213d-4eae-bfdb-64ff3f7401d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:30.339138 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:30.351028 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-52918e1f-213d-4eae-bfdb-64ff3f7401d6 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:30.352371 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-52918e1f-213d-4eae-bfdb-64ff3f7401d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:30.360558 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 153/297] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:30.383293 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:30.385036 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03285290-649e-4736-96b3-4a632521bee2 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:30.438073 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 145/298] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:35:30.457617 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52918e1f-213d-4eae-bfdb-64ff3f7401d6 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:30.499292 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03285290-649e-4736-96b3-4a632521bee2 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:30.535384 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f66d6-f07d-4505-a9d4-a26666f8b276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:30.536191 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f66d6-f07d-4505-a9d4-a26666f8b276 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:30.536473 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f66d6-f07d-4505-a9d4-a26666f8b276 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:30.536748 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f66d6-f07d-4505-a9d4-a26666f8b276 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:30.547442 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23f66d6-f07d-4505-a9d4-a26666f8b276 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:30.555553 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-a23f66d6-f07d-4505-a9d4-a26666f8b276 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 20:35:30.555553 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:30.555553 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:30.555553 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:30.555553 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:30.555553 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:30.555553 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:30.555553 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:30.555553 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:30.555553 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:30.555553 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:30.555553 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:30.555553 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:30.555553 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:30.555553 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:30.555553 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:30.556437 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:30.556437 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:30.556437 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:30.556437 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:30.556437 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:30.556437 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:30.556437 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:30.556437 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:30.556437 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:30.556437 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:30.556437 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:30.556437 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:30.556437 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:30.556437 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:30.556437 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:30.556437 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:30.557819 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:30.557819 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:30.557819 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:30.557819 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:30.557819 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:30.557819 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:30.557819 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:30.557819 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:30.557819 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:30.557819 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:30.557819 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 20:35:30.557819 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:30.557819 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 154/299] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:35:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:30.564653 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52918e1f-213d-4eae-bfdb-64ff3f7401d6 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:30.565339 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f66d6-f07d-4505-a9d4-a26666f8b276 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:30.600251 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fb44b-63c4-4d0c-bda1-54bd9b1d3282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:30.601399 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fb44b-63c4-4d0c-bda1-54bd9b1d3282 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:30.601915 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fb44b-63c4-4d0c-bda1-54bd9b1d3282 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:30.602378 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fb44b-63c4-4d0c-bda1-54bd9b1d3282 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:30.603735 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520fb44b-63c4-4d0c-bda1-54bd9b1d3282 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:30.605524 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520fb44b-63c4-4d0c-bda1-54bd9b1d3282 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:30.612006 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 146/300] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:35:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:30.614478 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d4441-ee00-4c7c-9af9-867b986235af None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:30.614781 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d4441-ee00-4c7c-9af9-867b986235af None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:30.615062 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d4441-ee00-4c7c-9af9-867b986235af None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:30.618391 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 147/301] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:30.618391 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d4441-ee00-4c7c-9af9-867b986235af None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:30.622519 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:30.654331 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:30.672597 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f66d6-f07d-4505-a9d4-a26666f8b276 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:30.710286 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4834d-8468-4dfc-bb98-9412af724fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:30.710872 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4834d-8468-4dfc-bb98-9412af724fea None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:30.711186 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4834d-8468-4dfc-bb98-9412af724fea None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:30.711459 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4834d-8468-4dfc-bb98-9412af724fea None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:30.712209 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e4834d-8468-4dfc-bb98-9412af724fea None admin] RBAC: Adding query filter params (name=reader) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:30.712514 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e4834d-8468-4dfc-bb98-9412af724fea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:30.713935 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e4834d-8468-4dfc-bb98-9412af724fea None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:30.722616 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 155/302] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 5 20:35:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:35:30.727933 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11760356-1313-46e2-be96-a70dfe0aeb4d None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:30.728213 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11760356-1313-46e2-be96-a70dfe0aeb4d None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:30.728484 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11760356-1313-46e2-be96-a70dfe0aeb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:30.733170 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d4441-ee00-4c7c-9af9-867b986235af None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:30.745118 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-11760356-1313-46e2-be96-a70dfe0aeb4d None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:30.746342 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-11760356-1313-46e2-be96-a70dfe0aeb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:30.767539 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc8590-5df7-4414-8a41-44cc71556bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:30.768253 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc8590-5df7-4414-8a41-44cc71556bb2 None admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:30.768536 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc8590-5df7-4414-8a41-44cc71556bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:30.768812 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc8590-5df7-4414-8a41-44cc71556bb2 None admin] PATH_INFO: `/v3/groups` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:30.769487 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc8590-5df7-4414-8a41-44cc71556bb2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:30.770963 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc8590-5df7-4414-8a41-44cc71556bb2 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:30.786277 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 148/303] 10.222.0.27 () {60 vars in 1134 bytes} [Tue Jul 5 20:35:30 2022] POST /identity/v3/groups => generated 229 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:35:30.795258 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc8590-5df7-4414-8a41-44cc71556bb2 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:30.828711 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 156/304] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:30.851224 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11760356-1313-46e2-be96-a70dfe0aeb4d None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:30.896861 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:30.910373 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc8590-5df7-4414-8a41-44cc71556bb2 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:30.914381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:30.950432 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee51b1-2a38-41fc-9f45-83817254501c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:30.951558 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee51b1-2a38-41fc-9f45-83817254501c None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:30.951946 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee51b1-2a38-41fc-9f45-83817254501c None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:30.952293 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee51b1-2a38-41fc-9f45-83817254501c None admin] PATH_INFO: `/v3/users/d83c257093c2457bb4a8ae41e3faccf4` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:30.968096 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee51b1-2a38-41fc-9f45-83817254501c None admin] RBAC: Authorizing `identity:get_user(user_id=d83c257093c2457bb4a8ae41e3faccf4)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:30.969516 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee51b1-2a38-41fc-9f45-83817254501c None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:30.971490 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 149/305] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:35:30 2022] GET /identity/v3/users/d83c257093c2457bb4a8ae41e3faccf4 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:30.977856 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee51b1-2a38-41fc-9f45-83817254501c None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:30.986359 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11760356-1313-46e2-be96-a70dfe0aeb4d None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:31.025900 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a594cd-5f93-4ba9-87a7-0b06e4ee6798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:31.027018 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a594cd-5f93-4ba9-87a7-0b06e4ee6798 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:31.027300 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a594cd-5f93-4ba9-87a7-0b06e4ee6798 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:31.027573 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a594cd-5f93-4ba9-87a7-0b06e4ee6798 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:31.040160 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a594cd-5f93-4ba9-87a7-0b06e4ee6798 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:31.048391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-24a594cd-5f93-4ba9-87a7-0b06e4ee6798 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:35:31.048391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:31.048391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:31.048391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:31.048391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:31.048391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:31.048391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:31.048391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:31.048391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:31.048391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:31.048391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:31.048391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:31.048391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:31.048391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:31.048391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:31.048391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:31.049358 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:31.049358 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:31.049358 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:31.049358 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:31.049358 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:31.049358 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:31.049358 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:31.049358 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:31.049358 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:31.049358 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:31.049358 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:31.049358 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:31.049358 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:31.049358 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:31.049358 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:31.049358 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:31.051532 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:31.051532 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:31.051532 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:31.051532 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:31.051532 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:31.051532 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:31.051532 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:31.051532 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:31.051532 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:31.051532 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:31.051532 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:35:31.051532 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:31.051532 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 157/306] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:35:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:35:31.056460 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a594cd-5f93-4ba9-87a7-0b06e4ee6798 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:31.105931 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee51b1-2a38-41fc-9f45-83817254501c None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:31.143285 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a2fc3-f7da-4e01-ad8e-315ddccaace4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:31.144406 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a2fc3-f7da-4e01-ad8e-315ddccaace4 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:31.144878 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a2fc3-f7da-4e01-ad8e-315ddccaace4 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:31.145491 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a2fc3-f7da-4e01-ad8e-315ddccaace4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:31.147151 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a2fc3-f7da-4e01-ad8e-315ddccaace4 None admin] RBAC: Adding query filter params (role.id=ca2c6e2b56e14467bcd435e641e63880, user.id=d83c257093c2457bb4a8ae41e3faccf4, scope.system=all) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:31.147654 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a2fc3-f7da-4e01-ad8e-315ddccaace4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:31.149420 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a2fc3-f7da-4e01-ad8e-315ddccaace4 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:31.156016 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 150/307] 10.222.0.27 () {56 vars in 1308 bytes} [Tue Jul 5 20:35:30 2022] GET /identity/v3/role_assignments?user.id=d83c257093c2457bb4a8ae41e3faccf4&scope.system=all&role.id=ca2c6e2b56e14467bcd435e641e63880 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:35:31.170743 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a594cd-5f93-4ba9-87a7-0b06e4ee6798 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:31.174126 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:31.211267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca764b1-8b63-4ec5-a1cf-20912fdce3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:31.212439 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca764b1-8b63-4ec5-a1cf-20912fdce3ce None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:31.212931 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca764b1-8b63-4ec5-a1cf-20912fdce3ce None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:31.213396 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca764b1-8b63-4ec5-a1cf-20912fdce3ce None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:31.214407 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca764b1-8b63-4ec5-a1cf-20912fdce3ce None admin] RBAC: Adding query filter params (name=member) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:31.214905 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca764b1-8b63-4ec5-a1cf-20912fdce3ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:31.216517 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca764b1-8b63-4ec5-a1cf-20912fdce3ce None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:31.227977 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 158/308] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 5 20:35:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:31.235089 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a2fc3-f7da-4e01-ad8e-315ddccaace4 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:31.249960 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:31.261245 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a035ad-3fc7-4b1f-8246-e35d866a3ec5 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:31.261598 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a035ad-3fc7-4b1f-8246-e35d866a3ec5 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:31.261873 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a035ad-3fc7-4b1f-8246-e35d866a3ec5 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:31.264124 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 159/309] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:31.271198 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2448f95-91e7-4cde-9623-2e89677dff11 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:31.271547 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2448f95-91e7-4cde-9623-2e89677dff11 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:31.271760 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2448f95-91e7-4cde-9623-2e89677dff11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:31.295149 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-c2448f95-91e7-4cde-9623-2e89677dff11 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:31.296678 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-c2448f95-91e7-4cde-9623-2e89677dff11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:31.373866 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a2fc3-f7da-4e01-ad8e-315ddccaace4 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:31.386083 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 160/310] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:35:31.409568 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2448f95-91e7-4cde-9623-2e89677dff11 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:31.411802 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dafbdb7-e754-40c2-8c35-c2efc2fcae43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:31.412716 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafbdb7-e754-40c2-8c35-c2efc2fcae43 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:31.413286 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafbdb7-e754-40c2-8c35-c2efc2fcae43 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:31.413566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafbdb7-e754-40c2-8c35-c2efc2fcae43 None admin] PATH_INFO: `/v3/users/7ef800ddb6504350b3b4a5fbab4cf0f5` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:31.415003 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dafbdb7-e754-40c2-8c35-c2efc2fcae43 None admin] RBAC: Authorizing `identity:get_user(user_id=7ef800ddb6504350b3b4a5fbab4cf0f5)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:31.416540 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dafbdb7-e754-40c2-8c35-c2efc2fcae43 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:31.418610 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 151/311] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:35:31 2022] GET /identity/v3/users/7ef800ddb6504350b3b4a5fbab4cf0f5 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:31.426810 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dafbdb7-e754-40c2-8c35-c2efc2fcae43 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:31.526618 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:31.530001 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:31.537002 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2448f95-91e7-4cde-9623-2e89677dff11 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:31.558038 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dafbdb7-e754-40c2-8c35-c2efc2fcae43 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:31.582280 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b07287-b250-439f-bd7a-e067e9f54d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:31.583324 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b07287-b250-439f-bd7a-e067e9f54d0c None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:31.584519 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b07287-b250-439f-bd7a-e067e9f54d0c None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:31.584951 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b07287-b250-439f-bd7a-e067e9f54d0c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:31.599411 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b07287-b250-439f-bd7a-e067e9f54d0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:31.600473 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290666cd-2b7c-4008-be02-5f3eafbc2d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:31.601438 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290666cd-2b7c-4008-be02-5f3eafbc2d50 None admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:31.601786 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290666cd-2b7c-4008-be02-5f3eafbc2d50 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:31.602154 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290666cd-2b7c-4008-be02-5f3eafbc2d50 None admin] PATH_INFO: `/v3/system/users/7ef800ddb6504350b3b4a5fbab4cf0f5/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:31.603715 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290666cd-2b7c-4008-be02-5f3eafbc2d50 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7ef800ddb6504350b3b4a5fbab4cf0f5, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:31.605182 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290666cd-2b7c-4008-be02-5f3eafbc2d50 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:31.609246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-41b07287-b250-439f-bd7a-e067e9f54d0c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 20:35:31.609246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:31.609246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:31.609246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:31.609246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:31.609246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:31.609246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:31.609246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:31.609246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:31.609246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:31.609246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:31.609246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:31.609246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:31.609246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:31.609246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:31.609246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:31.610308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:31.610308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:31.610308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:31.610308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:31.610308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:31.610308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:31.610308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:31.610308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:31.610308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:31.610308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:31.610308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:31.610308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:31.610308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:31.610308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:31.610308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:31.610308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:31.611308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:31.611308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:31.611308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:31.611308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:31.611308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:31.611308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:31.611308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:31.611308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:31.611308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:31.611308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:31.611308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 20:35:31.611308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:31.618244 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 161/312] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:35:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:35:31.620016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b07287-b250-439f-bd7a-e067e9f54d0c None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:31.624318 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 152/313] 10.222.0.27 () {58 vars in 1334 bytes} [Tue Jul 5 20:35:31 2022] PUT /identity/v3/system/users/7ef800ddb6504350b3b4a5fbab4cf0f5/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:35:31.749207 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b07287-b250-439f-bd7a-e067e9f54d0c None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:31.787469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343da1d3-3939-401c-a16c-033e1545ea76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:31.788066 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343da1d3-3939-401c-a16c-033e1545ea76 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:31.788345 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343da1d3-3939-401c-a16c-033e1545ea76 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:31.788617 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343da1d3-3939-401c-a16c-033e1545ea76 None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:31.789372 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343da1d3-3939-401c-a16c-033e1545ea76 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:31.789679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343da1d3-3939-401c-a16c-033e1545ea76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:31.791247 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343da1d3-3939-401c-a16c-033e1545ea76 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:31.805928 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 162/314] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 5 20:35:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:35:31.807597 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290666cd-2b7c-4008-be02-5f3eafbc2d50 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:31.912301 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290666cd-2b7c-4008-be02-5f3eafbc2d50 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:31.947111 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ebb3b-196b-44f5-b584-b0f0a556b984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:31.948002 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ebb3b-196b-44f5-b584-b0f0a556b984 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:31.948290 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ebb3b-196b-44f5-b584-b0f0a556b984 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:31.948558 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ebb3b-196b-44f5-b584-b0f0a556b984 None admin] PATH_INFO: `/v3/users/5ff855e96eef4cdc9b31c8200844b1ee` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:31.949759 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ebb3b-196b-44f5-b584-b0f0a556b984 None admin] RBAC: Authorizing `identity:get_user(user_id=5ff855e96eef4cdc9b31c8200844b1ee)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:31.951274 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ebb3b-196b-44f5-b584-b0f0a556b984 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:31.953215 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 153/315] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:35:31 2022] GET /identity/v3/users/5ff855e96eef4cdc9b31c8200844b1ee => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:31.958730 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343da1d3-3939-401c-a16c-033e1545ea76 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:31.979239 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:32.064274 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343da1d3-3939-401c-a16c-033e1545ea76 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:32.098983 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f207ba50-cc2b-432b-b2b0-f23e2ad6c598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:32.099638 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207ba50-cc2b-432b-b2b0-f23e2ad6c598 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:32.099922 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207ba50-cc2b-432b-b2b0-f23e2ad6c598 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:32.100199 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207ba50-cc2b-432b-b2b0-f23e2ad6c598 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:32.177789 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f207ba50-cc2b-432b-b2b0-f23e2ad6c598 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:32.179650 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f207ba50-cc2b-432b-b2b0-f23e2ad6c598 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:32.198659 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:32.284743 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 163/316] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:35:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:35:32.290265 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ebb3b-196b-44f5-b584-b0f0a556b984 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:32.304004 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:32.396780 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ebb3b-196b-44f5-b584-b0f0a556b984 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:32.431867 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88019091-64c1-4ffa-9b89-f3a5f2b12bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:32.432740 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88019091-64c1-4ffa-9b89-f3a5f2b12bfb None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:32.433022 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88019091-64c1-4ffa-9b89-f3a5f2b12bfb None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:32.433297 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88019091-64c1-4ffa-9b89-f3a5f2b12bfb None admin] PATH_INFO: `/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:32.434506 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88019091-64c1-4ffa-9b89-f3a5f2b12bfb None admin] RBAC: Authorizing `identity:get_project(project_id=2ceac2e500814d1f9e4b6160e2b6b2bb)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:32.436083 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88019091-64c1-4ffa-9b89-f3a5f2b12bfb None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:32.438228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 154/317] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:32 2022] GET /identity/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:32.444265 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f207ba50-cc2b-432b-b2b0-f23e2ad6c598 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:32.545189 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f207ba50-cc2b-432b-b2b0-f23e2ad6c598 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:32.563997 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:32.582188 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0bcb25-dc47-4128-9a13-b992cec80e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:32.582848 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0bcb25-dc47-4128-9a13-b992cec80e4b None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:32.583126 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0bcb25-dc47-4128-9a13-b992cec80e4b None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:32.583398 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0bcb25-dc47-4128-9a13-b992cec80e4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:32.584234 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0bcb25-dc47-4128-9a13-b992cec80e4b None admin] RBAC: Adding query filter params (role.id=ca2c6e2b56e14467bcd435e641e63880, scope.project.id=2ceac2e500814d1f9e4b6160e2b6b2bb, user.id=5ff855e96eef4cdc9b31c8200844b1ee) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:32.584541 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0bcb25-dc47-4128-9a13-b992cec80e4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:32.586013 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0bcb25-dc47-4128-9a13-b992cec80e4b None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:32.592300 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 164/318] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:35:32 2022] GET /identity/v3/role_assignments?user.id=5ff855e96eef4cdc9b31c8200844b1ee&scope.project.id=2ceac2e500814d1f9e4b6160e2b6b2bb&role.id=ca2c6e2b56e14467bcd435e641e63880 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:35:32.990875 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42e525-138a-4e54-8a46-0b2a00a5f798 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:32.991436 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42e525-138a-4e54-8a46-0b2a00a5f798 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:32.991436 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42e525-138a-4e54-8a46-0b2a00a5f798 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:32.992821 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 155/319] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:32.998073 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed3fe9-1883-4139-bf28-56dec19a2dd9 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:32.998367 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed3fe9-1883-4139-bf28-56dec19a2dd9 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:32.998646 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed3fe9-1883-4139-bf28-56dec19a2dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:33.015425 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-68ed3fe9-1883-4139-bf28-56dec19a2dd9 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:33.016616 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-68ed3fe9-1883-4139-bf28-56dec19a2dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:33.092835 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 165/320] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:33.115040 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42e525-138a-4e54-8a46-0b2a00a5f798 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:33.187701 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c4e59-d353-40a0-9f73-65b8fdbba74c None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:33.187980 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c4e59-d353-40a0-9f73-65b8fdbba74c None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:33.188217 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c4e59-d353-40a0-9f73-65b8fdbba74c None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:33.189747 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 166/321] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:35:33.196141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0fef3c-b03b-4991-8e0c-80a3bed6c4c7 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:33.196141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0fef3c-b03b-4991-8e0c-80a3bed6c4c7 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:33.196141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0fef3c-b03b-4991-8e0c-80a3bed6c4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:33.210563 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:33.212091 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-5d0fef3c-b03b-4991-8e0c-80a3bed6c4c7 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:33.213277 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-5d0fef3c-b03b-4991-8e0c-80a3bed6c4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:33.238542 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42e525-138a-4e54-8a46-0b2a00a5f798 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:33.273600 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cdf71-8c0e-452f-b91c-eb56a04a5653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:33.274777 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cdf71-8c0e-452f-b91c-eb56a04a5653 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:33.275065 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cdf71-8c0e-452f-b91c-eb56a04a5653 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:33.275339 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cdf71-8c0e-452f-b91c-eb56a04a5653 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:33.276498 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033cdf71-8c0e-452f-b91c-eb56a04a5653 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:33.277972 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033cdf71-8c0e-452f-b91c-eb56a04a5653 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:33.279821 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 156/322] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:35:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:33.285134 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cdf71-8c0e-452f-b91c-eb56a04a5653 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:33.294118 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 167/323] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:35:33.316760 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0fef3c-b03b-4991-8e0c-80a3bed6c4c7 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:33.363686 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:33.401358 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cdf71-8c0e-452f-b91c-eb56a04a5653 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:33.425009 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0fef3c-b03b-4991-8e0c-80a3bed6c4c7 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:33.437385 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae315e42-219b-407d-837a-54289074d250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:33.438098 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae315e42-219b-407d-837a-54289074d250 None admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:33.438381 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae315e42-219b-407d-837a-54289074d250 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:33.438653 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae315e42-219b-407d-837a-54289074d250 None admin] PATH_INFO: `/v3/groups` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:33.439336 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae315e42-219b-407d-837a-54289074d250 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:33.440800 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae315e42-219b-407d-837a-54289074d250 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:33.456724 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 157/324] 10.222.0.27 () {60 vars in 1134 bytes} [Tue Jul 5 20:35:33 2022] POST /identity/v3/groups => generated 226 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:35:33.470537 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517400b-6ee8-4191-a618-c9045e8ec95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:33.471474 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517400b-6ee8-4191-a618-c9045e8ec95a None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:33.471815 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517400b-6ee8-4191-a618-c9045e8ec95a None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:33.472148 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517400b-6ee8-4191-a618-c9045e8ec95a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:33.486134 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1517400b-6ee8-4191-a618-c9045e8ec95a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:33.494193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-1517400b-6ee8-4191-a618-c9045e8ec95a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 20:35:33.494193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:33.494193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:33.494193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:33.494193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:33.494193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:33.494193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:33.494193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:33.494193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:33.494193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:33.494193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:33.494193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:33.494193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:33.494193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:33.494193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:33.494193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:33.495164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:33.495164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:33.495164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:33.495164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:33.495164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:33.495164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:33.495164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:33.495164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:33.495164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:33.495164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:33.495164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:33.495164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:33.495164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:33.495164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:33.495164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:33.495164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:33.495975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:33.495975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:33.495975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:33.495975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:33.495975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:33.495975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:33.495975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:33.495975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:33.495975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:33.495975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:33.495975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 20:35:33.495975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:33.498224 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 168/325] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:35:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:35:33.501702 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae315e42-219b-407d-837a-54289074d250 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:33.511547 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:33.617329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae315e42-219b-407d-837a-54289074d250 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:33.653058 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082fc645-ed34-43fa-94b4-af45d5833ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:33.653951 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fc645-ed34-43fa-94b4-af45d5833ea6 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:33.654321 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fc645-ed34-43fa-94b4-af45d5833ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:33.654597 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fc645-ed34-43fa-94b4-af45d5833ea6 None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:33.655354 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082fc645-ed34-43fa-94b4-af45d5833ea6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:33.655652 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082fc645-ed34-43fa-94b4-af45d5833ea6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:33.657067 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082fc645-ed34-43fa-94b4-af45d5833ea6 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:33.666348 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 158/326] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 5 20:35:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:35:33.672707 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517400b-6ee8-4191-a618-c9045e8ec95a None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:33.782056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517400b-6ee8-4191-a618-c9045e8ec95a None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:33.783749 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:33.787658 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c52498-8255-4768-bef0-97717ccdc7a0 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:33.788033 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c52498-8255-4768-bef0-97717ccdc7a0 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:33.788382 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c52498-8255-4768-bef0-97717ccdc7a0 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:33.789872 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 159/327] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:35:33.795202 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e8f09-8663-4f88-888b-5e384fc8d0c6 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:33.795584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e8f09-8663-4f88-888b-5e384fc8d0c6 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:33.795952 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e8f09-8663-4f88-888b-5e384fc8d0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:33.816311 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-c15e8f09-8663-4f88-888b-5e384fc8d0c6 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:33.817614 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-c15e8f09-8663-4f88-888b-5e384fc8d0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:33.820652 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9ad71-0eae-4a54-9afe-3fcc23877cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:33.821551 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9ad71-0eae-4a54-9afe-3fcc23877cc1 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:33.821858 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9ad71-0eae-4a54-9afe-3fcc23877cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:33.822142 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9ad71-0eae-4a54-9afe-3fcc23877cc1 None admin] PATH_INFO: `/v3/users/d83c257093c2457bb4a8ae41e3faccf4` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:33.823361 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9ad71-0eae-4a54-9afe-3fcc23877cc1 None admin] RBAC: Authorizing `identity:get_user(user_id=d83c257093c2457bb4a8ae41e3faccf4)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:33.824833 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9ad71-0eae-4a54-9afe-3fcc23877cc1 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:33.826796 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 169/328] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:35:33 2022] GET /identity/v3/users/d83c257093c2457bb4a8ae41e3faccf4 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:33.832540 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9ad71-0eae-4a54-9afe-3fcc23877cc1 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:33.901155 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:33.909380 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 160/329] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:35:33.933988 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e8f09-8663-4f88-888b-5e384fc8d0c6 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:33.961351 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9ad71-0eae-4a54-9afe-3fcc23877cc1 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:34.001227 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332af243-9ec5-4cbe-9c3c-5574e9272cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:34.002137 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332af243-9ec5-4cbe-9c3c-5574e9272cab None admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:34.002416 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332af243-9ec5-4cbe-9c3c-5574e9272cab None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:34.002801 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332af243-9ec5-4cbe-9c3c-5574e9272cab None admin] PATH_INFO: `/v3/system/users/d83c257093c2457bb4a8ae41e3faccf4/roles/ca2c6e2b56e14467bcd435e641e63880` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:34.004302 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332af243-9ec5-4cbe-9c3c-5574e9272cab None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d83c257093c2457bb4a8ae41e3faccf4, role_id=ca2c6e2b56e14467bcd435e641e63880)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:34.005724 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332af243-9ec5-4cbe-9c3c-5574e9272cab None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:34.021493 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 170/330] 10.222.0.27 () {58 vars in 1334 bytes} [Tue Jul 5 20:35:33 2022] PUT /identity/v3/system/users/d83c257093c2457bb4a8ae41e3faccf4/roles/ca2c6e2b56e14467bcd435e641e63880 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:35:34.058637 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e8f09-8663-4f88-888b-5e384fc8d0c6 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:34.100551 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba529e-058d-4f23-8a68-fc8e9f17e7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:34.101642 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba529e-058d-4f23-8a68-fc8e9f17e7fa None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:34.102108 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba529e-058d-4f23-8a68-fc8e9f17e7fa None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:34.102548 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba529e-058d-4f23-8a68-fc8e9f17e7fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:34.115201 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba529e-058d-4f23-8a68-fc8e9f17e7fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:34.123754 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-b6ba529e-058d-4f23-8a68-fc8e9f17e7fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:35:34.123754 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:34.123754 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:34.123754 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:34.123754 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:34.123754 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:34.123754 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:34.123754 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:34.123754 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:34.123754 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:34.123754 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:34.123754 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:34.123754 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:34.123754 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:34.123754 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:34.123754 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:34.124916 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:34.124916 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:34.124916 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:34.124916 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:34.124916 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:34.124916 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:34.124916 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:34.124916 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:34.124916 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:34.124916 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:34.124916 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:34.124916 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:34.124916 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:34.124916 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:34.124916 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:34.124916 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:34.125974 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:34.125974 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:34.125974 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:34.125974 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:34.125974 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:34.125974 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:34.125974 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:34.125974 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:34.125974 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:34.125974 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:34.125974 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:35:34.125974 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:35:34.128178 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 161/331] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:35:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:35:34.137892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332af243-9ec5-4cbe-9c3c-5574e9272cab None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:34.198510 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:34.287654 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332af243-9ec5-4cbe-9c3c-5574e9272cab None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:34.323659 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ecb78-ce35-49fa-a6dd-c505caa12a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:34.324336 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ecb78-ce35-49fa-a6dd-c505caa12a49 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:34.324617 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ecb78-ce35-49fa-a6dd-c505caa12a49 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:34.324891 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ecb78-ce35-49fa-a6dd-c505caa12a49 None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:34.325651 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ecb78-ce35-49fa-a6dd-c505caa12a49 None admin] RBAC: Adding query filter params (name=member) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:34.326077 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ecb78-ce35-49fa-a6dd-c505caa12a49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:34.327506 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ecb78-ce35-49fa-a6dd-c505caa12a49 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:34.337011 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 171/332] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 5 20:35:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:34.343025 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba529e-058d-4f23-8a68-fc8e9f17e7fa None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:34.406330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:34.451378 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba529e-058d-4f23-8a68-fc8e9f17e7fa None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:34.487288 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798b5ff-0012-4e40-9dce-6c3c4a539a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:34.488195 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798b5ff-0012-4e40-9dce-6c3c4a539a7f None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:34.488475 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798b5ff-0012-4e40-9dce-6c3c4a539a7f None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:34.488750 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798b5ff-0012-4e40-9dce-6c3c4a539a7f None admin] PATH_INFO: `/v3/users/7ef800ddb6504350b3b4a5fbab4cf0f5` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:34.489999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0798b5ff-0012-4e40-9dce-6c3c4a539a7f None admin] RBAC: Authorizing `identity:get_user(user_id=7ef800ddb6504350b3b4a5fbab4cf0f5)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:34.491477 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0798b5ff-0012-4e40-9dce-6c3c4a539a7f None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:34.493437 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 162/333] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:35:34 2022] GET /identity/v3/users/7ef800ddb6504350b3b4a5fbab4cf0f5 => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:34.499393 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ecb78-ce35-49fa-a6dd-c505caa12a49 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:34.605386 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ecb78-ce35-49fa-a6dd-c505caa12a49 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:34.613109 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:34.644266 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab448fed-6ebc-4e56-874f-f412b40667a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:34.645207 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab448fed-6ebc-4e56-874f-f412b40667a9 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:34.645501 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab448fed-6ebc-4e56-874f-f412b40667a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:34.645778 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab448fed-6ebc-4e56-874f-f412b40667a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:34.646657 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab448fed-6ebc-4e56-874f-f412b40667a9 None admin] RBAC: Adding query filter params (role.id=8dc2563a47c540cfa548eb210d02066e, user.id=7ef800ddb6504350b3b4a5fbab4cf0f5, scope.system=all) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:34.646971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab448fed-6ebc-4e56-874f-f412b40667a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:34.648437 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab448fed-6ebc-4e56-874f-f412b40667a9 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:34.662641 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 172/334] 10.222.0.27 () {56 vars in 1308 bytes} [Tue Jul 5 20:35:34 2022] GET /identity/v3/role_assignments?user.id=7ef800ddb6504350b3b4a5fbab4cf0f5&scope.system=all&role.id=8dc2563a47c540cfa548eb210d02066e => generated 510 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:36.408015 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17bb15-81cf-44c1-98ce-4bc5f335522d None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:36.408520 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17bb15-81cf-44c1-98ce-4bc5f335522d None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:36.408520 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17bb15-81cf-44c1-98ce-4bc5f335522d None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:36.410176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 163/335] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:36.415290 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c170868-1f3f-41f2-beb9-d346ee5fd747 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:36.416107 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c170868-1f3f-41f2-beb9-d346ee5fd747 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:36.416525 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c170868-1f3f-41f2-beb9-d346ee5fd747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:36.441007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-7c170868-1f3f-41f2-beb9-d346ee5fd747 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:36.442777 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-7c170868-1f3f-41f2-beb9-d346ee5fd747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:36.453404 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee32922-5a97-45df-b599-10970516bcdf None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:36.454094 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee32922-5a97-45df-b599-10970516bcdf None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:36.454567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee32922-5a97-45df-b599-10970516bcdf None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:36.457943 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 164/336] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:36.475806 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283610e-d135-4358-b615-e89121534bae None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:36.476118 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283610e-d135-4358-b615-e89121534bae None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:36.476358 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283610e-d135-4358-b615-e89121534bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:36.510874 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-8283610e-d135-4358-b615-e89121534bae None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:36.512085 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-8283610e-d135-4358-b615-e89121534bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:36.532531 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 173/337] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:36.569571 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c170868-1f3f-41f2-beb9-d346ee5fd747 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:36.691864 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 165/338] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:36.706265 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:36.722884 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c170868-1f3f-41f2-beb9-d346ee5fd747 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:36.735381 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283610e-d135-4358-b615-e89121534bae None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:36.781737 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489e9c1-6dae-4266-9d13-64506f827005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:36.782600 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489e9c1-6dae-4266-9d13-64506f827005 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:36.782885 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489e9c1-6dae-4266-9d13-64506f827005 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:36.783160 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489e9c1-6dae-4266-9d13-64506f827005 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:36.803898 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489e9c1-6dae-4266-9d13-64506f827005 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:36.814217 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:36.815834 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-f489e9c1-6dae-4266-9d13-64506f827005 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:35:36.815834 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:36.815834 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:36.815834 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:36.815834 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:36.815834 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:36.815834 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:36.815834 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:36.815834 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:36.815834 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:36.815834 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:36.815834 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:36.815834 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:36.815834 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:36.815834 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:36.815834 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:36.816910 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:36.816910 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:36.816910 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:36.816910 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:36.816910 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:36.816910 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:36.816910 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:36.816910 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:36.816910 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:36.816910 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:36.816910 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:36.816910 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:36.816910 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:36.816910 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:36.816910 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:36.816910 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:36.817923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:36.817923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:36.817923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:36.817923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:36.817923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:36.817923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:36.817923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:36.817923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:36.817923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:36.817923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:36.817923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:35:36.817923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:36.817923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 174/339] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:35:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:35:36.820053 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebda13-fb8d-4dd1-9cfe-bb73cc723d49 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:36.820053 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebda13-fb8d-4dd1-9cfe-bb73cc723d49 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:36.820053 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ebda13-fb8d-4dd1-9cfe-bb73cc723d49 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:36.820888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 175/340] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:36.830754 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ebda13-fb8d-4dd1-9cfe-bb73cc723d49 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:36.875106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283610e-d135-4358-b615-e89121534bae None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:36.920176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f5536-1326-4cb3-a8cc-a08190a058c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:36.921815 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f5536-1326-4cb3-a8cc-a08190a058c1 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:36.922335 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f5536-1326-4cb3-a8cc-a08190a058c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:36.923127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f5536-1326-4cb3-a8cc-a08190a058c1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:36.937104 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f5536-1326-4cb3-a8cc-a08190a058c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:36.946215 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-f45f5536-1326-4cb3-a8cc-a08190a058c1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:35:36.946215 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:36.946215 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:36.946215 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:36.946215 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:36.946215 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:36.946215 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:36.946215 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:36.946215 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:36.946215 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:36.946215 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:36.946215 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:36.946215 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:36.946215 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:36.946215 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:36.946215 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:36.947127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:36.947127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:36.947127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:36.947127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:36.947127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:36.947127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:36.947127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:36.947127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:36.947127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:36.947127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:36.947127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:36.947127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:36.947127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:36.947127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:36.947127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:36.947127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:36.947938 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:36.947938 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:36.947938 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:36.947938 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:36.947938 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:36.947938 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:36.947938 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:36.947938 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:36.947938 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:36.947938 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:36.947938 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:35:36.947938 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:35:36.950839 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 166/341] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 5 20:35:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:36.951660 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ebda13-fb8d-4dd1-9cfe-bb73cc723d49 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:36.952550 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b288bb-41e5-4222-b8e2-a8ef6574e967 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:36.952974 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b288bb-41e5-4222-b8e2-a8ef6574e967 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:36.953520 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b288bb-41e5-4222-b8e2-a8ef6574e967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:36.972265 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-32b288bb-41e5-4222-b8e2-a8ef6574e967 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:36.973684 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-32b288bb-41e5-4222-b8e2-a8ef6574e967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:36.988700 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96d1b8-27c5-414b-8e15-c0d30cee11c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:36.989584 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96d1b8-27c5-414b-8e15-c0d30cee11c2 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:36.990257 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96d1b8-27c5-414b-8e15-c0d30cee11c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:36.990375 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96d1b8-27c5-414b-8e15-c0d30cee11c2 None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:36.991302 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96d1b8-27c5-414b-8e15-c0d30cee11c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:36.991675 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96d1b8-27c5-414b-8e15-c0d30cee11c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:36.993279 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96d1b8-27c5-414b-8e15-c0d30cee11c2 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:37.003694 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 176/342] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 5 20:35:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:37.005108 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ac76d-4581-4339-8827-c5773559c08f None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:37.010375 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ac76d-4581-4339-8827-c5773559c08f None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:37.010375 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ac76d-4581-4339-8827-c5773559c08f None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:37.010375 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 177/343] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:37.010375 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ac76d-4581-4339-8827-c5773559c08f None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:37.019182 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:37.060612 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 167/344] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:37.061981 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b288bb-41e5-4222-b8e2-a8ef6574e967 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:37.113362 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:37.129676 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ac76d-4581-4339-8827-c5773559c08f None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:37.169160 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98591842-f8cf-4c67-97d1-cf999d25f845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:37.170267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98591842-f8cf-4c67-97d1-cf999d25f845 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:37.171147 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98591842-f8cf-4c67-97d1-cf999d25f845 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:37.171621 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98591842-f8cf-4c67-97d1-cf999d25f845 None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:37.172570 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98591842-f8cf-4c67-97d1-cf999d25f845 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:37.173085 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98591842-f8cf-4c67-97d1-cf999d25f845 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:37.174953 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98591842-f8cf-4c67-97d1-cf999d25f845 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:37.183961 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b288bb-41e5-4222-b8e2-a8ef6574e967 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:37.186144 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 178/345] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:35:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:37.187890 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308b6df-ab51-46df-9d89-b620d619c488 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:37.188402 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308b6df-ab51-46df-9d89-b620d619c488 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:37.188873 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308b6df-ab51-46df-9d89-b620d619c488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:37.208728 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-7308b6df-ab51-46df-9d89-b620d619c488 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:37.211191 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-7308b6df-ab51-46df-9d89-b620d619c488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:37.224700 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdab272-1189-4d57-af25-ebce0986a287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:37.225681 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdab272-1189-4d57-af25-ebce0986a287 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:37.225855 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdab272-1189-4d57-af25-ebce0986a287 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:37.226429 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdab272-1189-4d57-af25-ebce0986a287 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:37.290893 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:37.296433 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 179/346] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:37.297348 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308b6df-ab51-46df-9d89-b620d619c488 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:37.311864 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdab272-1189-4d57-af25-ebce0986a287 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:37.313635 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdab272-1189-4d57-af25-ebce0986a287 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:37.364213 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:37.404064 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308b6df-ab51-46df-9d89-b620d619c488 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:37.426146 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 168/347] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:35:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:35:37.427730 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdab272-1189-4d57-af25-ebce0986a287 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:37.447935 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbbb289-32b6-4404-b07b-c581737a1d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:37.449396 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbb289-32b6-4404-b07b-c581737a1d8e None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:37.449816 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbb289-32b6-4404-b07b-c581737a1d8e None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:37.450250 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbb289-32b6-4404-b07b-c581737a1d8e None admin] PATH_INFO: `/v3/roles/member` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:37.464959 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbbb289-32b6-4404-b07b-c581737a1d8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:37.473297 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-8cbbb289-32b6-4404-b07b-c581737a1d8e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:35:37.473297 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:37.473297 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:37.473297 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:37.473297 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:37.473297 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:37.473297 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:37.473297 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:37.473297 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:37.473297 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:37.473297 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:37.473297 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:37.473297 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:37.473297 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:37.473297 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:37.473297 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:37.474396 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:37.474396 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:37.474396 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:37.474396 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:37.474396 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:37.474396 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:37.474396 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:37.474396 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:37.474396 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:37.474396 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:37.474396 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:37.474396 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:37.474396 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:37.474396 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:37.474396 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:37.474396 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:37.475288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:37.475288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:37.475288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:37.475288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:37.475288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:37.475288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:37.475288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:37.475288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:37.475288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:37.475288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:37.475288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:35:37.475288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:37.477651 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 180/348] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:35:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:37.478620 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbbb289-32b6-4404-b07b-c581737a1d8e None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:37.551713 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdab272-1189-4d57-af25-ebce0986a287 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:37.554838 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:37.600747 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f96d0-81a9-488c-bbcd-207bff670632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:37.601412 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f96d0-81a9-488c-bbcd-207bff670632 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:37.601691 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f96d0-81a9-488c-bbcd-207bff670632 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:37.601991 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f96d0-81a9-488c-bbcd-207bff670632 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:37.609769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbbb289-32b6-4404-b07b-c581737a1d8e None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:37.628323 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:37.651952 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36350fa-c922-42dd-b8a3-052c50b8bd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:37.653151 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36350fa-c922-42dd-b8a3-052c50b8bd08 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:37.653634 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36350fa-c922-42dd-b8a3-052c50b8bd08 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:37.654171 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36350fa-c922-42dd-b8a3-052c50b8bd08 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:37.665148 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36350fa-c922-42dd-b8a3-052c50b8bd08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:37.675826 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-f36350fa-c922-42dd-b8a3-052c50b8bd08 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 20:35:37.675826 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:37.675826 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:37.675826 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:37.675826 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:37.675826 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:37.675826 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:37.675826 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:37.675826 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:37.675826 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:37.675826 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:37.675826 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:37.675826 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:37.675826 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:37.675826 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:37.675826 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:37.676752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:37.676752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:37.676752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:37.676752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:37.676752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:37.676752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:37.676752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:37.676752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:37.676752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:37.676752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:37.676752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:37.676752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:37.676752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:37.676752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:37.676752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:37.676752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:37.677561 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:37.677561 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:37.677561 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:37.677561 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:37.677561 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:37.677561 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:37.677561 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:37.677561 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:37.677561 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:37.677561 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:37.677561 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 05 20:35:37.677561 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:37.680525 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 181/349] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:35:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:37.681522 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36350fa-c922-42dd-b8a3-052c50b8bd08 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:37.684232 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f96d0-81a9-488c-bbcd-207bff670632 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:37.686018 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f96d0-81a9-488c-bbcd-207bff670632 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:37.799746 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36350fa-c922-42dd-b8a3-052c50b8bd08 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:37.808657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 169/350] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:35:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:35:37.810797 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f96d0-81a9-488c-bbcd-207bff670632 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:37.825232 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:37.851180 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e24aed-9b9a-4073-88e0-0c588062e62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:37.851180 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e24aed-9b9a-4073-88e0-0c588062e62f None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:37.851482 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e24aed-9b9a-4073-88e0-0c588062e62f None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:37.851695 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e24aed-9b9a-4073-88e0-0c588062e62f None admin] PATH_INFO: `/v3/projects/49b18126ef0a46788f631cd665c36e57` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:37.854630 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e24aed-9b9a-4073-88e0-0c588062e62f None admin] RBAC: Authorizing `identity:get_project(project_id=49b18126ef0a46788f631cd665c36e57)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:37.856340 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e24aed-9b9a-4073-88e0-0c588062e62f None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:37.858691 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 182/351] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:37 2022] GET /identity/v3/projects/49b18126ef0a46788f631cd665c36e57 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:37.860145 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180276c-47f3-4d51-b466-7417ac9b954a None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:37.860573 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180276c-47f3-4d51-b466-7417ac9b954a None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:37.861003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180276c-47f3-4d51-b466-7417ac9b954a None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:37.862300 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 183/352] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:37.866381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180276c-47f3-4d51-b466-7417ac9b954a None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:37.881389 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:37.955458 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f96d0-81a9-488c-bbcd-207bff670632 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:37.996154 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180276c-47f3-4d51-b466-7417ac9b954a None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:37.999380 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dade0b-f3f2-4b61-855d-96fb4bb5eac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:38.000068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dade0b-f3f2-4b61-855d-96fb4bb5eac5 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:38.000348 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dade0b-f3f2-4b61-855d-96fb4bb5eac5 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:38.000623 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dade0b-f3f2-4b61-855d-96fb4bb5eac5 None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:38.001378 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dade0b-f3f2-4b61-855d-96fb4bb5eac5 None admin] RBAC: Adding query filter params (name=member) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:38.001684 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dade0b-f3f2-4b61-855d-96fb4bb5eac5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:38.004729 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dade0b-f3f2-4b61-855d-96fb4bb5eac5 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:38.016329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 170/353] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 5 20:35:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:38.017412 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dade0b-f3f2-4b61-855d-96fb4bb5eac5 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:38.035546 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee40910-ac92-4483-aff2-44d129da19c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:38.036373 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee40910-ac92-4483-aff2-44d129da19c6 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:38.036657 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee40910-ac92-4483-aff2-44d129da19c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:38.036928 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee40910-ac92-4483-aff2-44d129da19c6 None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:38.038744 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee40910-ac92-4483-aff2-44d129da19c6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:38.039053 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee40910-ac92-4483-aff2-44d129da19c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:38.040452 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee40910-ac92-4483-aff2-44d129da19c6 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:38.052352 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 184/354] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 5 20:35:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:38.053219 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee40910-ac92-4483-aff2-44d129da19c6 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:38.113433 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:38.152294 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dade0b-f3f2-4b61-855d-96fb4bb5eac5 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:38.163868 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:38.185168 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee40910-ac92-4483-aff2-44d129da19c6 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:38.204329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae15d6a-01b6-47d6-b8e7-6abae0648ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:38.205585 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae15d6a-01b6-47d6-b8e7-6abae0648ab5 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:38.208619 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae15d6a-01b6-47d6-b8e7-6abae0648ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:38.208619 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae15d6a-01b6-47d6-b8e7-6abae0648ab5 None admin] PATH_INFO: `/v3/projects/49b18126ef0a46788f631cd665c36e57` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:38.209637 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae15d6a-01b6-47d6-b8e7-6abae0648ab5 None admin] RBAC: Authorizing `identity:get_project(project_id=49b18126ef0a46788f631cd665c36e57)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:38.212146 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae15d6a-01b6-47d6-b8e7-6abae0648ab5 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:38.213563 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 171/355] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:38 2022] GET /identity/v3/projects/49b18126ef0a46788f631cd665c36e57 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:38.215300 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204caf5-97c9-4653-a98c-d38bb3433f03 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:38.215300 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204caf5-97c9-4653-a98c-d38bb3433f03 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:38.215572 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204caf5-97c9-4653-a98c-d38bb3433f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:38.234437 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-c204caf5-97c9-4653-a98c-d38bb3433f03 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:38.235692 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-c204caf5-97c9-4653-a98c-d38bb3433f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:38.235950 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee1f7e-6cf9-4553-9b0e-0d134c826aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:38.237015 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee1f7e-6cf9-4553-9b0e-0d134c826aeb None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:38.237292 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee1f7e-6cf9-4553-9b0e-0d134c826aeb None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:38.237555 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee1f7e-6cf9-4553-9b0e-0d134c826aeb None admin] PATH_INFO: `/v3/groups/1eea90a3713c4b468b2256b7d87be5d5` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:38.247019 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee1f7e-6cf9-4553-9b0e-0d134c826aeb None admin] RBAC: Authorizing `identity:get_group(group_id=1eea90a3713c4b468b2256b7d87be5d5)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:38.248579 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee1f7e-6cf9-4553-9b0e-0d134c826aeb None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:38.252252 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 185/356] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Jul 5 20:35:38 2022] GET /identity/v3/groups/1eea90a3713c4b468b2256b7d87be5d5 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:38.253039 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee1f7e-6cf9-4553-9b0e-0d134c826aeb None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:38.317031 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 172/357] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:38.317859 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204caf5-97c9-4653-a98c-d38bb3433f03 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:38.383160 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee1f7e-6cf9-4553-9b0e-0d134c826aeb None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:38.399159 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:38.424423 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81946fc-e142-4958-af67-628d695edb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:38.425696 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81946fc-e142-4958-af67-628d695edb87 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:38.426066 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81946fc-e142-4958-af67-628d695edb87 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:38.426340 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81946fc-e142-4958-af67-628d695edb87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:38.439989 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204caf5-97c9-4653-a98c-d38bb3433f03 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:38.447928 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:38.485144 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82336b9d-e85e-4943-a330-01623635b01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:38.486148 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82336b9d-e85e-4943-a330-01623635b01b None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:38.486913 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82336b9d-e85e-4943-a330-01623635b01b None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:38.486913 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82336b9d-e85e-4943-a330-01623635b01b None admin] PATH_INFO: `/v3/users/d83c257093c2457bb4a8ae41e3faccf4` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:38.487872 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82336b9d-e85e-4943-a330-01623635b01b None admin] RBAC: Authorizing `identity:get_user(user_id=d83c257093c2457bb4a8ae41e3faccf4)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:38.489338 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82336b9d-e85e-4943-a330-01623635b01b None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:38.490995 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 173/358] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:35:38 2022] GET /identity/v3/users/d83c257093c2457bb4a8ae41e3faccf4 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:38.491760 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82336b9d-e85e-4943-a330-01623635b01b None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:38.513445 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81946fc-e142-4958-af67-628d695edb87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:38.514969 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81946fc-e142-4958-af67-628d695edb87 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:38.605693 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82336b9d-e85e-4943-a330-01623635b01b None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:38.634618 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 186/359] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:35:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:35:38.635782 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81946fc-e142-4958-af67-628d695edb87 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:38.640835 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ff9ca-acbd-427d-b511-b2ea55b9ae0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:38.641711 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ff9ca-acbd-427d-b511-b2ea55b9ae0f None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:38.642020 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ff9ca-acbd-427d-b511-b2ea55b9ae0f None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:38.642292 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ff9ca-acbd-427d-b511-b2ea55b9ae0f None admin] PATH_INFO: `/v3/groups/1eea90a3713c4b468b2256b7d87be5d5` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:38.643476 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ff9ca-acbd-427d-b511-b2ea55b9ae0f None admin] RBAC: Authorizing `identity:get_group(group_id=1eea90a3713c4b468b2256b7d87be5d5)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:38.644934 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ff9ca-acbd-427d-b511-b2ea55b9ae0f None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:38.646589 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 174/360] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Jul 5 20:35:38 2022] GET /identity/v3/groups/1eea90a3713c4b468b2256b7d87be5d5 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:38.647518 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ff9ca-acbd-427d-b511-b2ea55b9ae0f None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:38.655199 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:38.700767 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:38.761441 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81946fc-e142-4958-af67-628d695edb87 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:38.762318 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ff9ca-acbd-427d-b511-b2ea55b9ae0f None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:38.801479 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e528f9-5673-4e92-b652-0fb5de48003c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:38.802350 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e528f9-5673-4e92-b652-0fb5de48003c None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:38.802799 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e528f9-5673-4e92-b652-0fb5de48003c None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:38.803088 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e528f9-5673-4e92-b652-0fb5de48003c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:38.804601 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b7f41-56b2-44dc-843b-f878a88dbe6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:38.805257 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b7f41-56b2-44dc-843b-f878a88dbe6d None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:38.805531 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b7f41-56b2-44dc-843b-f878a88dbe6d None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:38.805804 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b7f41-56b2-44dc-843b-f878a88dbe6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:38.806677 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b7f41-56b2-44dc-843b-f878a88dbe6d None admin] RBAC: Adding query filter params (group.id=1eea90a3713c4b468b2256b7d87be5d5, role.id=8dc2563a47c540cfa548eb210d02066e, scope.project.id=49b18126ef0a46788f631cd665c36e57) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:38.806979 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b7f41-56b2-44dc-843b-f878a88dbe6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:38.808417 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b7f41-56b2-44dc-843b-f878a88dbe6d None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:38.817152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e528f9-5673-4e92-b652-0fb5de48003c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:38.817911 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 187/361] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Jul 5 20:35:38 2022] GET /identity/v3/role_assignments?group.id=1eea90a3713c4b468b2256b7d87be5d5&scope.project.id=49b18126ef0a46788f631cd665c36e57&role.id=8dc2563a47c540cfa548eb210d02066e => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:38.819550 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08a15f-6021-4bb4-bf03-7c131a86ee27 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:38.820051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08a15f-6021-4bb4-bf03-7c131a86ee27 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:38.820550 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08a15f-6021-4bb4-bf03-7c131a86ee27 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:38.822270 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 188/362] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:38.823268 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08a15f-6021-4bb4-bf03-7c131a86ee27 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:38.826694 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-75e528f9-5673-4e92-b652-0fb5de48003c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:35:38.826694 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:38.826694 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:38.826694 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:38.826694 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:38.826694 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:38.826694 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:38.826694 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:38.826694 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:38.826694 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:38.826694 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:38.826694 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:38.826694 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:38.826694 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:38.826694 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:38.826694 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:38.827653 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:38.827653 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:38.827653 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:38.827653 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:38.827653 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:38.827653 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:38.827653 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:38.827653 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:38.827653 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:38.827653 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:38.827653 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:38.827653 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:38.827653 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:38.827653 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:38.827653 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:38.827653 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:38.828457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:38.828457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:38.828457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:38.828457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:38.828457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:38.828457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:38.828457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:38.828457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:38.828457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:38.828457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:38.828457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:35:38.828457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:35:38.828457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 175/363] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 5 20:35:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:38.829888 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e528f9-5673-4e92-b652-0fb5de48003c None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:38.955819 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:38.984381 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e528f9-5673-4e92-b652-0fb5de48003c None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:38.986319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:38.992465 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08a15f-6021-4bb4-bf03-7c131a86ee27 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:39.029228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91936b-c36b-475f-9669-7f844089b896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:39.030185 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91936b-c36b-475f-9669-7f844089b896 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:39.030632 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91936b-c36b-475f-9669-7f844089b896 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:39.031054 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91936b-c36b-475f-9669-7f844089b896 None admin] PATH_INFO: `/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:39.033667 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91936b-c36b-475f-9669-7f844089b896 None admin] RBAC: Authorizing `identity:get_project(project_id=2ceac2e500814d1f9e4b6160e2b6b2bb)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:39.035385 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91936b-c36b-475f-9669-7f844089b896 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:39.037126 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 176/364] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:38 2022] GET /identity/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:39.039199 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91936b-c36b-475f-9669-7f844089b896 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:39.039651 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2020203-8db5-4722-a404-08e104278937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:39.040370 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2020203-8db5-4722-a404-08e104278937 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:39.040656 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2020203-8db5-4722-a404-08e104278937 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:39.040933 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2020203-8db5-4722-a404-08e104278937 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:39.041855 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2020203-8db5-4722-a404-08e104278937 None admin] RBAC: Adding query filter params (role.id=ca2c6e2b56e14467bcd435e641e63880, user.id=d83c257093c2457bb4a8ae41e3faccf4, scope.system=all) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:39.042297 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2020203-8db5-4722-a404-08e104278937 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:39.045341 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2020203-8db5-4722-a404-08e104278937 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:39.061403 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 189/365] 10.222.0.27 () {56 vars in 1308 bytes} [Tue Jul 5 20:35:38 2022] GET /identity/v3/role_assignments?user.id=d83c257093c2457bb4a8ae41e3faccf4&scope.system=all&role.id=ca2c6e2b56e14467bcd435e641e63880 => generated 510 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:39.062595 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c113208-e4f7-4b40-8f13-0f1eeeb08fa2 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:39.062877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c113208-e4f7-4b40-8f13-0f1eeeb08fa2 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:39.063314 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c113208-e4f7-4b40-8f13-0f1eeeb08fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:39.081130 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-6c113208-e4f7-4b40-8f13-0f1eeeb08fa2 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:39.082867 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-6c113208-e4f7-4b40-8f13-0f1eeeb08fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:39.166296 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91936b-c36b-475f-9669-7f844089b896 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:39.168715 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 190/366] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:39.169807 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c113208-e4f7-4b40-8f13-0f1eeeb08fa2 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:39.206297 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e605be-51d5-4684-ab7c-6fbd1f9f9e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:39.206982 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e605be-51d5-4684-ab7c-6fbd1f9f9e22 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:39.207331 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e605be-51d5-4684-ab7c-6fbd1f9f9e22 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:39.207679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e605be-51d5-4684-ab7c-6fbd1f9f9e22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:39.208751 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e605be-51d5-4684-ab7c-6fbd1f9f9e22 None admin] RBAC: Adding query filter params (group.id=1eea90a3713c4b468b2256b7d87be5d5, role.id=c403525d65944d2187540a6d893b91e7, scope.project.id=49b18126ef0a46788f631cd665c36e57) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:39.209137 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e605be-51d5-4684-ab7c-6fbd1f9f9e22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:39.210886 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e605be-51d5-4684-ab7c-6fbd1f9f9e22 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:39.222057 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 177/367] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Jul 5 20:35:39 2022] GET /identity/v3/role_assignments?group.id=1eea90a3713c4b468b2256b7d87be5d5&scope.project.id=49b18126ef0a46788f631cd665c36e57&role.id=c403525d65944d2187540a6d893b91e7 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:39.223234 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e605be-51d5-4684-ab7c-6fbd1f9f9e22 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:39.271040 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:39.284287 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:39.353572 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c113208-e4f7-4b40-8f13-0f1eeeb08fa2 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:39.365350 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e605be-51d5-4684-ab7c-6fbd1f9f9e22 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:39.401399 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c21d72-759c-4636-a037-d14b060af3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:39.402165 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c21d72-759c-4636-a037-d14b060af3fc None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:39.402443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c21d72-759c-4636-a037-d14b060af3fc None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:39.402712 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c21d72-759c-4636-a037-d14b060af3fc None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:39.403480 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c21d72-759c-4636-a037-d14b060af3fc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:39.403783 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c21d72-759c-4636-a037-d14b060af3fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:39.405283 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c21d72-759c-4636-a037-d14b060af3fc None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:39.415936 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 191/368] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:35:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:39.416611 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c21d72-759c-4636-a037-d14b060af3fc None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:39.428043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa1ba6-2655-451b-94ae-4cc85da69156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:39.429002 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa1ba6-2655-451b-94ae-4cc85da69156 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:39.429336 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa1ba6-2655-451b-94ae-4cc85da69156 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:39.429613 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa1ba6-2655-451b-94ae-4cc85da69156 None admin] PATH_INFO: `/v3/groups/1eea90a3713c4b468b2256b7d87be5d5` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:39.431133 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa1ba6-2655-451b-94ae-4cc85da69156 None admin] RBAC: Authorizing `identity:get_group(group_id=1eea90a3713c4b468b2256b7d87be5d5)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:39.433344 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa1ba6-2655-451b-94ae-4cc85da69156 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:39.436054 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 178/369] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Jul 5 20:35:39 2022] GET /identity/v3/groups/1eea90a3713c4b468b2256b7d87be5d5 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:39.439148 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa1ba6-2655-451b-94ae-4cc85da69156 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:39.547639 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c21d72-759c-4636-a037-d14b060af3fc None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:39.564263 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa1ba6-2655-451b-94ae-4cc85da69156 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:39.565825 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:39.575628 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:39.586158 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275253b5-936e-485c-b8ce-225ed95befa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:39.586976 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275253b5-936e-485c-b8ce-225ed95befa8 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:39.587259 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275253b5-936e-485c-b8ce-225ed95befa8 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:39.587535 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275253b5-936e-485c-b8ce-225ed95befa8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:39.599570 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275253b5-936e-485c-b8ce-225ed95befa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:39.603305 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af37f3-174a-41a9-a79f-7bc1e9bd3dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:39.604188 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af37f3-174a-41a9-a79f-7bc1e9bd3dd2 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:39.604614 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af37f3-174a-41a9-a79f-7bc1e9bd3dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:39.605024 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af37f3-174a-41a9-a79f-7bc1e9bd3dd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:39.608049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-275253b5-936e-485c-b8ce-225ed95befa8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:35:39.608049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:39.608049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:39.608049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:39.608049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:39.608049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:39.608049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:39.608049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:39.608049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:39.608049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:39.608049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:39.608049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:39.608049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:39.608049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:39.608049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:39.608049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:39.609147 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:39.609147 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:39.609147 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:39.609147 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:39.609147 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:39.609147 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:39.609147 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:39.609147 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:39.609147 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:39.609147 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:39.609147 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:39.609147 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:39.609147 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:39.609147 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:39.609147 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:39.609147 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:39.610135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:39.610135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:39.610135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:39.610135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:39.610135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:39.610135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:39.610135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:39.610135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:39.610135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:39.610135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:39.610135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:35:39.610135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:39.612381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 192/370] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 5 20:35:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:39.613401 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275253b5-936e-485c-b8ce-225ed95befa8 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:39.686027 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af37f3-174a-41a9-a79f-7bc1e9bd3dd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:39.687432 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af37f3-174a-41a9-a79f-7bc1e9bd3dd2 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:39.735297 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275253b5-936e-485c-b8ce-225ed95befa8 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:39.783547 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a414525-5999-428d-b336-dd46af962cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:39.784752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a414525-5999-428d-b336-dd46af962cd0 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:39.785235 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a414525-5999-428d-b336-dd46af962cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:39.785668 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a414525-5999-428d-b336-dd46af962cd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:39.787124 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a414525-5999-428d-b336-dd46af962cd0 None admin] RBAC: Adding query filter params (group.id=1eea90a3713c4b468b2256b7d87be5d5, role.id=8dc2563a47c540cfa548eb210d02066e, scope.project.id=2ceac2e500814d1f9e4b6160e2b6b2bb) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:39.787618 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a414525-5999-428d-b336-dd46af962cd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:39.789258 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a414525-5999-428d-b336-dd46af962cd0 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:39.798144 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 193/371] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Jul 5 20:35:39 2022] GET /identity/v3/role_assignments?group.id=1eea90a3713c4b468b2256b7d87be5d5&scope.project.id=2ceac2e500814d1f9e4b6160e2b6b2bb&role.id=8dc2563a47c540cfa548eb210d02066e => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:39.799950 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a414525-5999-428d-b336-dd46af962cd0 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:39.808408 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 179/372] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:35:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:35:39.810801 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af37f3-174a-41a9-a79f-7bc1e9bd3dd2 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:39.818262 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:39.886315 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:39.938867 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af37f3-174a-41a9-a79f-7bc1e9bd3dd2 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:39.964356 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a414525-5999-428d-b336-dd46af962cd0 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:39.980284 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7c141-b0ac-4b87-b4ae-fa2b59503328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:39.981561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7c141-b0ac-4b87-b4ae-fa2b59503328 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:39.982178 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7c141-b0ac-4b87-b4ae-fa2b59503328 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:39.982658 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7c141-b0ac-4b87-b4ae-fa2b59503328 None admin] PATH_INFO: `/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:39.984867 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a7c141-b0ac-4b87-b4ae-fa2b59503328 None admin] RBAC: Authorizing `identity:get_project(project_id=2ceac2e500814d1f9e4b6160e2b6b2bb)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:39.986636 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a7c141-b0ac-4b87-b4ae-fa2b59503328 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:39.993766 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 180/373] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:39 2022] GET /identity/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:35:39.996106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7c141-b0ac-4b87-b4ae-fa2b59503328 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:40.074674 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f8784-31ae-404c-9ec6-d923b8eac0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:40.075329 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f8784-31ae-404c-9ec6-d923b8eac0b7 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:40.075623 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f8784-31ae-404c-9ec6-d923b8eac0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:40.075929 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f8784-31ae-404c-9ec6-d923b8eac0b7 None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:40.076693 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f8784-31ae-404c-9ec6-d923b8eac0b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:40.077001 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f8784-31ae-404c-9ec6-d923b8eac0b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:40.077789 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:40.078577 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f8784-31ae-404c-9ec6-d923b8eac0b7 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:40.093204 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 194/374] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:35:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:40.098809 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f8784-31ae-404c-9ec6-d923b8eac0b7 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:40.122347 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7c141-b0ac-4b87-b4ae-fa2b59503328 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:40.168434 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54560c3-d52c-49c9-94e7-8cc0dfed8016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:40.169608 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54560c3-d52c-49c9-94e7-8cc0dfed8016 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:40.169918 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54560c3-d52c-49c9-94e7-8cc0dfed8016 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:40.170197 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54560c3-d52c-49c9-94e7-8cc0dfed8016 None admin] PATH_INFO: `/v3/groups/1eea90a3713c4b468b2256b7d87be5d5` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:40.173829 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54560c3-d52c-49c9-94e7-8cc0dfed8016 None admin] RBAC: Authorizing `identity:get_group(group_id=1eea90a3713c4b468b2256b7d87be5d5)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:40.176332 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54560c3-d52c-49c9-94e7-8cc0dfed8016 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:40.180164 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 181/375] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Jul 5 20:35:39 2022] GET /identity/v3/groups/1eea90a3713c4b468b2256b7d87be5d5 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:35:40.185724 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54560c3-d52c-49c9-94e7-8cc0dfed8016 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:40.306942 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54560c3-d52c-49c9-94e7-8cc0dfed8016 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:40.349823 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed145e-5d70-4303-89e3-666e1ae38a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:40.350523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed145e-5d70-4303-89e3-666e1ae38a35 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:40.350806 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed145e-5d70-4303-89e3-666e1ae38a35 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:40.351078 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed145e-5d70-4303-89e3-666e1ae38a35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:40.351928 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed145e-5d70-4303-89e3-666e1ae38a35 None admin] RBAC: Adding query filter params (group.id=1eea90a3713c4b468b2256b7d87be5d5, role.id=c403525d65944d2187540a6d893b91e7, scope.project.id=2ceac2e500814d1f9e4b6160e2b6b2bb) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:40.352244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed145e-5d70-4303-89e3-666e1ae38a35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:40.353714 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed145e-5d70-4303-89e3-666e1ae38a35 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:40.358820 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f8784-31ae-404c-9ec6-d923b8eac0b7 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:40.367037 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 182/376] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Jul 5 20:35:40 2022] GET /identity/v3/role_assignments?group.id=1eea90a3713c4b468b2256b7d87be5d5&scope.project.id=2ceac2e500814d1f9e4b6160e2b6b2bb&role.id=c403525d65944d2187540a6d893b91e7 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:40.377529 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:40.410881 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069f221-0723-4ebc-bb9c-1d8047d00cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:40.411546 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069f221-0723-4ebc-bb9c-1d8047d00cf6 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:40.411839 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069f221-0723-4ebc-bb9c-1d8047d00cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:40.412118 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069f221-0723-4ebc-bb9c-1d8047d00cf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:40.505268 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4069f221-0723-4ebc-bb9c-1d8047d00cf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:40.506787 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4069f221-0723-4ebc-bb9c-1d8047d00cf6 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:40.650380 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 195/377] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:35:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 20:35:40.651956 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed145e-5d70-4303-89e3-666e1ae38a35 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:40.660589 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:40.785123 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed145e-5d70-4303-89e3-666e1ae38a35 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:40.826890 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a27bdc-2f5a-46e7-8571-3f0f3a36cd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:40.827771 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a27bdc-2f5a-46e7-8571-3f0f3a36cd74 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:40.828047 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a27bdc-2f5a-46e7-8571-3f0f3a36cd74 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:40.828319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a27bdc-2f5a-46e7-8571-3f0f3a36cd74 None admin] PATH_INFO: `/v3/projects/d2d267a59c9249019ee131b3dae58a6e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:40.829511 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a27bdc-2f5a-46e7-8571-3f0f3a36cd74 None admin] RBAC: Authorizing `identity:get_project(project_id=d2d267a59c9249019ee131b3dae58a6e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:40.831029 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a27bdc-2f5a-46e7-8571-3f0f3a36cd74 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:40.833145 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 183/378] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:40 2022] GET /identity/v3/projects/d2d267a59c9249019ee131b3dae58a6e => generated 344 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:40.838706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069f221-0723-4ebc-bb9c-1d8047d00cf6 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:40.862733 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:40.972629 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069f221-0723-4ebc-bb9c-1d8047d00cf6 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:41.013244 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b84255f-d34b-4cab-8154-36108b8534da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:41.014587 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84255f-d34b-4cab-8154-36108b8534da None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:41.015071 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84255f-d34b-4cab-8154-36108b8534da None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:41.015537 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b84255f-d34b-4cab-8154-36108b8534da None admin] PATH_INFO: `/v3/groups/09bdc2faea2941469614ebb972e8373e` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:41.026737 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84255f-d34b-4cab-8154-36108b8534da None admin] RBAC: Authorizing `identity:get_group(group_id=09bdc2faea2941469614ebb972e8373e)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:41.028500 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b84255f-d34b-4cab-8154-36108b8534da None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:41.030605 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 196/379] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Jul 5 20:35:40 2022] GET /identity/v3/groups/09bdc2faea2941469614ebb972e8373e => generated 229 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:41.036604 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a27bdc-2f5a-46e7-8571-3f0f3a36cd74 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:41.136475 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:41.158742 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a040fe0-1977-4939-8378-63c127aad54d None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:41.159119 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a040fe0-1977-4939-8378-63c127aad54d None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:41.159724 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a040fe0-1977-4939-8378-63c127aad54d None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:41.161611 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 197/380] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:35:41.174088 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befec8c-1a2d-4d1a-9d69-f6a792b41d81 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:41.174372 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befec8c-1a2d-4d1a-9d69-f6a792b41d81 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:41.174692 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6befec8c-1a2d-4d1a-9d69-f6a792b41d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:41.185863 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a27bdc-2f5a-46e7-8571-3f0f3a36cd74 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:41.213808 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-6befec8c-1a2d-4d1a-9d69-f6a792b41d81 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:41.215047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-6befec8c-1a2d-4d1a-9d69-f6a792b41d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:41.219485 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7755c-8734-4120-a00e-4db393496a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:41.220148 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7755c-8734-4120-a00e-4db393496a6f None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:41.220642 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7755c-8734-4120-a00e-4db393496a6f None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:41.221095 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7755c-8734-4120-a00e-4db393496a6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:41.222142 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7755c-8734-4120-a00e-4db393496a6f None admin] RBAC: Adding query filter params (group.id=09bdc2faea2941469614ebb972e8373e, role.id=37ba4a62052348d4811b560c19a07e02, scope.project.id=d2d267a59c9249019ee131b3dae58a6e) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:41.222703 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7755c-8734-4120-a00e-4db393496a6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:41.224495 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7755c-8734-4120-a00e-4db393496a6f None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:41.235148 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 184/381] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Jul 5 20:35:41 2022] GET /identity/v3/role_assignments?group.id=09bdc2faea2941469614ebb972e8373e&scope.project.id=d2d267a59c9249019ee131b3dae58a6e&role.id=37ba4a62052348d4811b560c19a07e02 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:41.324467 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 198/382] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:41.361774 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7755c-8734-4120-a00e-4db393496a6f None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:41.490250 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7755c-8734-4120-a00e-4db393496a6f None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:41.539404 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b14e14-bd39-407c-8a8a-bb605f8bd14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:41.540217 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b14e14-bd39-407c-8a8a-bb605f8bd14f None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:41.540496 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b14e14-bd39-407c-8a8a-bb605f8bd14f None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:41.540767 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b14e14-bd39-407c-8a8a-bb605f8bd14f None admin] PATH_INFO: `/v3/roles/member` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:41.542624 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:41.559747 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b14e14-bd39-407c-8a8a-bb605f8bd14f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:41.567511 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-04b14e14-bd39-407c-8a8a-bb605f8bd14f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:35:41.567511 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:41.567511 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:41.567511 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:41.567511 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:41.567511 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:41.567511 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:41.567511 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:41.567511 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:41.567511 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:41.567511 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:41.567511 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:41.567511 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:41.567511 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:41.567511 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:41.567511 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:41.568443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:41.568443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:41.568443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:41.568443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:41.568443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:41.568443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:41.568443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:41.568443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:41.568443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:41.568443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:41.568443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:41.568443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:41.568443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:41.568443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:41.568443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:41.568443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:41.569268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:41.569268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:41.569268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:41.569268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:41.569268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:41.569268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:41.569268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:41.569268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:41.569268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:41.569268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:41.569268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:35:41.569268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:35:41.569268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 185/383] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:35:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:41.576260 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befec8c-1a2d-4d1a-9d69-f6a792b41d81 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:41.588752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:41.704948 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6befec8c-1a2d-4d1a-9d69-f6a792b41d81 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:41.750146 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c280a008-67f0-4f56-ac1e-19b6ef25e3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:41.750736 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280a008-67f0-4f56-ac1e-19b6ef25e3a4 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:41.751013 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280a008-67f0-4f56-ac1e-19b6ef25e3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:41.751282 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280a008-67f0-4f56-ac1e-19b6ef25e3a4 None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:41.752030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c280a008-67f0-4f56-ac1e-19b6ef25e3a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:41.752330 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c280a008-67f0-4f56-ac1e-19b6ef25e3a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:41.753720 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c280a008-67f0-4f56-ac1e-19b6ef25e3a4 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:41.765931 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 199/384] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 5 20:35:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:41.770955 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b14e14-bd39-407c-8a8a-bb605f8bd14f None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:41.902864 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b14e14-bd39-407c-8a8a-bb605f8bd14f None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:41.945316 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d487a2a-4573-4e60-83a2-aecb89a71b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:41.946623 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d487a2a-4573-4e60-83a2-aecb89a71b27 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:41.947101 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d487a2a-4573-4e60-83a2-aecb89a71b27 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:41.947591 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d487a2a-4573-4e60-83a2-aecb89a71b27 None admin] PATH_INFO: `/v3/groups/1eea90a3713c4b468b2256b7d87be5d5` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:41.954377 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d487a2a-4573-4e60-83a2-aecb89a71b27 None admin] RBAC: Authorizing `identity:get_group(group_id=1eea90a3713c4b468b2256b7d87be5d5)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:41.956272 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d487a2a-4573-4e60-83a2-aecb89a71b27 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:41.958330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 186/385] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Jul 5 20:35:41 2022] GET /identity/v3/groups/1eea90a3713c4b468b2256b7d87be5d5 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:41.967124 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c280a008-67f0-4f56-ac1e-19b6ef25e3a4 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:42.082259 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:42.132233 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1f35d-f4b3-4a14-b5ab-13406945a29d None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:42.132580 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1f35d-f4b3-4a14-b5ab-13406945a29d None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:42.132768 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1f35d-f4b3-4a14-b5ab-13406945a29d None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:42.134461 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 187/386] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:35:42.148081 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d415186-29de-42f1-bd6a-a8500b454906 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:42.148081 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d415186-29de-42f1-bd6a-a8500b454906 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:42.148081 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d415186-29de-42f1-bd6a-a8500b454906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:42.158841 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c280a008-67f0-4f56-ac1e-19b6ef25e3a4 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:42.190478 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-3d415186-29de-42f1-bd6a-a8500b454906 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:42.191685 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-3d415186-29de-42f1-bd6a-a8500b454906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:42.203214 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9316ff8-8e77-49b1-85c2-5f8592f07963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:42.204093 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9316ff8-8e77-49b1-85c2-5f8592f07963 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:42.204368 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9316ff8-8e77-49b1-85c2-5f8592f07963 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:42.204634 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9316ff8-8e77-49b1-85c2-5f8592f07963 None admin] PATH_INFO: `/v3/projects/49b18126ef0a46788f631cd665c36e57` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:42.205817 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9316ff8-8e77-49b1-85c2-5f8592f07963 None admin] RBAC: Authorizing `identity:get_project(project_id=49b18126ef0a46788f631cd665c36e57)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:42.210989 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9316ff8-8e77-49b1-85c2-5f8592f07963 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:42.218503 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 200/387] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:41 2022] GET /identity/v3/projects/49b18126ef0a46788f631cd665c36e57 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:42.223755 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9316ff8-8e77-49b1-85c2-5f8592f07963 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:42.306762 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:42.327751 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 188/388] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:42.373756 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d415186-29de-42f1-bd6a-a8500b454906 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:42.385163 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9316ff8-8e77-49b1-85c2-5f8592f07963 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:42.425740 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a403d-8067-447a-a332-60ec0c5b4919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:42.426719 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a403d-8067-447a-a332-60ec0c5b4919 None admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:42.427003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a403d-8067-447a-a332-60ec0c5b4919 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:42.427279 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a403d-8067-447a-a332-60ec0c5b4919 None admin] PATH_INFO: `/v3/projects/49b18126ef0a46788f631cd665c36e57/groups/1eea90a3713c4b468b2256b7d87be5d5/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:42.429333 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a403d-8067-447a-a332-60ec0c5b4919 None admin] RBAC: Authorizing `identity:create_grant(project_id=49b18126ef0a46788f631cd665c36e57, group_id=1eea90a3713c4b468b2256b7d87be5d5, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:42.430906 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a403d-8067-447a-a332-60ec0c5b4919 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:42.434419 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:42.452273 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 201/389] 10.222.0.27 () {58 vars in 1442 bytes} [Tue Jul 5 20:35:42 2022] PUT /identity/v3/projects/49b18126ef0a46788f631cd665c36e57/groups/1eea90a3713c4b468b2256b7d87be5d5/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:35:42.454470 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bff8c4-b17e-440b-9772-a1c091918b5d None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:42.454933 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bff8c4-b17e-440b-9772-a1c091918b5d None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:42.455872 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bff8c4-b17e-440b-9772-a1c091918b5d None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:42.458304 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 202/390] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:42.464254 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ddd71-5c17-473f-9f30-05c82f0e516a None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:42.464792 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ddd71-5c17-473f-9f30-05c82f0e516a None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:42.465209 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ddd71-5c17-473f-9f30-05c82f0e516a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:42.484151 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-2e9ddd71-5c17-473f-9f30-05c82f0e516a None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:42.485642 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-2e9ddd71-5c17-473f-9f30-05c82f0e516a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:42.507130 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d415186-29de-42f1-bd6a-a8500b454906 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:42.545486 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb1942-c16b-4801-a52f-46ce2f96c4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:42.546476 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb1942-c16b-4801-a52f-46ce2f96c4ee None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:42.546714 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb1942-c16b-4801-a52f-46ce2f96c4ee None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:42.546991 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb1942-c16b-4801-a52f-46ce2f96c4ee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:42.559502 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb1942-c16b-4801-a52f-46ce2f96c4ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:42.562694 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 203/391] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:42.568314 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-dcfb1942-c16b-4801-a52f-46ce2f96c4ee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:35:42.568314 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:42.568314 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:42.568314 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:42.568314 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:42.568314 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:42.568314 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:42.568314 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:42.568314 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:42.568314 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:42.568314 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:42.568314 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:42.568314 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:42.568314 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:42.568314 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:42.568314 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:42.569487 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:42.569487 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:42.569487 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:42.569487 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:42.569487 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:42.569487 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:42.569487 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:42.569487 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:42.569487 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:42.569487 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:42.569487 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:42.569487 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:42.569487 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:42.569487 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:42.569487 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:42.569487 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:42.570397 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:42.570397 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:42.570397 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:42.570397 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:42.570397 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:42.570397 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:42.570397 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:42.570397 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:42.570397 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:42.570397 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:42.570397 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:35:42.570397 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:35:42.570397 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 189/392] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 5 20:35:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:35:42.576072 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ddd71-5c17-473f-9f30-05c82f0e516a None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:42.594336 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb1942-c16b-4801-a52f-46ce2f96c4ee None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:42.683188 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:42.744116 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb1942-c16b-4801-a52f-46ce2f96c4ee None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:42.749323 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ddd71-5c17-473f-9f30-05c82f0e516a None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:42.777206 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:42.791130 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9431141-af08-4a5a-b877-88b93fc92ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:42.791968 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9431141-af08-4a5a-b877-88b93fc92ec7 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:42.792228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9431141-af08-4a5a-b877-88b93fc92ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:42.792502 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9431141-af08-4a5a-b877-88b93fc92ec7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:42.793643 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76d58f-4576-4724-93bf-9e477cb96894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:42.794901 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76d58f-4576-4724-93bf-9e477cb96894 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:42.795672 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76d58f-4576-4724-93bf-9e477cb96894 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:42.796147 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76d58f-4576-4724-93bf-9e477cb96894 None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:42.797093 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76d58f-4576-4724-93bf-9e477cb96894 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:42.797591 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76d58f-4576-4724-93bf-9e477cb96894 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:42.799226 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76d58f-4576-4724-93bf-9e477cb96894 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:42.816775 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 204/393] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:35:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:42.817927 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9431141-af08-4a5a-b877-88b93fc92ec7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:42.827380 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-b9431141-af08-4a5a-b877-88b93fc92ec7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:35:42.827380 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:42.827380 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:42.827380 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:42.827380 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:42.827380 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:42.827380 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:42.827380 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:42.827380 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:42.827380 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:42.827380 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:42.827380 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:42.827380 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:42.827380 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:42.827380 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:42.827380 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:42.828241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:42.828241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:42.828241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:42.828241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:42.828241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:42.828241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:42.828241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:42.828241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:42.828241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:42.828241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:42.828241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:42.828241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:42.828241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:42.828241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:42.828241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:42.828241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:42.829068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:42.829068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:42.829068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:42.829068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:42.829068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:42.829068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:42.829068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:42.829068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:42.829068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:42.829068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:42.829068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:35:42.829068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:35:42.832769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76d58f-4576-4724-93bf-9e477cb96894 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:42.842630 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 190/394] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:35:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:35:42.849330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9431141-af08-4a5a-b877-88b93fc92ec7 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:43.018129 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9431141-af08-4a5a-b877-88b93fc92ec7 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:43.024946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76d58f-4576-4724-93bf-9e477cb96894 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:43.033180 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:43.058112 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c226ad-2938-42de-8faa-d81c02e837bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:43.059236 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c226ad-2938-42de-8faa-d81c02e837bc None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:43.059728 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c226ad-2938-42de-8faa-d81c02e837bc None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:43.060295 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c226ad-2938-42de-8faa-d81c02e837bc None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:43.061338 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c226ad-2938-42de-8faa-d81c02e837bc None admin] RBAC: Adding query filter params (name=member) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:43.061901 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c226ad-2938-42de-8faa-d81c02e837bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:43.063548 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c226ad-2938-42de-8faa-d81c02e837bc None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:43.074772 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 191/395] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 5 20:35:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:35:43.082333 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6278a9b-34a9-4f20-909a-208e7917af5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:43.082986 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6278a9b-34a9-4f20-909a-208e7917af5a None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:43.083266 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6278a9b-34a9-4f20-909a-208e7917af5a None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:43.083537 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6278a9b-34a9-4f20-909a-208e7917af5a None admin] PATH_INFO: `/v3/groups/1eea90a3713c4b468b2256b7d87be5d5` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:43.084583 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c226ad-2938-42de-8faa-d81c02e837bc None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:43.084785 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6278a9b-34a9-4f20-909a-208e7917af5a None admin] RBAC: Authorizing `identity:get_group(group_id=1eea90a3713c4b468b2256b7d87be5d5)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:43.087892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6278a9b-34a9-4f20-909a-208e7917af5a None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:43.088364 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 205/396] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Jul 5 20:35:42 2022] GET /identity/v3/groups/1eea90a3713c4b468b2256b7d87be5d5 => generated 226 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:43.089747 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c001a-6095-4d9f-99ec-314d0b87f126 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:43.090056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c001a-6095-4d9f-99ec-314d0b87f126 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:43.090335 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c001a-6095-4d9f-99ec-314d0b87f126 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:43.091640 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 206/397] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:43.098786 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c001a-6095-4d9f-99ec-314d0b87f126 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:43.167186 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:43.203863 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c226ad-2938-42de-8faa-d81c02e837bc None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:43.230885 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c001a-6095-4d9f-99ec-314d0b87f126 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:43.241913 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44374cf8-62fe-4c1b-99e2-b5d9fbb6b3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:43.243135 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44374cf8-62fe-4c1b-99e2-b5d9fbb6b3c4 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:43.243595 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44374cf8-62fe-4c1b-99e2-b5d9fbb6b3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:43.244125 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44374cf8-62fe-4c1b-99e2-b5d9fbb6b3c4 None admin] PATH_INFO: `/v3/groups/1eea90a3713c4b468b2256b7d87be5d5` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:43.245468 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44374cf8-62fe-4c1b-99e2-b5d9fbb6b3c4 None admin] RBAC: Authorizing `identity:get_group(group_id=1eea90a3713c4b468b2256b7d87be5d5)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:43.247239 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44374cf8-62fe-4c1b-99e2-b5d9fbb6b3c4 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:43.249522 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 192/398] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Jul 5 20:35:43 2022] GET /identity/v3/groups/1eea90a3713c4b468b2256b7d87be5d5 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:43.250967 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefdef8-bfa9-4b90-9ed1-d21f5e78779d None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:43.251530 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefdef8-bfa9-4b90-9ed1-d21f5e78779d None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:43.251976 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefdef8-bfa9-4b90-9ed1-d21f5e78779d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:43.269025 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-3aefdef8-bfa9-4b90-9ed1-d21f5e78779d None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:43.270461 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-3aefdef8-bfa9-4b90-9ed1-d21f5e78779d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:43.270750 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81061727-8357-445c-aae3-a4b6d2b5444e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:43.271691 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81061727-8357-445c-aae3-a4b6d2b5444e None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:43.272036 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81061727-8357-445c-aae3-a4b6d2b5444e None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:43.272380 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81061727-8357-445c-aae3-a4b6d2b5444e None admin] PATH_INFO: `/v3/projects/49b18126ef0a46788f631cd665c36e57` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:43.273939 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81061727-8357-445c-aae3-a4b6d2b5444e None admin] RBAC: Authorizing `identity:get_project(project_id=49b18126ef0a46788f631cd665c36e57)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:43.277377 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81061727-8357-445c-aae3-a4b6d2b5444e None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:43.281908 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 207/399] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:43 2022] GET /identity/v3/projects/49b18126ef0a46788f631cd665c36e57 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:43.282905 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81061727-8357-445c-aae3-a4b6d2b5444e None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:43.320099 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:43.363570 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 193/400] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:43.364805 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aefdef8-bfa9-4b90-9ed1-d21f5e78779d None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:43.412732 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81061727-8357-445c-aae3-a4b6d2b5444e None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:43.438639 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:43.453621 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f016c4-d235-441e-a829-25e693d43f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:43.455053 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f016c4-d235-441e-a829-25e693d43f52 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:43.455654 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f016c4-d235-441e-a829-25e693d43f52 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:43.456126 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f016c4-d235-441e-a829-25e693d43f52 None admin] PATH_INFO: `/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:43.457648 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f016c4-d235-441e-a829-25e693d43f52 None admin] RBAC: Authorizing `identity:get_project(project_id=2ceac2e500814d1f9e4b6160e2b6b2bb)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:43.459863 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f016c4-d235-441e-a829-25e693d43f52 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:43.461901 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 208/401] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:43 2022] GET /identity/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:43.462962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f016c4-d235-441e-a829-25e693d43f52 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:43.486060 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aefdef8-bfa9-4b90-9ed1-d21f5e78779d None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:43.521406 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b03a1-a430-40c9-a1ed-2a22208c0ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:43.522365 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b03a1-a430-40c9-a1ed-2a22208c0ba5 None admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:43.522626 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b03a1-a430-40c9-a1ed-2a22208c0ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:43.522898 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b03a1-a430-40c9-a1ed-2a22208c0ba5 None admin] PATH_INFO: `/v3/projects/49b18126ef0a46788f631cd665c36e57/groups/1eea90a3713c4b468b2256b7d87be5d5/roles/c403525d65944d2187540a6d893b91e7` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:43.525159 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b03a1-a430-40c9-a1ed-2a22208c0ba5 None admin] RBAC: Authorizing `identity:create_grant(project_id=49b18126ef0a46788f631cd665c36e57, group_id=1eea90a3713c4b468b2256b7d87be5d5, role_id=c403525d65944d2187540a6d893b91e7)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:43.526637 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b03a1-a430-40c9-a1ed-2a22208c0ba5 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:43.542548 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 194/402] 10.222.0.27 () {58 vars in 1442 bytes} [Tue Jul 5 20:35:43 2022] PUT /identity/v3/projects/49b18126ef0a46788f631cd665c36e57/groups/1eea90a3713c4b468b2256b7d87be5d5/roles/c403525d65944d2187540a6d893b91e7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:35:43.543344 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b03a1-a430-40c9-a1ed-2a22208c0ba5 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:43.574127 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f016c4-d235-441e-a829-25e693d43f52 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:43.595064 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:43.617308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed6fe7-37c3-429c-a350-72ac53501086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:43.618614 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed6fe7-37c3-429c-a350-72ac53501086 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:43.619115 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed6fe7-37c3-429c-a350-72ac53501086 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:43.619604 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed6fe7-37c3-429c-a350-72ac53501086 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:43.631912 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed6fe7-37c3-429c-a350-72ac53501086 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:43.642900 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-44ed6fe7-37c3-429c-a350-72ac53501086 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:35:43.642900 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:43.642900 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:43.642900 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:43.642900 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:43.642900 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:43.642900 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:43.642900 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:43.642900 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:43.642900 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:43.642900 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:43.642900 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:43.642900 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:43.642900 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:43.642900 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:43.642900 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:43.644130 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:43.644130 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:43.644130 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:43.644130 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:43.644130 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:43.644130 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:43.644130 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:43.644130 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:43.644130 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:43.644130 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:43.644130 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:43.644130 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:43.644130 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:43.644130 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:43.644130 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:43.644130 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:43.645128 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:43.645128 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:43.645128 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:43.645128 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:43.645128 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:43.645128 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:43.645128 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:43.645128 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:43.645128 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:43.645128 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:43.645128 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:35:43.645128 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:43.647171 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 209/403] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 5 20:35:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:43.648361 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c47d70-71e4-4d32-b5e9-619cf0604fb7 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:43.648709 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c47d70-71e4-4d32-b5e9-619cf0604fb7 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:43.649067 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c47d70-71e4-4d32-b5e9-619cf0604fb7 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:43.654534 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 210/404] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:43.654534 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c47d70-71e4-4d32-b5e9-619cf0604fb7 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:43.703357 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b03a1-a430-40c9-a1ed-2a22208c0ba5 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:43.714718 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:43.753209 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e4b7e-6ef3-45b6-8e9c-a4b67cbc2689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:43.754245 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e4b7e-6ef3-45b6-8e9c-a4b67cbc2689 None admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:43.754588 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e4b7e-6ef3-45b6-8e9c-a4b67cbc2689 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:43.754926 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e4b7e-6ef3-45b6-8e9c-a4b67cbc2689 None admin] PATH_INFO: `/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb/groups/1eea90a3713c4b468b2256b7d87be5d5/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:43.757411 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e4b7e-6ef3-45b6-8e9c-a4b67cbc2689 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ceac2e500814d1f9e4b6160e2b6b2bb, group_id=1eea90a3713c4b468b2256b7d87be5d5, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:43.758915 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e4b7e-6ef3-45b6-8e9c-a4b67cbc2689 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:43.776129 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 195/405] 10.222.0.27 () {58 vars in 1442 bytes} [Tue Jul 5 20:35:43 2022] PUT /identity/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb/groups/1eea90a3713c4b468b2256b7d87be5d5/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:35:43.777413 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb81a0-be82-4009-af87-d4a506ae131b None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:43.777520 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c47d70-71e4-4d32-b5e9-619cf0604fb7 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:43.777969 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb81a0-be82-4009-af87-d4a506ae131b None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:43.777969 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb81a0-be82-4009-af87-d4a506ae131b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:43.796582 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-88bb81a0-be82-4009-af87-d4a506ae131b None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:43.797879 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-88bb81a0-be82-4009-af87-d4a506ae131b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:43.830030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef80023-eeeb-4831-8cfe-e82b6e991267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:43.830721 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef80023-eeeb-4831-8cfe-e82b6e991267 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:43.830995 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef80023-eeeb-4831-8cfe-e82b6e991267 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:43.831263 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef80023-eeeb-4831-8cfe-e82b6e991267 None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:43.832032 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef80023-eeeb-4831-8cfe-e82b6e991267 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:43.832328 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef80023-eeeb-4831-8cfe-e82b6e991267 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:43.833777 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef80023-eeeb-4831-8cfe-e82b6e991267 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:43.844056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 211/406] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:35:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:43.855916 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef80023-eeeb-4831-8cfe-e82b6e991267 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:43.897976 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 196/407] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:43.920178 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb81a0-be82-4009-af87-d4a506ae131b None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:43.946075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:44.026342 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef80023-eeeb-4831-8cfe-e82b6e991267 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:44.047779 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb81a0-be82-4009-af87-d4a506ae131b None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:44.067740 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f68be-e9b9-4f63-8e25-1f813dad26ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:44.068986 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f68be-e9b9-4f63-8e25-1f813dad26ef None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:44.069874 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f68be-e9b9-4f63-8e25-1f813dad26ef None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:44.070380 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f68be-e9b9-4f63-8e25-1f813dad26ef None admin] PATH_INFO: `/v3/groups/1eea90a3713c4b468b2256b7d87be5d5` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:44.072115 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f68be-e9b9-4f63-8e25-1f813dad26ef None admin] RBAC: Authorizing `identity:get_group(group_id=1eea90a3713c4b468b2256b7d87be5d5)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:44.078025 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:44.082123 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f68be-e9b9-4f63-8e25-1f813dad26ef None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:44.084676 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 212/408] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Jul 5 20:35:43 2022] GET /identity/v3/groups/1eea90a3713c4b468b2256b7d87be5d5 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:44.096971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f68be-e9b9-4f63-8e25-1f813dad26ef None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:44.106596 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5e2dc-0b7d-4a07-8613-aca692e0d78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:44.107491 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5e2dc-0b7d-4a07-8613-aca692e0d78f None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:44.107772 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5e2dc-0b7d-4a07-8613-aca692e0d78f None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:44.108049 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5e2dc-0b7d-4a07-8613-aca692e0d78f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:44.136339 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5e2dc-0b7d-4a07-8613-aca692e0d78f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:44.152078 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-46a5e2dc-0b7d-4a07-8613-aca692e0d78f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:35:44.152078 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:44.152078 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:44.152078 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:44.152078 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:44.152078 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:44.152078 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:44.152078 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:44.152078 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:44.152078 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:44.152078 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:44.152078 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:44.152078 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:44.152078 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:44.152078 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:44.152078 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:44.152987 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:44.152987 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:44.152987 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:44.152987 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:44.152987 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:44.152987 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:44.152987 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:44.152987 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:44.152987 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:44.152987 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:44.152987 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:44.152987 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:44.152987 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:44.152987 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:44.152987 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:44.152987 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:44.158729 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:44.158729 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:44.158729 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:44.158729 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:44.158729 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:44.158729 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:44.158729 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:44.158729 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:44.158729 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:44.158729 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:44.158729 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:35:44.158729 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:35:44.158729 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 197/409] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 5 20:35:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:44.161329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5e2dc-0b7d-4a07-8613-aca692e0d78f None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:44.279947 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f68be-e9b9-4f63-8e25-1f813dad26ef None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:44.294989 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:44.307559 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5e2dc-0b7d-4a07-8613-aca692e0d78f None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:44.342797 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210f7b9-1cc4-4e5e-b77e-d5dfbe615967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:44.343502 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210f7b9-1cc4-4e5e-b77e-d5dfbe615967 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:44.343765 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210f7b9-1cc4-4e5e-b77e-d5dfbe615967 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:44.344044 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210f7b9-1cc4-4e5e-b77e-d5dfbe615967 None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:44.344806 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210f7b9-1cc4-4e5e-b77e-d5dfbe615967 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:44.345118 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210f7b9-1cc4-4e5e-b77e-d5dfbe615967 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:44.346560 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210f7b9-1cc4-4e5e-b77e-d5dfbe615967 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:44.356021 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 198/410] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:35:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:44.362592 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210f7b9-1cc4-4e5e-b77e-d5dfbe615967 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:44.379606 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3b059-0645-4056-a155-d4df96a6e03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:44.380492 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3b059-0645-4056-a155-d4df96a6e03f None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:44.380772 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3b059-0645-4056-a155-d4df96a6e03f None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:44.381046 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3b059-0645-4056-a155-d4df96a6e03f None admin] PATH_INFO: `/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:44.382383 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3b059-0645-4056-a155-d4df96a6e03f None admin] RBAC: Authorizing `identity:get_project(project_id=2ceac2e500814d1f9e4b6160e2b6b2bb)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:44.384053 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3b059-0645-4056-a155-d4df96a6e03f None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:44.385892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 213/411] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:44 2022] GET /identity/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb => generated 302 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:44.391629 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3b059-0645-4056-a155-d4df96a6e03f None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:44.472281 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210f7b9-1cc4-4e5e-b77e-d5dfbe615967 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:44.507709 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55719f3-683f-420d-81f9-0187d6172006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:44.508588 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55719f3-683f-420d-81f9-0187d6172006 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:44.508868 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55719f3-683f-420d-81f9-0187d6172006 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:44.509146 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55719f3-683f-420d-81f9-0187d6172006 None admin] PATH_INFO: `/v3/groups/09bdc2faea2941469614ebb972e8373e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:44.510370 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55719f3-683f-420d-81f9-0187d6172006 None admin] RBAC: Authorizing `identity:get_group(group_id=09bdc2faea2941469614ebb972e8373e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:44.511855 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55719f3-683f-420d-81f9-0187d6172006 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:44.513860 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 199/412] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Jul 5 20:35:44 2022] GET /identity/v3/groups/09bdc2faea2941469614ebb972e8373e => generated 229 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:35:44.522622 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55719f3-683f-420d-81f9-0187d6172006 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:44.535440 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:44.552812 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:44.653365 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3b059-0645-4056-a155-d4df96a6e03f None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:44.664735 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55719f3-683f-420d-81f9-0187d6172006 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:44.702796 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ad0ee-46f2-46cd-be7d-7ec272ff6c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:44.703976 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ad0ee-46f2-46cd-be7d-7ec272ff6c3e None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:44.704258 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ad0ee-46f2-46cd-be7d-7ec272ff6c3e None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:44.704530 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ad0ee-46f2-46cd-be7d-7ec272ff6c3e None admin] PATH_INFO: `/v3/projects/d2d267a59c9249019ee131b3dae58a6e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:44.705739 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235ad0ee-46f2-46cd-be7d-7ec272ff6c3e None admin] RBAC: Authorizing `identity:get_project(project_id=d2d267a59c9249019ee131b3dae58a6e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:44.707251 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235ad0ee-46f2-46cd-be7d-7ec272ff6c3e None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:44.709731 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 200/413] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:44 2022] GET /identity/v3/projects/d2d267a59c9249019ee131b3dae58a6e => generated 344 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:35:44.717947 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ad0ee-46f2-46cd-be7d-7ec272ff6c3e None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:44.741178 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258fa2e-3584-406f-b56b-f9264a75ef2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:44.742335 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258fa2e-3584-406f-b56b-f9264a75ef2e None admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:44.742774 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258fa2e-3584-406f-b56b-f9264a75ef2e None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:44.743178 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258fa2e-3584-406f-b56b-f9264a75ef2e None admin] PATH_INFO: `/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb/groups/1eea90a3713c4b468b2256b7d87be5d5/roles/c403525d65944d2187540a6d893b91e7` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:44.747810 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e258fa2e-3584-406f-b56b-f9264a75ef2e None admin] RBAC: Authorizing `identity:create_grant(project_id=2ceac2e500814d1f9e4b6160e2b6b2bb, group_id=1eea90a3713c4b468b2256b7d87be5d5, role_id=c403525d65944d2187540a6d893b91e7)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:44.749406 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e258fa2e-3584-406f-b56b-f9264a75ef2e None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:44.771568 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 214/414] 10.222.0.27 () {58 vars in 1442 bytes} [Tue Jul 5 20:35:44 2022] PUT /identity/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb/groups/1eea90a3713c4b468b2256b7d87be5d5/roles/c403525d65944d2187540a6d893b91e7 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:35:44.835378 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:44.863464 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ad0ee-46f2-46cd-be7d-7ec272ff6c3e None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:44.918662 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45797064-da5d-4837-be90-9e45960e0709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:44.919967 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45797064-da5d-4837-be90-9e45960e0709 None admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:44.920477 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45797064-da5d-4837-be90-9e45960e0709 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:44.920904 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45797064-da5d-4837-be90-9e45960e0709 None admin] PATH_INFO: `/v3/projects/d2d267a59c9249019ee131b3dae58a6e/groups/09bdc2faea2941469614ebb972e8373e/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:44.923508 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45797064-da5d-4837-be90-9e45960e0709 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2d267a59c9249019ee131b3dae58a6e, group_id=09bdc2faea2941469614ebb972e8373e, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:44.925205 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45797064-da5d-4837-be90-9e45960e0709 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:44.948737 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 201/415] 10.222.0.27 () {58 vars in 1442 bytes} [Tue Jul 5 20:35:44 2022] PUT /identity/v3/projects/d2d267a59c9249019ee131b3dae58a6e/groups/09bdc2faea2941469614ebb972e8373e/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:35:44.963963 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66294c5-12dc-422d-a51d-9fb2f13dd30e None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:44.964871 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66294c5-12dc-422d-a51d-9fb2f13dd30e None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:44.965293 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66294c5-12dc-422d-a51d-9fb2f13dd30e None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:44.966893 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 215/416] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:35:44.972972 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5c91d-b1be-46c8-8804-e62cf3d3e3aa None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:44.973467 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5c91d-b1be-46c8-8804-e62cf3d3e3aa None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:44.974002 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5c91d-b1be-46c8-8804-e62cf3d3e3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:44.998412 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-1ad5c91d-b1be-46c8-8804-e62cf3d3e3aa None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:44.999861 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-1ad5c91d-b1be-46c8-8804-e62cf3d3e3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:45.074581 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 202/417] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:35:45.098653 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66294c5-12dc-422d-a51d-9fb2f13dd30e None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:45.217995 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66294c5-12dc-422d-a51d-9fb2f13dd30e None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:45.229159 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:45.254251 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b9bbd-bae3-49f4-addf-fe1b13a4039d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:45.255353 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b9bbd-bae3-49f4-addf-fe1b13a4039d None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:45.255644 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b9bbd-bae3-49f4-addf-fe1b13a4039d None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:45.256415 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b9bbd-bae3-49f4-addf-fe1b13a4039d None admin] PATH_INFO: `/v3/roles/member` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:45.268730 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b9bbd-bae3-49f4-addf-fe1b13a4039d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:45.276443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-244b9bbd-bae3-49f4-addf-fe1b13a4039d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:35:45.276443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:45.276443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:45.276443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:45.276443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:45.276443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:45.276443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:45.276443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:45.276443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:45.276443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:45.276443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:45.276443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:45.276443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:45.276443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:45.276443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:45.276443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:45.277321 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:45.277321 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:45.277321 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:45.277321 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:45.277321 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:45.277321 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:45.277321 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:45.277321 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:45.277321 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:45.277321 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:45.277321 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:45.277321 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:45.277321 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:45.277321 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:45.277321 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:45.277321 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:45.278149 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:45.278149 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:45.278149 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:45.278149 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:45.278149 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:45.278149 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:45.278149 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:45.278149 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:45.278149 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:45.278149 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:45.278149 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:35:45.278149 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:45.278149 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 216/418] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:35:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:45.284214 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5c91d-b1be-46c8-8804-e62cf3d3e3aa None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:45.380746 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:45.412456 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5c91d-b1be-46c8-8804-e62cf3d3e3aa None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:45.445963 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c163325-0bbf-4cf3-89a8-76d935586d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:45.446636 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c163325-0bbf-4cf3-89a8-76d935586d08 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:45.446916 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c163325-0bbf-4cf3-89a8-76d935586d08 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:45.447180 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c163325-0bbf-4cf3-89a8-76d935586d08 None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:45.447926 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c163325-0bbf-4cf3-89a8-76d935586d08 None admin] RBAC: Adding query filter params (name=member) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:45.448228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c163325-0bbf-4cf3-89a8-76d935586d08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:45.449670 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c163325-0bbf-4cf3-89a8-76d935586d08 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:45.458565 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 203/419] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 5 20:35:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:45.467344 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b9bbd-bae3-49f4-addf-fe1b13a4039d None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:45.586988 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b9bbd-bae3-49f4-addf-fe1b13a4039d None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:45.620889 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8befa3ca-0976-4bf0-aad0-584d8e58b739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:45.621540 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befa3ca-0976-4bf0-aad0-584d8e58b739 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:45.621818 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befa3ca-0976-4bf0-aad0-584d8e58b739 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:45.622114 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8befa3ca-0976-4bf0-aad0-584d8e58b739 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:45.670515 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:45.709348 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8befa3ca-0976-4bf0-aad0-584d8e58b739 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:45.710851 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8befa3ca-0976-4bf0-aad0-584d8e58b739 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:45.859229 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 217/420] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:35:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:35:45.865926 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c163325-0bbf-4cf3-89a8-76d935586d08 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:46.017713 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c163325-0bbf-4cf3-89a8-76d935586d08 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:46.021737 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794b0f8-ba50-4558-b660-413fa254b76f None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:46.022617 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794b0f8-ba50-4558-b660-413fa254b76f None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:46.023089 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794b0f8-ba50-4558-b660-413fa254b76f None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:46.024947 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 218/421] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:46.030555 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41b7cd-677a-4576-9cfc-c269827297d7 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:46.030837 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41b7cd-677a-4576-9cfc-c269827297d7 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:46.031118 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41b7cd-677a-4576-9cfc-c269827297d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:46.051014 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-7b41b7cd-677a-4576-9cfc-c269827297d7 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:46.052222 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-7b41b7cd-677a-4576-9cfc-c269827297d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:46.080676 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a5a63-ed5f-4871-b406-5e4a06c21c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:46.081559 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a5a63-ed5f-4871-b406-5e4a06c21c3b None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:46.081859 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a5a63-ed5f-4871-b406-5e4a06c21c3b None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:46.082147 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a5a63-ed5f-4871-b406-5e4a06c21c3b None admin] PATH_INFO: `/v3/projects/49b18126ef0a46788f631cd665c36e57` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:46.083348 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a5a63-ed5f-4871-b406-5e4a06c21c3b None admin] RBAC: Authorizing `identity:get_project(project_id=49b18126ef0a46788f631cd665c36e57)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:46.085146 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a5a63-ed5f-4871-b406-5e4a06c21c3b None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:46.087237 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 204/422] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:45 2022] GET /identity/v3/projects/49b18126ef0a46788f631cd665c36e57 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:46.087674 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:46.094981 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a5a63-ed5f-4871-b406-5e4a06c21c3b None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:46.142313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:46.152091 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 219/423] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:35:46.201878 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41b7cd-677a-4576-9cfc-c269827297d7 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:46.241820 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a5a63-ed5f-4871-b406-5e4a06c21c3b None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:46.277482 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4edea1-9c67-4780-83b0-b4c8c5e8689e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:46.278680 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4edea1-9c67-4780-83b0-b4c8c5e8689e None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:46.279213 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4edea1-9c67-4780-83b0-b4c8c5e8689e None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:46.279658 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4edea1-9c67-4780-83b0-b4c8c5e8689e None admin] PATH_INFO: `/v3/groups/1eea90a3713c4b468b2256b7d87be5d5` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:46.281017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4edea1-9c67-4780-83b0-b4c8c5e8689e None admin] RBAC: Authorizing `identity:get_group(group_id=1eea90a3713c4b468b2256b7d87be5d5)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:46.282674 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4edea1-9c67-4780-83b0-b4c8c5e8689e None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:46.284935 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 205/424] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Jul 5 20:35:46 2022] GET /identity/v3/groups/1eea90a3713c4b468b2256b7d87be5d5 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:46.291119 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4edea1-9c67-4780-83b0-b4c8c5e8689e None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:46.370652 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41b7cd-677a-4576-9cfc-c269827297d7 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:46.415065 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:46.436280 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4299b-b136-41a8-917e-7d40f6504eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:46.437109 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4299b-b136-41a8-917e-7d40f6504eea None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:46.437387 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4299b-b136-41a8-917e-7d40f6504eea None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:46.437661 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4299b-b136-41a8-917e-7d40f6504eea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:46.458767 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4299b-b136-41a8-917e-7d40f6504eea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:46.466946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-74a4299b-b136-41a8-917e-7d40f6504eea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:35:46.466946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:46.466946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:46.466946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:46.466946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:46.466946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:46.466946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:46.466946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:46.466946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:46.466946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:46.466946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:46.466946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:46.466946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:46.466946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:46.466946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:46.466946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:46.467877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:46.467877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:46.467877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:46.467877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:46.467877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:46.467877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:46.467877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:46.467877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:46.467877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:46.467877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:46.467877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:46.467877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:46.467877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:46.467877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:46.467877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:46.467877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:46.468679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:46.468679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:46.468679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:46.468679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:46.468679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:46.468679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:46.468679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:46.468679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:46.468679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:46.468679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:46.468679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:35:46.468679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:46.468679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 220/425] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 5 20:35:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:46.477606 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4299b-b136-41a8-917e-7d40f6504eea None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:46.484895 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4edea1-9c67-4780-83b0-b4c8c5e8689e None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:46.522178 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66753bd8-f42c-41b9-89c2-64e6a42e976a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:46.523105 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66753bd8-f42c-41b9-89c2-64e6a42e976a None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:46.524270 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66753bd8-f42c-41b9-89c2-64e6a42e976a None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:46.524557 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66753bd8-f42c-41b9-89c2-64e6a42e976a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:46.525412 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66753bd8-f42c-41b9-89c2-64e6a42e976a None admin] RBAC: Adding query filter params (group.id=1eea90a3713c4b468b2256b7d87be5d5, role.id=8dc2563a47c540cfa548eb210d02066e, scope.project.id=49b18126ef0a46788f631cd665c36e57) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:46.525736 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66753bd8-f42c-41b9-89c2-64e6a42e976a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:46.527222 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66753bd8-f42c-41b9-89c2-64e6a42e976a None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:46.535968 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 206/426] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Jul 5 20:35:46 2022] GET /identity/v3/role_assignments?group.id=1eea90a3713c4b468b2256b7d87be5d5&scope.project.id=49b18126ef0a46788f631cd665c36e57&role.id=8dc2563a47c540cfa548eb210d02066e => generated 611 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:46.537237 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83990eb8-0e4a-4374-ab6b-e431310d352c None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:46.537521 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83990eb8-0e4a-4374-ab6b-e431310d352c None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:46.537798 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83990eb8-0e4a-4374-ab6b-e431310d352c None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:46.539366 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 207/427] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:46.548420 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf8590-8c37-44b8-bca5-5dabc8c7febd None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:46.548711 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf8590-8c37-44b8-bca5-5dabc8c7febd None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:46.549129 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf8590-8c37-44b8-bca5-5dabc8c7febd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:46.568978 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-ecbf8590-8c37-44b8-bca5-5dabc8c7febd None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:46.570364 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-ecbf8590-8c37-44b8-bca5-5dabc8c7febd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:46.579554 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:46.662813 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4299b-b136-41a8-917e-7d40f6504eea None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:46.695409 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 208/428] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:46.724056 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf8590-8c37-44b8-bca5-5dabc8c7febd None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:46.726732 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8442033-242d-44f5-a2cb-202ffcc87d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:46.727404 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8442033-242d-44f5-a2cb-202ffcc87d7f None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:46.727679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8442033-242d-44f5-a2cb-202ffcc87d7f None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:46.727948 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8442033-242d-44f5-a2cb-202ffcc87d7f None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:46.728696 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8442033-242d-44f5-a2cb-202ffcc87d7f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:46.729005 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8442033-242d-44f5-a2cb-202ffcc87d7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:46.730432 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8442033-242d-44f5-a2cb-202ffcc87d7f None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:46.743754 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 221/429] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:35:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:35:46.749095 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8442033-242d-44f5-a2cb-202ffcc87d7f None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:46.805557 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:46.855757 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf8590-8c37-44b8-bca5-5dabc8c7febd None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:46.870359 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8442033-242d-44f5-a2cb-202ffcc87d7f None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:46.896286 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13e616-158e-4d81-95d7-095ecf5b3edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:46.897190 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13e616-158e-4d81-95d7-095ecf5b3edd None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:46.897664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:46.898068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13e616-158e-4d81-95d7-095ecf5b3edd None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:46.899168 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13e616-158e-4d81-95d7-095ecf5b3edd None admin] PATH_INFO: `/v3/roles/member` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:46.909955 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed816c3-9698-4d55-88d0-e03482b0d481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:46.911677 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed816c3-9698-4d55-88d0-e03482b0d481 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:46.911875 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed816c3-9698-4d55-88d0-e03482b0d481 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:46.912155 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed816c3-9698-4d55-88d0-e03482b0d481 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:46.915284 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13e616-158e-4d81-95d7-095ecf5b3edd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:46.929117 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-cb13e616-158e-4d81-95d7-095ecf5b3edd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:35:46.929117 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:46.929117 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:46.929117 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:46.929117 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:46.929117 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:46.929117 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:46.929117 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:46.929117 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:46.929117 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:46.929117 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:46.929117 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:46.929117 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:46.929117 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:46.929117 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:46.929117 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:46.930062 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:46.930062 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:46.930062 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:46.930062 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:46.930062 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:46.930062 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:46.930062 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:46.930062 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:46.930062 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:46.930062 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:46.930062 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:46.930062 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:46.930062 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:46.930062 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:46.930062 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:46.930062 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:46.930854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:46.930854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:46.930854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:46.930854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:46.930854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:46.930854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:46.930854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:46.930854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:46.930854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:46.930854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:46.930854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 05 20:35:46.930854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:35:46.933800 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 209/430] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:35:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:46.944520 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13e616-158e-4d81-95d7-095ecf5b3edd None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:47.000575 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed816c3-9698-4d55-88d0-e03482b0d481 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:47.002367 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed816c3-9698-4d55-88d0-e03482b0d481 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:47.100849 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13e616-158e-4d81-95d7-095ecf5b3edd None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:47.130649 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:47.139343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 222/431] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:35:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 20:35:47.147047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed816c3-9698-4d55-88d0-e03482b0d481 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:47.156612 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086591a3-1904-4ab2-a104-a2b0c98a279b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:47.157306 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086591a3-1904-4ab2-a104-a2b0c98a279b None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:47.157590 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086591a3-1904-4ab2-a104-a2b0c98a279b None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:47.157922 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086591a3-1904-4ab2-a104-a2b0c98a279b None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:47.158696 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086591a3-1904-4ab2-a104-a2b0c98a279b None admin] RBAC: Adding query filter params (name=member) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:47.159002 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086591a3-1904-4ab2-a104-a2b0c98a279b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:47.160412 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086591a3-1904-4ab2-a104-a2b0c98a279b None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:47.173722 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 210/432] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 5 20:35:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:47.175113 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:47.179817 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086591a3-1904-4ab2-a104-a2b0c98a279b None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:47.277995 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed816c3-9698-4d55-88d0-e03482b0d481 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:47.298726 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086591a3-1904-4ab2-a104-a2b0c98a279b None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:47.318346 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ceaa8-f3cf-47b4-8713-9ee279364e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:47.319318 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ceaa8-f3cf-47b4-8713-9ee279364e71 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:47.319595 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ceaa8-f3cf-47b4-8713-9ee279364e71 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:47.319864 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ceaa8-f3cf-47b4-8713-9ee279364e71 None admin] PATH_INFO: `/v3/projects/49b18126ef0a46788f631cd665c36e57` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:47.323039 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ceaa8-f3cf-47b4-8713-9ee279364e71 None admin] RBAC: Authorizing `identity:get_project(project_id=49b18126ef0a46788f631cd665c36e57)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:47.324633 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ceaa8-f3cf-47b4-8713-9ee279364e71 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:47.326946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 223/433] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:47 2022] GET /identity/v3/projects/49b18126ef0a46788f631cd665c36e57 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:47.332298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ceaa8-f3cf-47b4-8713-9ee279364e71 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:47.343707 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84b800-ca6d-43b6-97ea-696d3195e608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:47.344372 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84b800-ca6d-43b6-97ea-696d3195e608 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:47.344918 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84b800-ca6d-43b6-97ea-696d3195e608 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:47.345090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84b800-ca6d-43b6-97ea-696d3195e608 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:47.415337 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:47.435200 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e84b800-ca6d-43b6-97ea-696d3195e608 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:47.436681 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e84b800-ca6d-43b6-97ea-696d3195e608 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:47.464719 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:47.480991 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ceaa8-f3cf-47b4-8713-9ee279364e71 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:47.521505 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97747d8f-56b5-48c0-9ea3-c4336102b259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:47.522412 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97747d8f-56b5-48c0-9ea3-c4336102b259 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:47.522700 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97747d8f-56b5-48c0-9ea3-c4336102b259 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:47.522973 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97747d8f-56b5-48c0-9ea3-c4336102b259 None admin] PATH_INFO: `/v3/groups/1eea90a3713c4b468b2256b7d87be5d5` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:47.524178 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97747d8f-56b5-48c0-9ea3-c4336102b259 None admin] RBAC: Authorizing `identity:get_group(group_id=1eea90a3713c4b468b2256b7d87be5d5)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:47.525660 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97747d8f-56b5-48c0-9ea3-c4336102b259 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:47.527335 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 224/434] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Jul 5 20:35:47 2022] GET /identity/v3/groups/1eea90a3713c4b468b2256b7d87be5d5 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:47.528604 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91bf0f-cb47-4c16-99ff-019a91a4d242 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:47.528949 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91bf0f-cb47-4c16-99ff-019a91a4d242 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:47.529224 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb91bf0f-cb47-4c16-99ff-019a91a4d242 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:47.530587 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 225/435] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:47.531606 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1967e9-a012-44e7-95b7-da2a62e21a29 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:47.531831 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1967e9-a012-44e7-95b7-da2a62e21a29 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:47.532105 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1967e9-a012-44e7-95b7-da2a62e21a29 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:47.533402 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 226/436] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:47.534005 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1967e9-a012-44e7-95b7-da2a62e21a29 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:47.552775 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 211/437] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:35:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 20:35:47.552775 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce380ae-7b9c-4764-8f9b-3a07e112ef7f None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:47.552775 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce380ae-7b9c-4764-8f9b-3a07e112ef7f None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:47.552775 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce380ae-7b9c-4764-8f9b-3a07e112ef7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:47.566186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-1ce380ae-7b9c-4764-8f9b-3a07e112ef7f None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:47.567375 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-1ce380ae-7b9c-4764-8f9b-3a07e112ef7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:47.634332 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 212/438] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:47.634533 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1967e9-a012-44e7-95b7-da2a62e21a29 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:47.635598 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5055e8d-2df6-4883-88fa-3094a617120b None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:47.635885 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5055e8d-2df6-4883-88fa-3094a617120b None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:47.636157 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5055e8d-2df6-4883-88fa-3094a617120b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:47.651992 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-f5055e8d-2df6-4883-88fa-3094a617120b None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:47.653281 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-f5055e8d-2df6-4883-88fa-3094a617120b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:47.663021 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:47.681511 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b40429-58be-43c6-bd33-c2242c73bd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:47.682134 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b40429-58be-43c6-bd33-c2242c73bd84 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:47.682418 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b40429-58be-43c6-bd33-c2242c73bd84 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:47.682696 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b40429-58be-43c6-bd33-c2242c73bd84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:47.683535 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b40429-58be-43c6-bd33-c2242c73bd84 None admin] RBAC: Adding query filter params (group.id=1eea90a3713c4b468b2256b7d87be5d5, role.id=c403525d65944d2187540a6d893b91e7, scope.project.id=49b18126ef0a46788f631cd665c36e57) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:47.683848 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b40429-58be-43c6-bd33-c2242c73bd84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:47.685363 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b40429-58be-43c6-bd33-c2242c73bd84 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:47.691200 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 227/439] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Jul 5 20:35:47 2022] GET /identity/v3/role_assignments?group.id=1eea90a3713c4b468b2256b7d87be5d5&scope.project.id=49b18126ef0a46788f631cd665c36e57&role.id=c403525d65944d2187540a6d893b91e7 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:47.691977 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b40429-58be-43c6-bd33-c2242c73bd84 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:47.719930 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:47.737256 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 213/440] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:47.738003 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5055e8d-2df6-4883-88fa-3094a617120b None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:47.822134 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b40429-58be-43c6-bd33-c2242c73bd84 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:47.852860 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5055e8d-2df6-4883-88fa-3094a617120b None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:47.862627 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741d674-ed73-4bbe-af35-a6999a4ff40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:47.863490 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741d674-ed73-4bbe-af35-a6999a4ff40b None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:47.863799 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741d674-ed73-4bbe-af35-a6999a4ff40b None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:47.864070 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741d674-ed73-4bbe-af35-a6999a4ff40b None admin] PATH_INFO: `/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:47.865260 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1741d674-ed73-4bbe-af35-a6999a4ff40b None admin] RBAC: Authorizing `identity:get_project(project_id=2ceac2e500814d1f9e4b6160e2b6b2bb)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:47.866760 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1741d674-ed73-4bbe-af35-a6999a4ff40b None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:47.868672 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 228/441] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:47 2022] GET /identity/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:47.869466 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741d674-ed73-4bbe-af35-a6999a4ff40b None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:47.897064 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613afe4-89cd-49a5-b5ae-28f2770aa548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:47.897926 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613afe4-89cd-49a5-b5ae-28f2770aa548 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:47.898211 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613afe4-89cd-49a5-b5ae-28f2770aa548 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:47.898491 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613afe4-89cd-49a5-b5ae-28f2770aa548 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:47.910153 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613afe4-89cd-49a5-b5ae-28f2770aa548 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:47.919166 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-2613afe4-89cd-49a5-b5ae-28f2770aa548 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:35:47.919166 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:47.919166 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:47.919166 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:47.919166 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:47.919166 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:47.919166 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:47.919166 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:47.919166 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:47.919166 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:47.919166 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:47.919166 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:47.919166 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:47.919166 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:47.919166 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:47.919166 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:47.920144 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:47.920144 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:47.920144 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:47.920144 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:47.920144 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:47.920144 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:47.920144 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:47.920144 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:47.920144 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:47.920144 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:47.920144 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:47.920144 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:47.920144 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:47.920144 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:47.920144 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:47.920144 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:47.920941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:47.920941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:47.920941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:47.920941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:47.920941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:47.920941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:47.920941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:47.920941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:47.920941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:47.920941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:47.920941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:35:47.920941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:35:47.920941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 214/442] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 5 20:35:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:47.921631 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613afe4-89cd-49a5-b5ae-28f2770aa548 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:47.925759 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:47.977100 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:47.988800 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741d674-ed73-4bbe-af35-a6999a4ff40b None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:48.029057 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fb925-e622-4c6b-aa44-7c53b724f7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:48.030156 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fb925-e622-4c6b-aa44-7c53b724f7da None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:48.030156 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fb925-e622-4c6b-aa44-7c53b724f7da None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:48.030421 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fb925-e622-4c6b-aa44-7c53b724f7da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:48.039529 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613afe4-89cd-49a5-b5ae-28f2770aa548 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:48.043727 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80fb925-e622-4c6b-aa44-7c53b724f7da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:48.051988 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-f80fb925-e622-4c6b-aa44-7c53b724f7da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:35:48.051988 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:48.051988 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:48.051988 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:48.051988 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:48.051988 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:48.051988 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:48.051988 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:48.051988 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:48.051988 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:48.051988 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:48.051988 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:48.051988 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:48.051988 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:48.051988 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:48.051988 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:48.052881 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:48.052881 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:48.052881 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:48.052881 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:48.052881 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:48.052881 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:48.052881 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:48.052881 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:48.052881 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:48.052881 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:48.052881 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:48.052881 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:48.052881 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:48.052881 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:48.052881 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:48.052881 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:48.053706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:48.053706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:48.053706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:48.053706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:48.053706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:48.053706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:48.053706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:48.053706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:48.053706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:48.053706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:48.053706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:35:48.053706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:48.053706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 229/443] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 5 20:35:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:48.054820 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fb925-e622-4c6b-aa44-7c53b724f7da None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:48.080786 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10cf98c-ce35-4d1a-ad15-45ba8b2bb8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:48.081658 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10cf98c-ce35-4d1a-ad15-45ba8b2bb8ef None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:48.081982 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10cf98c-ce35-4d1a-ad15-45ba8b2bb8ef None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:48.082256 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10cf98c-ce35-4d1a-ad15-45ba8b2bb8ef None admin] PATH_INFO: `/v3/groups/1eea90a3713c4b468b2256b7d87be5d5` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:48.083465 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10cf98c-ce35-4d1a-ad15-45ba8b2bb8ef None admin] RBAC: Authorizing `identity:get_group(group_id=1eea90a3713c4b468b2256b7d87be5d5)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:48.084953 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10cf98c-ce35-4d1a-ad15-45ba8b2bb8ef None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:48.086783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 215/444] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Jul 5 20:35:47 2022] GET /identity/v3/groups/1eea90a3713c4b468b2256b7d87be5d5 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:48.087366 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10cf98c-ce35-4d1a-ad15-45ba8b2bb8ef None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:48.158443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fb925-e622-4c6b-aa44-7c53b724f7da None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:48.159253 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:48.189175 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10cf98c-ce35-4d1a-ad15-45ba8b2bb8ef None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:48.192270 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215d337-923e-4fa5-850b-18f9cf5cf1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:48.192929 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215d337-923e-4fa5-850b-18f9cf5cf1e9 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:48.193202 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215d337-923e-4fa5-850b-18f9cf5cf1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:48.193470 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215d337-923e-4fa5-850b-18f9cf5cf1e9 None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:48.194243 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215d337-923e-4fa5-850b-18f9cf5cf1e9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:48.194535 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215d337-923e-4fa5-850b-18f9cf5cf1e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:48.195910 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215d337-923e-4fa5-850b-18f9cf5cf1e9 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:48.203960 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 230/445] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:35:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:48.204727 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215d337-923e-4fa5-850b-18f9cf5cf1e9 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:48.219426 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:48.222576 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf0e73-f846-405c-ace2-9f9fcc293332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:48.223250 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf0e73-f846-405c-ace2-9f9fcc293332 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:48.223531 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf0e73-f846-405c-ace2-9f9fcc293332 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:48.223808 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf0e73-f846-405c-ace2-9f9fcc293332 None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:48.224538 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf0e73-f846-405c-ace2-9f9fcc293332 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:48.224863 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf0e73-f846-405c-ace2-9f9fcc293332 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:48.226285 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf0e73-f846-405c-ace2-9f9fcc293332 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:48.234513 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 216/446] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:35:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:48.235267 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf0e73-f846-405c-ace2-9f9fcc293332 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:48.309450 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215d337-923e-4fa5-850b-18f9cf5cf1e9 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:48.336947 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf0e73-f846-405c-ace2-9f9fcc293332 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:48.343350 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc61165-06fa-4c8b-88b4-74049400c4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:48.343996 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc61165-06fa-4c8b-88b4-74049400c4d9 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:48.344273 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc61165-06fa-4c8b-88b4-74049400c4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:48.344543 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc61165-06fa-4c8b-88b4-74049400c4d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:48.345358 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc61165-06fa-4c8b-88b4-74049400c4d9 None admin] RBAC: Adding query filter params (group.id=1eea90a3713c4b468b2256b7d87be5d5, role.id=8dc2563a47c540cfa548eb210d02066e, scope.project.id=2ceac2e500814d1f9e4b6160e2b6b2bb) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:48.345673 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc61165-06fa-4c8b-88b4-74049400c4d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:48.347145 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc61165-06fa-4c8b-88b4-74049400c4d9 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:48.352932 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 231/447] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Jul 5 20:35:48 2022] GET /identity/v3/role_assignments?group.id=1eea90a3713c4b468b2256b7d87be5d5&scope.project.id=2ceac2e500814d1f9e4b6160e2b6b2bb&role.id=8dc2563a47c540cfa548eb210d02066e => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:48.353721 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc61165-06fa-4c8b-88b4-74049400c4d9 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:48.372110 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c29ee-f2e9-478b-89f0-c8e37d9a14dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:48.372864 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c29ee-f2e9-478b-89f0-c8e37d9a14dd None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:48.373141 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c29ee-f2e9-478b-89f0-c8e37d9a14dd None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:48.373414 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c29ee-f2e9-478b-89f0-c8e37d9a14dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:48.377194 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:48.454443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:48.461155 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c29ee-f2e9-478b-89f0-c8e37d9a14dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:48.462687 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c29ee-f2e9-478b-89f0-c8e37d9a14dd None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:48.481707 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc61165-06fa-4c8b-88b4-74049400c4d9 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:48.524679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544684d5-a360-44e1-8fb5-43f492ad5e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:48.525777 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544684d5-a360-44e1-8fb5-43f492ad5e5c None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:48.526087 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544684d5-a360-44e1-8fb5-43f492ad5e5c None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:48.526368 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544684d5-a360-44e1-8fb5-43f492ad5e5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:48.585872 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 217/448] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:35:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:35:48.591593 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c29ee-f2e9-478b-89f0-c8e37d9a14dd None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:48.607746 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544684d5-a360-44e1-8fb5-43f492ad5e5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:48.609314 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544684d5-a360-44e1-8fb5-43f492ad5e5c None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:48.629202 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:48.696832 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:48.720415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c29ee-f2e9-478b-89f0-c8e37d9a14dd None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:48.726456 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 232/449] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:35:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:35:48.732126 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544684d5-a360-44e1-8fb5-43f492ad5e5c None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:48.754935 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43c218-10e3-4a14-8d8d-b20117c39d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:48.755807 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43c218-10e3-4a14-8d8d-b20117c39d7f None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:48.756082 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43c218-10e3-4a14-8d8d-b20117c39d7f None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:48.756349 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43c218-10e3-4a14-8d8d-b20117c39d7f None admin] PATH_INFO: `/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:48.757510 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df43c218-10e3-4a14-8d8d-b20117c39d7f None admin] RBAC: Authorizing `identity:get_project(project_id=2ceac2e500814d1f9e4b6160e2b6b2bb)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:48.759102 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df43c218-10e3-4a14-8d8d-b20117c39d7f None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:48.760793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 218/450] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:48 2022] GET /identity/v3/projects/2ceac2e500814d1f9e4b6160e2b6b2bb => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:35:48.766233 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43c218-10e3-4a14-8d8d-b20117c39d7f None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:48.828619 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544684d5-a360-44e1-8fb5-43f492ad5e5c None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:48.861435 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b6427-8aa3-4743-a436-f9f0531cf2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:48.861755 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43c218-10e3-4a14-8d8d-b20117c39d7f None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:48.862310 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b6427-8aa3-4743-a436-f9f0531cf2c7 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:48.862590 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b6427-8aa3-4743-a436-f9f0531cf2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:48.862857 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b6427-8aa3-4743-a436-f9f0531cf2c7 None admin] PATH_INFO: `/v3/projects/d2d267a59c9249019ee131b3dae58a6e` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:48.863386 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:48.864010 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b6427-8aa3-4743-a436-f9f0531cf2c7 None admin] RBAC: Authorizing `identity:get_project(project_id=d2d267a59c9249019ee131b3dae58a6e)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:48.865479 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b6427-8aa3-4743-a436-f9f0531cf2c7 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:48.867421 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 233/451] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:35:48 2022] GET /identity/v3/projects/d2d267a59c9249019ee131b3dae58a6e => generated 344 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:35:48.872899 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b6427-8aa3-4743-a436-f9f0531cf2c7 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:48.897440 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252b7e1-2c0b-4367-b3da-cb233e366a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:48.898352 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252b7e1-2c0b-4367-b3da-cb233e366a66 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:48.898632 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252b7e1-2c0b-4367-b3da-cb233e366a66 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:48.898926 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252b7e1-2c0b-4367-b3da-cb233e366a66 None admin] PATH_INFO: `/v3/groups/1eea90a3713c4b468b2256b7d87be5d5` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:48.900111 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252b7e1-2c0b-4367-b3da-cb233e366a66 None admin] RBAC: Authorizing `identity:get_group(group_id=1eea90a3713c4b468b2256b7d87be5d5)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:48.901603 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252b7e1-2c0b-4367-b3da-cb233e366a66 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:48.903388 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 219/452] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Jul 5 20:35:48 2022] GET /identity/v3/groups/1eea90a3713c4b468b2256b7d87be5d5 => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:35:48.909059 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252b7e1-2c0b-4367-b3da-cb233e366a66 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:48.920234 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:48.978269 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b6427-8aa3-4743-a436-f9f0531cf2c7 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:49.017207 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585c0ec-6439-485d-bd27-f89f2273a2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:49.018104 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585c0ec-6439-485d-bd27-f89f2273a2f5 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:49.018336 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252b7e1-2c0b-4367-b3da-cb233e366a66 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:49.018435 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585c0ec-6439-485d-bd27-f89f2273a2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:49.018640 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585c0ec-6439-485d-bd27-f89f2273a2f5 None admin] PATH_INFO: `/v3/groups/09bdc2faea2941469614ebb972e8373e` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:49.019924 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5585c0ec-6439-485d-bd27-f89f2273a2f5 None admin] RBAC: Authorizing `identity:get_group(group_id=09bdc2faea2941469614ebb972e8373e)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:49.021327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5585c0ec-6439-485d-bd27-f89f2273a2f5 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:49.022974 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 234/453] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Jul 5 20:35:48 2022] GET /identity/v3/groups/09bdc2faea2941469614ebb972e8373e => generated 229 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:49.028949 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585c0ec-6439-485d-bd27-f89f2273a2f5 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:49.053802 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9398ecc-219f-4663-b686-9b306efb6b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:49.054469 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9398ecc-219f-4663-b686-9b306efb6b7d None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:49.054758 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9398ecc-219f-4663-b686-9b306efb6b7d None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:49.055013 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9398ecc-219f-4663-b686-9b306efb6b7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:49.055842 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9398ecc-219f-4663-b686-9b306efb6b7d None admin] RBAC: Adding query filter params (group.id=1eea90a3713c4b468b2256b7d87be5d5, role.id=c403525d65944d2187540a6d893b91e7, scope.project.id=2ceac2e500814d1f9e4b6160e2b6b2bb) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:49.056146 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9398ecc-219f-4663-b686-9b306efb6b7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:49.057583 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9398ecc-219f-4663-b686-9b306efb6b7d None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:49.063519 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 220/454] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Jul 5 20:35:48 2022] GET /identity/v3/role_assignments?group.id=1eea90a3713c4b468b2256b7d87be5d5&scope.project.id=2ceac2e500814d1f9e4b6160e2b6b2bb&role.id=c403525d65944d2187540a6d893b91e7 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:35:49.140171 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585c0ec-6439-485d-bd27-f89f2273a2f5 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:49.157663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:49.181249 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4b698-0757-421c-884e-7ec76285a662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:49.182010 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4b698-0757-421c-884e-7ec76285a662 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:49.182228 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4b698-0757-421c-884e-7ec76285a662 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:49.182474 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4b698-0757-421c-884e-7ec76285a662 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:49.183360 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4b698-0757-421c-884e-7ec76285a662 None admin] RBAC: Adding query filter params (group.id=09bdc2faea2941469614ebb972e8373e, role.id=37ba4a62052348d4811b560c19a07e02, scope.project.id=d2d267a59c9249019ee131b3dae58a6e) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:49.183757 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4b698-0757-421c-884e-7ec76285a662 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:49.185420 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4b698-0757-421c-884e-7ec76285a662 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:49.192211 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 235/455] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Jul 5 20:35:49 2022] GET /identity/v3/role_assignments?group.id=09bdc2faea2941469614ebb972e8373e&scope.project.id=d2d267a59c9249019ee131b3dae58a6e&role.id=37ba4a62052348d4811b560c19a07e02 => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:51.551469 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d43d2-baeb-488c-8ae2-b72f6d264ec3 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:51.552478 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d43d2-baeb-488c-8ae2-b72f6d264ec3 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:51.552956 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d43d2-baeb-488c-8ae2-b72f6d264ec3 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:51.554842 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 221/456] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:51.559835 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60497d-9f5a-44a8-836a-50124b154044 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:51.560705 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60497d-9f5a-44a8-836a-50124b154044 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:51.561240 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60497d-9f5a-44a8-836a-50124b154044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:51.584382 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-fe60497d-9f5a-44a8-836a-50124b154044 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:51.585916 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-fe60497d-9f5a-44a8-836a-50124b154044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:51.687110 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 236/457] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:51.709970 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94527e48-e7e4-4d1c-856e-645ca578e098 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:51.710613 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94527e48-e7e4-4d1c-856e-645ca578e098 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:51.711088 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94527e48-e7e4-4d1c-856e-645ca578e098 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:51.712943 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 222/458] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:51.717922 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60497d-9f5a-44a8-836a-50124b154044 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:51.718493 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde65c8-1591-4303-a498-8144896de594 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:51.719022 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde65c8-1591-4303-a498-8144896de594 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:51.719501 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde65c8-1591-4303-a498-8144896de594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:51.741911 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-edde65c8-1591-4303-a498-8144896de594 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:51.743527 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-edde65c8-1591-4303-a498-8144896de594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:51.777023 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:51.826478 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 223/459] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:35:51.846737 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde65c8-1591-4303-a498-8144896de594 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:51.928003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60497d-9f5a-44a8-836a-50124b154044 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:51.936816 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:51.967692 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4501a-4fe6-46ee-b184-97fc96a2ffd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:51.968499 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4501a-4fe6-46ee-b184-97fc96a2ffd3 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:51.968784 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4501a-4fe6-46ee-b184-97fc96a2ffd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:51.969079 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4501a-4fe6-46ee-b184-97fc96a2ffd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:51.986084 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde65c8-1591-4303-a498-8144896de594 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:51.986645 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4501a-4fe6-46ee-b184-97fc96a2ffd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:51.988373 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4501a-4fe6-46ee-b184-97fc96a2ffd3 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:52.012479 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-26a4501a-4fe6-46ee-b184-97fc96a2ffd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:35:52.012479 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:52.012479 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:52.012479 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:52.012479 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:52.012479 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:52.012479 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:52.012479 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:52.012479 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:52.012479 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:52.012479 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:52.012479 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:52.012479 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:35:52.012479 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:35:52.012479 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:35:52.013448 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:35:52.013448 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:52.013448 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:52.013448 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:52.013448 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:52.013448 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:52.013448 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:52.013448 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:52.013448 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:52.013448 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:52.013448 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:52.013448 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:52.013448 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:52.013448 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:52.013448 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:52.013448 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:52.013448 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:52.014331 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:35:52.014331 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:35:52.014331 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:35:52.014331 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:52.014331 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 237/460] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:35:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:52.015467 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f20f2-ca92-4876-8fac-0068d3bce769 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:52.015756 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f20f2-ca92-4876-8fac-0068d3bce769 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:52.016029 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f20f2-ca92-4876-8fac-0068d3bce769 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:52.021915 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 238/461] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:52.022926 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f20f2-ca92-4876-8fac-0068d3bce769 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:52.034572 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfa2dc-6441-48a3-85d7-599b46d4c455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:52.036124 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfa2dc-6441-48a3-85d7-599b46d4c455 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:52.036582 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfa2dc-6441-48a3-85d7-599b46d4c455 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:52.037447 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfa2dc-6441-48a3-85d7-599b46d4c455 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:52.052836 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bfa2dc-6441-48a3-85d7-599b46d4c455 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:52.055384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bfa2dc-6441-48a3-85d7-599b46d4c455 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:52.084937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-76bfa2dc-6441-48a3-85d7-599b46d4c455 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:35:52.084937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:52.084937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:52.084937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:52.084937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:52.084937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:52.084937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:52.084937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:52.084937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:52.084937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:52.084937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:52.084937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:52.084937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:35:52.084937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:35:52.084937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:35:52.085873 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:35:52.085873 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:52.085873 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:52.085873 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:52.085873 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:52.085873 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:52.085873 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:52.085873 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:52.085873 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:52.085873 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:52.085873 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:52.085873 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:52.085873 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:52.085873 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:52.085873 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:52.085873 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:52.085873 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:52.086727 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:35:52.086727 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:35:52.086727 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:35:52.086727 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:35:52.087681 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 224/462] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:35:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:52.089010 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28038b9a-c30d-49ee-8822-49a0627d72d1 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:52.089294 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28038b9a-c30d-49ee-8822-49a0627d72d1 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:52.089569 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28038b9a-c30d-49ee-8822-49a0627d72d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:52.107076 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-28038b9a-c30d-49ee-8822-49a0627d72d1 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:52.108534 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-28038b9a-c30d-49ee-8822-49a0627d72d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:52.121072 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:52.169506 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f20f2-ca92-4876-8fac-0068d3bce769 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:52.189461 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 225/463] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:52.190665 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28038b9a-c30d-49ee-8822-49a0627d72d1 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:52.231514 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea844ac-f8b1-4a9f-a06c-7f3e34f2fb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:52.232774 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea844ac-f8b1-4a9f-a06c-7f3e34f2fb81 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:52.233054 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea844ac-f8b1-4a9f-a06c-7f3e34f2fb81 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:52.233327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea844ac-f8b1-4a9f-a06c-7f3e34f2fb81 None admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:52.234357 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea844ac-f8b1-4a9f-a06c-7f3e34f2fb81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:52.234851 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea844ac-f8b1-4a9f-a06c-7f3e34f2fb81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:52.238137 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea844ac-f8b1-4a9f-a06c-7f3e34f2fb81 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:52.254002 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 239/464] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:52.255871 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea844ac-f8b1-4a9f-a06c-7f3e34f2fb81 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:52.282686 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:52.316552 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28038b9a-c30d-49ee-8822-49a0627d72d1 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:52.357941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c9d9d-6fd2-4628-aba7-4874c872acca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:52.358711 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c9d9d-6fd2-4628-aba7-4874c872acca None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:52.359110 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c9d9d-6fd2-4628-aba7-4874c872acca None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:52.359481 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c9d9d-6fd2-4628-aba7-4874c872acca None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:52.360309 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c9d9d-6fd2-4628-aba7-4874c872acca None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:52.360762 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c9d9d-6fd2-4628-aba7-4874c872acca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:52.362338 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c9d9d-6fd2-4628-aba7-4874c872acca None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:52.388339 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 226/465] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:52.389283 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c9d9d-6fd2-4628-aba7-4874c872acca None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:52.390399 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea844ac-f8b1-4a9f-a06c-7f3e34f2fb81 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:52.400813 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:52.428578 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d103dab-9ba2-4bd0-8083-9b394818e6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:52.429765 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d103dab-9ba2-4bd0-8083-9b394818e6a6 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:52.430287 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d103dab-9ba2-4bd0-8083-9b394818e6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:52.430755 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d103dab-9ba2-4bd0-8083-9b394818e6a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:52.442730 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d103dab-9ba2-4bd0-8083-9b394818e6a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:52.444559 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d103dab-9ba2-4bd0-8083-9b394818e6a6 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:52.462880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-3d103dab-9ba2-4bd0-8083-9b394818e6a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:35:52.462880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:52.462880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:52.462880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:52.462880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:52.462880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:52.462880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:52.462880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:52.462880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:52.462880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:52.462880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:52.462880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:52.462880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:35:52.462880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:35:52.462880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:35:52.463779 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:35:52.463779 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:52.463779 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:52.463779 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:52.463779 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:52.463779 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:52.463779 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:52.463779 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:52.463779 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:52.463779 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:52.463779 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:52.463779 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:52.463779 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:52.463779 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:52.463779 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:52.463779 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:52.463779 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:52.464626 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:35:52.464626 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:35:52.464626 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:35:52.464626 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:52.471467 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 240/466] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:35:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:52.472575 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d103dab-9ba2-4bd0-8083-9b394818e6a6 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:52.514836 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c9d9d-6fd2-4628-aba7-4874c872acca None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:52.551219 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea770c9-5273-4b3c-b9c7-b679d87f9c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:52.552310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea770c9-5273-4b3c-b9c7-b679d87f9c68 None admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:52.553230 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea770c9-5273-4b3c-b9c7-b679d87f9c68 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:52.553816 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea770c9-5273-4b3c-b9c7-b679d87f9c68 None admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:52.554852 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea770c9-5273-4b3c-b9c7-b679d87f9c68 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:52.556599 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea770c9-5273-4b3c-b9c7-b679d87f9c68 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:52.565109 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:52.583137 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 227/467] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Jul 5 20:35:52 2022] POST /identity/v3/users => generated 246 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:35:52.584386 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea770c9-5273-4b3c-b9c7-b679d87f9c68 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:52.604198 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d103dab-9ba2-4bd0-8083-9b394818e6a6 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:52.646151 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d348b-3af4-4585-ba10-d6110fe63ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:52.646963 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d348b-3af4-4585-ba10-d6110fe63ca0 None admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:52.647370 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d348b-3af4-4585-ba10-d6110fe63ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:52.647769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d348b-3af4-4585-ba10-d6110fe63ca0 None admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:52.648725 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d348b-3af4-4585-ba10-d6110fe63ca0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:52.650344 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d348b-3af4-4585-ba10-d6110fe63ca0 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:52.658489 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:52.677782 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 241/468] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Jul 5 20:35:52 2022] POST /identity/v3/users => generated 248 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:35:52.679448 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a279f45-1046-464d-8dc1-b2fdb6979c82 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:52.679779 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a279f45-1046-464d-8dc1-b2fdb6979c82 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:52.680160 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a279f45-1046-464d-8dc1-b2fdb6979c82 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:52.682084 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 242/469] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:52.693503 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387efda0-a2f5-4a9f-aa81-e34947016c65 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:52.693503 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387efda0-a2f5-4a9f-aa81-e34947016c65 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:52.693503 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387efda0-a2f5-4a9f-aa81-e34947016c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:52.732058 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-387efda0-a2f5-4a9f-aa81-e34947016c65 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:52.733312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-387efda0-a2f5-4a9f-aa81-e34947016c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:52.743428 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea770c9-5273-4b3c-b9c7-b679d87f9c68 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:52.793329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d280cf-b4de-4fdd-a18e-66e6063400ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:52.794064 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d280cf-b4de-4fdd-a18e-66e6063400ae None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:52.794382 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d280cf-b4de-4fdd-a18e-66e6063400ae None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:52.794662 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d280cf-b4de-4fdd-a18e-66e6063400ae None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:52.795417 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d280cf-b4de-4fdd-a18e-66e6063400ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:52.795740 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d280cf-b4de-4fdd-a18e-66e6063400ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:52.797180 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d280cf-b4de-4fdd-a18e-66e6063400ae None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:52.816069 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 228/470] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:52.826425 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d280cf-b4de-4fdd-a18e-66e6063400ae None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:52.848855 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 243/471] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:52.874805 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387efda0-a2f5-4a9f-aa81-e34947016c65 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:52.947215 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:52.982802 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d280cf-b4de-4fdd-a18e-66e6063400ae None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:53.008263 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387efda0-a2f5-4a9f-aa81-e34947016c65 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:53.014752 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:53.034449 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c54fa0b-1723-445b-ac55-8b14ed6c223d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:53.035131 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54fa0b-1723-445b-ac55-8b14ed6c223d None admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:53.035410 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54fa0b-1723-445b-ac55-8b14ed6c223d None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:53.035683 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54fa0b-1723-445b-ac55-8b14ed6c223d None admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:53.036388 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c54fa0b-1723-445b-ac55-8b14ed6c223d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:53.037873 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c54fa0b-1723-445b-ac55-8b14ed6c223d None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:53.052619 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e647a-2ea5-4c0f-9952-639d8a725ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:53.053531 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e647a-2ea5-4c0f-9952-639d8a725ec2 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:53.054007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e647a-2ea5-4c0f-9952-639d8a725ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:53.054320 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e647a-2ea5-4c0f-9952-639d8a725ec2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:53.064125 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 229/472] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Jul 5 20:35:52 2022] POST /identity/v3/users => generated 248 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:35:53.069408 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e647a-2ea5-4c0f-9952-639d8a725ec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:53.070842 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e647a-2ea5-4c0f-9952-639d8a725ec2 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:53.092391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-c05e647a-2ea5-4c0f-9952-639d8a725ec2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:35:53.092391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:53.092391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:53.092391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:53.092391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:53.092391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:53.092391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:53.092391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:53.092391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:53.092391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:53.092391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:53.092391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:53.092391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:35:53.092391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:35:53.092391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:35:53.093312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:35:53.093312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:53.093312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:53.093312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:53.093312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:53.093312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:53.093312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:53.093312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:53.093312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:53.093312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:53.093312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:53.093312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:53.093312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:53.093312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:53.093312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:53.093312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:53.093312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:53.094223 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:35:53.094223 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:35:53.094223 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:35:53.094223 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:53.094223 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 244/473] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:35:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:53.103059 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c54fa0b-1723-445b-ac55-8b14ed6c223d None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:53.219248 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515143c-d25a-46c2-bd63-11d3a37481d2 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:53.219589 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515143c-d25a-46c2-bd63-11d3a37481d2 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:53.219952 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515143c-d25a-46c2-bd63-11d3a37481d2 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:53.221582 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 245/474] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:53.221954 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c54fa0b-1723-445b-ac55-8b14ed6c223d None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:53.227748 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86fc09-52e2-4a2a-b3cd-d5083d850141 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:53.228211 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86fc09-52e2-4a2a-b3cd-d5083d850141 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:53.228647 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86fc09-52e2-4a2a-b3cd-d5083d850141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:53.249078 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-3e86fc09-52e2-4a2a-b3cd-d5083d850141 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:53.250533 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-3e86fc09-52e2-4a2a-b3cd-d5083d850141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:53.269713 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68cdee-3a8e-4e1b-bc76-e9c4a542c3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:53.270565 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68cdee-3a8e-4e1b-bc76-e9c4a542c3a6 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:53.271042 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68cdee-3a8e-4e1b-bc76-e9c4a542c3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:53.271426 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68cdee-3a8e-4e1b-bc76-e9c4a542c3a6 None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:53.272360 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68cdee-3a8e-4e1b-bc76-e9c4a542c3a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:53.272754 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68cdee-3a8e-4e1b-bc76-e9c4a542c3a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:53.274268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68cdee-3a8e-4e1b-bc76-e9c4a542c3a6 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:53.290907 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 230/475] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:53.296197 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68cdee-3a8e-4e1b-bc76-e9c4a542c3a6 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:53.328953 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 246/476] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:35:53.345720 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:53.357182 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86fc09-52e2-4a2a-b3cd-d5083d850141 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:53.399286 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:53.418464 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68cdee-3a8e-4e1b-bc76-e9c4a542c3a6 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:53.456955 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073b327-40a9-4293-aa4d-083ec75fc69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:53.458117 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073b327-40a9-4293-aa4d-083ec75fc69b None admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:53.458682 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073b327-40a9-4293-aa4d-083ec75fc69b None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:53.459174 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073b327-40a9-4293-aa4d-083ec75fc69b None admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:53.460067 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073b327-40a9-4293-aa4d-083ec75fc69b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:53.461979 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073b327-40a9-4293-aa4d-083ec75fc69b None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:53.464248 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86fc09-52e2-4a2a-b3cd-d5083d850141 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:53.489090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 231/477] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Jul 5 20:35:53 2022] POST /identity/v3/users => generated 249 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:35:53.510961 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3394323-bc6a-474e-8f09-47871ac2dcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:53.511645 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3394323-bc6a-474e-8f09-47871ac2dcc5 None admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:53.511928 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3394323-bc6a-474e-8f09-47871ac2dcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:53.512193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3394323-bc6a-474e-8f09-47871ac2dcc5 None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:53.512925 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3394323-bc6a-474e-8f09-47871ac2dcc5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:53.515160 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3394323-bc6a-474e-8f09-47871ac2dcc5 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:53.525351 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.sql.core [None req-a3394323-bc6a-474e-8f09-47871ac2dcc5 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 05 20:35:53.525351 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 05 20:35:53.525351 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [parameters: {'id': 'cad0ebcfeabe4b8d8628593613bee8a0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 05 20:35:53.525351 dv-cinder-797608-49-smb devstack@keystone.service[87152]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87152) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 05 20:35:53.543157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-a3394323-bc6a-474e-8f09-47871ac2dcc5 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 05 20:35:53.543157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:53.543157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 20:35:53.543157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 20:35:53.543157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 20:35:53.543157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 20:35:53.543157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 20:35:53.543157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 20:35:53.543157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 20:35:53.543157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application conn.query(q) Jul 05 20:35:53.543157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 20:35:53.543157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 20:35:53.543157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 20:35:53.543157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application result.read() Jul 05 20:35:53.543157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 20:35:53.544313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 20:35:53.544313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 20:35:53.544313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 20:35:53.544313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 20:35:53.544313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 20:35:53.544313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 20:35:53.544313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 20:35:53.544313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 05 20:35:53.544313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:53.544313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 05 20:35:53.544313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:53.544313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:53.544313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 05 20:35:53.544313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 05 20:35:53.544313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 05 20:35:53.544313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return ref.to_dict() Jul 05 20:35:53.544313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 20:35:53.544313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application next(self.gen) Jul 05 20:35:53.545430 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 05 20:35:53.545430 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application yield resource Jul 05 20:35:53.545430 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 20:35:53.545430 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application next(self.gen) Jul 05 20:35:53.545430 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 05 20:35:53.545430 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self.session.rollback() Jul 05 20:35:53.545430 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 05 20:35:53.545430 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self.force_reraise() Jul 05 20:35:53.545430 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 05 20:35:53.545430 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise self.value Jul 05 20:35:53.545430 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 05 20:35:53.545430 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 05 20:35:53.545430 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 05 20:35:53.545430 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application session.commit() Jul 05 20:35:53.545430 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 05 20:35:53.545430 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 05 20:35:53.545430 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 05 20:35:53.551007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self._prepare_impl() Jul 05 20:35:53.551007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 05 20:35:53.551007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self.session.flush() Jul 05 20:35:53.551007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 05 20:35:53.551007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self._flush(objects) Jul 05 20:35:53.551007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 05 20:35:53.551007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 05 20:35:53.551007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 05 20:35:53.551007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application compat.raise_( Jul 05 20:35:53.551007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 20:35:53.551007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception Jul 05 20:35:53.551007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 05 20:35:53.551007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application flush_context.execute() Jul 05 20:35:53.551007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 05 20:35:53.551007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rec.execute(self) Jul 05 20:35:53.551007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 05 20:35:53.551007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 05 20:35:53.552073 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 05 20:35:53.552073 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 05 20:35:53.552073 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 05 20:35:53.552073 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 05 20:35:53.552073 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 05 20:35:53.552073 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 05 20:35:53.552073 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 05 20:35:53.552073 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 05 20:35:53.552073 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 05 20:35:53.552073 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 05 20:35:53.552073 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 05 20:35:53.552073 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 05 20:35:53.552073 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 05 20:35:53.552073 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 05 20:35:53.552073 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 20:35:53.552073 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception Jul 05 20:35:53.553068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 20:35:53.553068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 20:35:53.553068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 20:35:53.553068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 20:35:53.553068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 20:35:53.553068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 20:35:53.553068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 20:35:53.553068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application conn.query(q) Jul 05 20:35:53.553068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 20:35:53.553068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 20:35:53.553068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 20:35:53.553068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application result.read() Jul 05 20:35:53.553068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 20:35:53.553068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 20:35:53.553068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 20:35:53.553068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 20:35:53.554202 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 20:35:53.554202 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 20:35:53.554202 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 20:35:53.554202 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 20:35:53.554202 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 05 20:35:53.554202 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 05 20:35:53.554202 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [parameters: {'id': 'cad0ebcfeabe4b8d8628593613bee8a0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 05 20:35:53.554202 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 05 20:35:53.554202 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:53.554202 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:35:53.554202 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:53.554202 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:53.554202 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:53.554202 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:53.554202 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:53.554202 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:53.555180 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:53.555180 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:53.555180 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:53.555180 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:53.555180 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:53.555180 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:53.555180 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 05 20:35:53.555180 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 05 20:35:53.555180 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:53.555180 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:53.555180 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 05 20:35:53.555180 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 05 20:35:53.555180 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 05 20:35:53.555180 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 05 20:35:53.555180 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 05 20:35:53.555180 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:53.556152 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 247/478] 10.222.0.27 () {60 vars in 1131 bytes} [Tue Jul 5 20:35:53 2022] POST /identity/v3/roles => generated 144 bytes in 191 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:35:53.558869 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073b327-40a9-4293-aa4d-083ec75fc69b None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:53.667857 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:53.675970 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073b327-40a9-4293-aa4d-083ec75fc69b None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:53.712325 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e366a-7614-4681-8c90-cf377c5bcc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:53.713153 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e366a-7614-4681-8c90-cf377c5bcc2b None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:53.713429 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e366a-7614-4681-8c90-cf377c5bcc2b None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:53.713696 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e366a-7614-4681-8c90-cf377c5bcc2b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:53.724268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e366a-7614-4681-8c90-cf377c5bcc2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:53.732264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-b86e366a-7614-4681-8c90-cf377c5bcc2b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:35:53.732264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:53.732264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:53.732264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:53.732264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:53.732264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:53.732264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:53.732264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:53.732264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:53.732264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:53.732264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:53.732264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:53.732264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:53.732264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:53.732264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:53.732264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:53.734279 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:53.734279 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:53.734279 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:53.734279 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:53.734279 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:53.734279 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:53.734279 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:53.734279 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:53.734279 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:53.734279 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:53.734279 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:53.734279 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:53.734279 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:53.734279 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:53.734279 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:53.734279 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:53.736157 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:53.736157 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:53.736157 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:53.736157 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:53.736157 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:53.736157 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:53.736157 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:53.736157 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:53.736157 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:53.736157 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:53.736157 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 05 20:35:53.736157 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:35:53.736157 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 232/479] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 5 20:35:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:53.739966 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3394323-bc6a-474e-8f09-47871ac2dcc5 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:53.852300 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3394323-bc6a-474e-8f09-47871ac2dcc5 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:53.853819 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:53.888726 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2842eb-9e81-403a-aa39-d2ddde8c9411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:53.889400 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2842eb-9e81-403a-aa39-d2ddde8c9411 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:53.889724 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2842eb-9e81-403a-aa39-d2ddde8c9411 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:53.890020 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2842eb-9e81-403a-aa39-d2ddde8c9411 None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:53.890762 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2842eb-9e81-403a-aa39-d2ddde8c9411 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:53.891059 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2842eb-9e81-403a-aa39-d2ddde8c9411 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:53.892573 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2842eb-9e81-403a-aa39-d2ddde8c9411 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:53.902640 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 248/480] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:35:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:55.125893 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a54ca-2680-451c-871c-6f33a81fac6f None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:55.126409 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a54ca-2680-451c-871c-6f33a81fac6f None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:55.126870 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a54ca-2680-451c-871c-6f33a81fac6f None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:55.128982 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 233/481] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:55.134986 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5862b5-a407-41ed-a617-79e25ec4dcd7 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:55.135620 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5862b5-a407-41ed-a617-79e25ec4dcd7 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:55.135969 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5862b5-a407-41ed-a617-79e25ec4dcd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:55.163272 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-2d5862b5-a407-41ed-a617-79e25ec4dcd7 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:55.164478 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-2d5862b5-a407-41ed-a617-79e25ec4dcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:55.262567 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 249/482] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:55.285204 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e9271-196b-4b6b-9491-53790b00cd0e None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:55.285481 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e9271-196b-4b6b-9491-53790b00cd0e None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:55.285760 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e9271-196b-4b6b-9491-53790b00cd0e None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:55.287428 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 234/483] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:55.293357 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d408a-7dcb-49ba-a284-5fbf3fa5f6ef None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:55.293357 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d408a-7dcb-49ba-a284-5fbf3fa5f6ef None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:55.293357 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d408a-7dcb-49ba-a284-5fbf3fa5f6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:55.294269 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e9271-196b-4b6b-9491-53790b00cd0e None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:55.312353 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-9d6d408a-7dcb-49ba-a284-5fbf3fa5f6ef None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:55.313983 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-9d6d408a-7dcb-49ba-a284-5fbf3fa5f6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:55.390631 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 250/484] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:55.416213 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d408a-7dcb-49ba-a284-5fbf3fa5f6ef None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:55.446073 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:55.487808 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e9271-196b-4b6b-9491-53790b00cd0e None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:55.555175 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae1183-c43a-4daa-9139-47496422b9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:55.556366 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae1183-c43a-4daa-9139-47496422b9c1 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:55.556867 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae1183-c43a-4daa-9139-47496422b9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:55.557435 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae1183-c43a-4daa-9139-47496422b9c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:55.575313 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae1183-c43a-4daa-9139-47496422b9c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:55.583854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-aaae1183-c43a-4daa-9139-47496422b9c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:35:55.583854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:55.583854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:55.583854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:55.583854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:55.583854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:55.583854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:55.583854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:55.583854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:55.583854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:55.583854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:55.583854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:55.583854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:55.583854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:55.583854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:55.583854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:55.584771 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:55.584771 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:55.584771 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:55.584771 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:55.584771 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:55.584771 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:55.584771 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:55.584771 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:55.584771 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:55.584771 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:55.584771 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:55.584771 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:55.584771 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:55.584771 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:55.584771 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:55.584771 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:55.585566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:55.585566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:55.585566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:55.585566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:55.585566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:55.585566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:55.585566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:55.585566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:55.585566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:55.585566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:55.585566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:35:55.585566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:35:55.588104 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 235/485] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 5 20:35:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:55.594011 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae1183-c43a-4daa-9139-47496422b9c1 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:55.595207 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d408a-7dcb-49ba-a284-5fbf3fa5f6ef None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:55.614675 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:55.654816 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76adf22-9338-436c-806a-5930cdf4c463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:55.656049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76adf22-9338-436c-806a-5930cdf4c463 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:55.656559 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76adf22-9338-436c-806a-5930cdf4c463 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:55.657022 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76adf22-9338-436c-806a-5930cdf4c463 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:55.676389 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76adf22-9338-436c-806a-5930cdf4c463 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:55.689001 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-b76adf22-9338-436c-806a-5930cdf4c463 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:35:55.689001 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:55.689001 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:55.689001 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:55.689001 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:55.689001 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:55.689001 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:55.689001 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:55.689001 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:55.689001 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:55.689001 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:55.689001 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:55.689001 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:55.689001 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:55.689001 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:55.689001 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:55.689975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:55.689975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:55.689975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:55.689975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:55.689975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:55.689975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:55.689975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:55.689975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:55.689975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:55.689975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:55.689975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:55.689975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:55.689975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:55.689975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:55.689975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:55.689975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:55.690768 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:55.690768 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:55.690768 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:55.690768 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:55.690768 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:55.690768 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:55.690768 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:55.690768 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:55.690768 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:55.690768 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:55.690768 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:35:55.690768 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:55.696792 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 251/486] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 5 20:35:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:35:55.704218 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76adf22-9338-436c-806a-5930cdf4c463 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:55.828877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:55.841434 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae1183-c43a-4daa-9139-47496422b9c1 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:55.848279 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76adf22-9338-436c-806a-5930cdf4c463 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:55.883501 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00466e6-17da-49da-891f-75191201eaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:55.884078 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0a210-565c-46d8-948c-32130b27e108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:55.884745 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0a210-565c-46d8-948c-32130b27e108 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:55.885023 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0a210-565c-46d8-948c-32130b27e108 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:55.885232 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00466e6-17da-49da-891f-75191201eaec None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:55.885340 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0a210-565c-46d8-948c-32130b27e108 None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:55.885858 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00466e6-17da-49da-891f-75191201eaec None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:55.886041 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0a210-565c-46d8-948c-32130b27e108 None admin] RBAC: Adding query filter params (name=service) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:55.886343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0a210-565c-46d8-948c-32130b27e108 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:55.886696 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00466e6-17da-49da-891f-75191201eaec None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:55.887642 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00466e6-17da-49da-891f-75191201eaec None admin] RBAC: Adding query filter params (name=service) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:55.887805 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0a210-565c-46d8-948c-32130b27e108 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:55.888319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00466e6-17da-49da-891f-75191201eaec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:55.890389 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00466e6-17da-49da-891f-75191201eaec None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:55.897376 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 252/487] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 5 20:35:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:55.899197 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633e1df-218f-4f63-8e07-51c86356dfd7 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:55.899481 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633e1df-218f-4f63-8e07-51c86356dfd7 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:55.899753 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633e1df-218f-4f63-8e07-51c86356dfd7 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:55.901307 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 236/489] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 5 20:35:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:35:55.905954 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 253/489] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:55.907079 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00466e6-17da-49da-891f-75191201eaec None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:55.907446 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe205ca-2dcb-41c2-83fe-7dd33c369332 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:55.907734 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe205ca-2dcb-41c2-83fe-7dd33c369332 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:55.908413 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe205ca-2dcb-41c2-83fe-7dd33c369332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:55.926063 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-6fe205ca-2dcb-41c2-83fe-7dd33c369332 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:55.927364 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-6fe205ca-2dcb-41c2-83fe-7dd33c369332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:56.002128 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 254/490] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:56.002819 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:56.003809 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe205ca-2dcb-41c2-83fe-7dd33c369332 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:56.027731 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00466e6-17da-49da-891f-75191201eaec None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:56.069219 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d98ae-6cf0-4fec-9b18-8578e081a7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:56.070677 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d98ae-6cf0-4fec-9b18-8578e081a7a7 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:56.071134 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d98ae-6cf0-4fec-9b18-8578e081a7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:56.071732 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d98ae-6cf0-4fec-9b18-8578e081a7a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:56.085491 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d98ae-6cf0-4fec-9b18-8578e081a7a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:56.087802 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d98ae-6cf0-4fec-9b18-8578e081a7a7 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:56.105602 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:56.112080 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-a41d98ae-6cf0-4fec-9b18-8578e081a7a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:35:56.112080 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:56.112080 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:56.112080 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:56.112080 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:56.112080 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:56.112080 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:56.112080 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:56.112080 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:56.112080 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:56.112080 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:56.112080 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:56.112080 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:35:56.112080 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:35:56.112080 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:35:56.112937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:35:56.112937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:56.112937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:56.112937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:56.112937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:56.112937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:56.112937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:56.112937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:56.112937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:56.112937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:56.112937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:56.112937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:56.112937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:56.112937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:56.112937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:56.112937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:56.112937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:56.113788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:35:56.113788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:35:56.113788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:35:56.113788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:35:56.116080 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 237/491] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:35:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:56.117212 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d98ae-6cf0-4fec-9b18-8578e081a7a7 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:56.141002 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe205ca-2dcb-41c2-83fe-7dd33c369332 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:56.188109 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29604c53-9547-4850-b94a-e57a6f1fd73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:56.188914 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29604c53-9547-4850-b94a-e57a6f1fd73e None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:56.189111 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29604c53-9547-4850-b94a-e57a6f1fd73e None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:56.189377 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29604c53-9547-4850-b94a-e57a6f1fd73e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:56.199860 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29604c53-9547-4850-b94a-e57a6f1fd73e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:56.201482 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29604c53-9547-4850-b94a-e57a6f1fd73e None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:56.224227 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-29604c53-9547-4850-b94a-e57a6f1fd73e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:35:56.224227 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:56.224227 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:56.224227 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:56.224227 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:56.224227 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:56.224227 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:56.224227 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:56.224227 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:56.224227 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:56.224227 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:56.224227 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:56.224227 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:35:56.224227 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:35:56.224227 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:35:56.225114 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:35:56.225114 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:56.225114 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:56.225114 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:56.225114 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:56.225114 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:56.225114 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:56.225114 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:56.225114 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:56.225114 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:56.225114 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:56.225114 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:56.225114 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:56.225114 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:56.225114 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:56.225114 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:56.225114 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:56.225989 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:35:56.225989 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:35:56.225989 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:35:56.225989 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:56.227151 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 255/492] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:35:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:56.231866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29604c53-9547-4850-b94a-e57a6f1fd73e None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:56.237039 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d98ae-6cf0-4fec-9b18-8578e081a7a7 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:56.265466 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:56.273872 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfcb4ba-539d-4c1a-ac26-a14efe32e553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:56.274690 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcb4ba-539d-4c1a-ac26-a14efe32e553 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:56.274965 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcb4ba-539d-4c1a-ac26-a14efe32e553 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:56.275229 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcb4ba-539d-4c1a-ac26-a14efe32e553 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:56.285887 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfcb4ba-539d-4c1a-ac26-a14efe32e553 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:56.293640 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-5cfcb4ba-539d-4c1a-ac26-a14efe32e553 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:35:56.293640 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:56.293640 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:56.293640 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:56.293640 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:56.293640 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:56.293640 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:56.293640 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:56.293640 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:56.293640 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:56.293640 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:56.293640 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:56.293640 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:56.293640 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:56.293640 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:56.293640 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:56.294778 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:56.294778 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:56.294778 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:56.294778 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:56.294778 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:56.294778 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:56.294778 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:56.294778 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:56.294778 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:56.294778 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:56.294778 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:56.294778 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:56.294778 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:56.294778 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:56.294778 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:56.294778 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:56.295657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:56.295657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:56.295657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:56.295657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:56.295657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:56.295657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:56.295657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:56.295657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:56.295657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:56.295657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:56.295657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:35:56.295657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:35:56.299850 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 238/493] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 5 20:35:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:56.301263 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b9e91-41f9-49de-bedd-b97faa0c48ab None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:56.301552 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b9e91-41f9-49de-bedd-b97faa0c48ab None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:56.301825 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b9e91-41f9-49de-bedd-b97faa0c48ab None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:56.303350 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 239/494] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:56.304049 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b9e91-41f9-49de-bedd-b97faa0c48ab None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:56.341507 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29604c53-9547-4850-b94a-e57a6f1fd73e None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:56.369131 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:56.377351 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ace82-b99a-4e69-b236-d088544e279e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:56.378089 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ace82-b99a-4e69-b236-d088544e279e None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:56.378366 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ace82-b99a-4e69-b236-d088544e279e None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:56.378630 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ace82-b99a-4e69-b236-d088544e279e None admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:56.379322 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ace82-b99a-4e69-b236-d088544e279e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:56.379622 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ace82-b99a-4e69-b236-d088544e279e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:56.380992 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ace82-b99a-4e69-b236-d088544e279e None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:56.393281 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 256/495] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:56.394135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ace82-b99a-4e69-b236-d088544e279e None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:56.414648 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b9e91-41f9-49de-bedd-b97faa0c48ab None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:56.448339 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1af506-df0b-49eb-8227-7a6fd4cda499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:56.448929 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1af506-df0b-49eb-8227-7a6fd4cda499 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:56.449205 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1af506-df0b-49eb-8227-7a6fd4cda499 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:56.449478 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1af506-df0b-49eb-8227-7a6fd4cda499 None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:56.450232 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1af506-df0b-49eb-8227-7a6fd4cda499 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:56.450586 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1af506-df0b-49eb-8227-7a6fd4cda499 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:56.451987 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1af506-df0b-49eb-8227-7a6fd4cda499 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:56.463380 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 240/496] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:56.464675 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3eb0e8-3f91-438b-967f-b6d7fb148972 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:56.464963 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3eb0e8-3f91-438b-967f-b6d7fb148972 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:56.465247 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3eb0e8-3f91-438b-967f-b6d7fb148972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:56.481628 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-2c3eb0e8-3f91-438b-967f-b6d7fb148972 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:56.482847 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-2c3eb0e8-3f91-438b-967f-b6d7fb148972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:56.509422 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ace82-b99a-4e69-b236-d088544e279e None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:56.526603 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:56.543258 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e6428-bfa3-4280-874f-db7488f5733b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:56.543929 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e6428-bfa3-4280-874f-db7488f5733b None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:56.544243 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e6428-bfa3-4280-874f-db7488f5733b None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:56.544516 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e6428-bfa3-4280-874f-db7488f5733b None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:56.545260 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e6428-bfa3-4280-874f-db7488f5733b None admin] RBAC: Adding query filter params (name=service) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:56.545554 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e6428-bfa3-4280-874f-db7488f5733b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:56.546999 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e6428-bfa3-4280-874f-db7488f5733b None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:56.549888 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 241/497] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:56.551082 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3eb0e8-3f91-438b-967f-b6d7fb148972 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:56.557915 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 257/498] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 5 20:35:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:56.557915 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e6428-bfa3-4280-874f-db7488f5733b None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:56.608644 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:56.651173 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3eb0e8-3f91-438b-967f-b6d7fb148972 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:56.659248 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e6428-bfa3-4280-874f-db7488f5733b None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:56.684405 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c2e2a-ce47-46d5-b444-78b12ae68d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:56.685287 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c2e2a-ce47-46d5-b444-78b12ae68d0b None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:56.685567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c2e2a-ce47-46d5-b444-78b12ae68d0b None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:56.685870 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c2e2a-ce47-46d5-b444-78b12ae68d0b None admin] PATH_INFO: `/v3/users/glance` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:56.692409 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7ff9e-ec4c-4800-a0bb-7290c7f8dec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:56.692808 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c2e2a-ce47-46d5-b444-78b12ae68d0b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:56.693200 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7ff9e-ec4c-4800-a0bb-7290c7f8dec9 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:56.693530 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7ff9e-ec4c-4800-a0bb-7290c7f8dec9 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:56.693804 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7ff9e-ec4c-4800-a0bb-7290c7f8dec9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:56.694297 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c2e2a-ce47-46d5-b444-78b12ae68d0b None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:56.701538 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7ff9e-ec4c-4800-a0bb-7290c7f8dec9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:56.702980 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7ff9e-ec4c-4800-a0bb-7290c7f8dec9 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:56.709764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-272c2e2a-ce47-46d5-b444-78b12ae68d0b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 05 20:35:56.709764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:56.709764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:56.709764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:56.709764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:56.709764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:56.709764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:56.709764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:56.709764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:56.709764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:56.709764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:56.709764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:56.709764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:35:56.709764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:35:56.709764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:35:56.709764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:35:56.710846 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:56.710846 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:56.710846 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:35:56.710846 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:35:56.710846 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:35:56.710846 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:35:56.710846 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:56.710846 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:56.710846 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:56.710846 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:56.710846 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:56.710846 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:56.710846 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:56.710846 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:56.710846 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:56.710846 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:56.710846 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:56.710846 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:56.711748 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:56.711748 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:56.711748 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:35:56.711748 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:35:56.711748 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:35:56.711748 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:35:56.711748 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:35:56.711748 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:35:56.711748 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 05 20:35:56.711748 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:35:56.711748 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 242/499] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:35:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:56.712309 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1217d48-a324-45cc-8400-e759f2d6641d None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:56.712770 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1217d48-a324-45cc-8400-e759f2d6641d None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:56.712770 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1217d48-a324-45cc-8400-e759f2d6641d None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:56.717873 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 243/500] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:35:56.717873 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1217d48-a324-45cc-8400-e759f2d6641d None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:56.718802 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-0ed7ff9e-ec4c-4800-a0bb-7290c7f8dec9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 20:35:56.718802 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:56.718802 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:56.718802 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:56.718802 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:56.718802 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:56.718802 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:56.718802 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:56.718802 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:56.718802 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:56.718802 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:56.718802 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:56.718802 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:35:56.718802 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:35:56.718802 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:35:56.718802 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:35:56.719666 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:56.719666 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:56.719666 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:35:56.719666 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:35:56.719666 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:35:56.719666 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:35:56.719666 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:56.719666 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:56.719666 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:56.719666 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:56.719666 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:56.719666 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:56.719666 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:56.719666 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:56.719666 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:56.719666 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:56.719666 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:56.719666 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:56.720537 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:56.720537 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:56.720537 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:35:56.720537 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:35:56.720537 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:35:56.720537 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:35:56.720537 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:35:56.720537 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:35:56.720537 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 20:35:56.720537 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:56.720537 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 258/501] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Jul 5 20:35:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:56.721088 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7ff9e-ec4c-4800-a0bb-7290c7f8dec9 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:56.761228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:56.819542 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7ff9e-ec4c-4800-a0bb-7290c7f8dec9 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:56.819791 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1217d48-a324-45cc-8400-e759f2d6641d None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:56.829686 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:56.853814 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f439e1-5826-4a69-bef3-83872ef71e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:56.854200 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b5018-e3fc-4c19-8264-12850fdf8df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:56.854817 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f439e1-5826-4a69-bef3-83872ef71e29 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:56.855004 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b5018-e3fc-4c19-8264-12850fdf8df6 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:56.855212 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f439e1-5826-4a69-bef3-83872ef71e29 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:56.855300 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b5018-e3fc-4c19-8264-12850fdf8df6 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:56.855546 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b5018-e3fc-4c19-8264-12850fdf8df6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:56.855631 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f439e1-5826-4a69-bef3-83872ef71e29 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:56.865609 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2b5018-e3fc-4c19-8264-12850fdf8df6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:56.866009 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f439e1-5826-4a69-bef3-83872ef71e29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:35:56.867152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2b5018-e3fc-4c19-8264-12850fdf8df6 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:56.873632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-66f439e1-5826-4a69-bef3-83872ef71e29 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:35:56.873632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:56.873632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:56.873632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:56.873632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:56.873632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:56.873632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:56.873632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:56.873632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:56.873632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:56.873632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:56.873632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:56.873632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:35:56.873632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:35:56.873632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:35:56.873632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:35:56.874706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:35:56.874706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:35:56.874706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:35:56.874706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:35:56.874706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:56.874706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:56.874706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:56.874706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:56.874706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:56.874706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:56.874706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:56.874706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:56.874706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:56.874706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:56.874706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:56.874706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:56.875671 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:56.875671 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:56.875671 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:56.875671 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:56.875671 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:35:56.875671 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:35:56.875671 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:35:56.875671 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:35:56.875671 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:35:56.875671 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:35:56.875671 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:35:56.875671 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:56.875671 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 259/502] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 5 20:35:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:56.875671 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f439e1-5826-4a69-bef3-83872ef71e29 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:56.887546 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-7d2b5018-e3fc-4c19-8264-12850fdf8df6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:35:56.887546 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:56.887546 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:56.887546 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:56.887546 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:56.887546 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:56.887546 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:56.887546 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:56.887546 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:56.887546 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:56.887546 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:56.887546 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:56.887546 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:35:56.887546 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:35:56.887546 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:35:56.888783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:35:56.888783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:56.888783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:56.888783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:56.888783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:56.888783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:56.888783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:56.888783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:56.888783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:56.888783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:56.888783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:56.888783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:56.888783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:56.888783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:56.888783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:56.888783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:56.888783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:56.895388 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:35:56.895388 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:35:56.895388 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:35:56.895388 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:35:56.895388 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 244/503] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:35:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:56.895388 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089f2a6-4305-408a-8cf9-1829c8a60ba3 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:56.895388 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089f2a6-4305-408a-8cf9-1829c8a60ba3 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:56.895388 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089f2a6-4305-408a-8cf9-1829c8a60ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:56.909591 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-4089f2a6-4305-408a-8cf9-1829c8a60ba3 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:35:56.910797 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-4089f2a6-4305-408a-8cf9-1829c8a60ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:35:56.982426 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 245/504] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:35:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:35:56.982426 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089f2a6-4305-408a-8cf9-1829c8a60ba3 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:56.989623 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f439e1-5826-4a69-bef3-83872ef71e29 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:57.007091 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:57.027008 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9468955-c0d1-4e50-9e15-cdadeda2e16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:57.027681 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9468955-c0d1-4e50-9e15-cdadeda2e16f None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:57.027963 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9468955-c0d1-4e50-9e15-cdadeda2e16f None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:57.028237 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9468955-c0d1-4e50-9e15-cdadeda2e16f None admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:57.029125 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9468955-c0d1-4e50-9e15-cdadeda2e16f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:57.029433 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9468955-c0d1-4e50-9e15-cdadeda2e16f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:57.030922 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9468955-c0d1-4e50-9e15-cdadeda2e16f None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:57.067956 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 260/505] 10.222.0.27 () {56 vars in 1137 bytes} [Tue Jul 5 20:35:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:57.068780 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9468955-c0d1-4e50-9e15-cdadeda2e16f None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:57.087976 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089f2a6-4305-408a-8cf9-1829c8a60ba3 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:57.098782 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:57.121972 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b55bd-ca97-4a89-b045-08d891a63501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:57.122673 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b55bd-ca97-4a89-b045-08d891a63501 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:57.122959 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b55bd-ca97-4a89-b045-08d891a63501 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:57.123241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b55bd-ca97-4a89-b045-08d891a63501 None admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:57.124088 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b55bd-ca97-4a89-b045-08d891a63501 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:57.124721 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b55bd-ca97-4a89-b045-08d891a63501 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:57.125895 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b55bd-ca97-4a89-b045-08d891a63501 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:57.162651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 246/506] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Jul 5 20:35:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:57.163505 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b55bd-ca97-4a89-b045-08d891a63501 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:57.171412 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9468955-c0d1-4e50-9e15-cdadeda2e16f None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:57.207855 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1f4b5-a0b1-4ebf-ba93-0766d60a1a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:57.208528 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1f4b5-a0b1-4ebf-ba93-0766d60a1a1b None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:57.208819 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1f4b5-a0b1-4ebf-ba93-0766d60a1a1b None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:57.209095 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1f4b5-a0b1-4ebf-ba93-0766d60a1a1b None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:57.209861 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1f4b5-a0b1-4ebf-ba93-0766d60a1a1b None admin] RBAC: Adding query filter params (name=service) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:57.210171 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1f4b5-a0b1-4ebf-ba93-0766d60a1a1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:57.211580 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1f4b5-a0b1-4ebf-ba93-0766d60a1a1b None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:57.219680 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 261/507] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 5 20:35:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:57.220658 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1f4b5-a0b1-4ebf-ba93-0766d60a1a1b None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:57.248035 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:57.269685 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b55bd-ca97-4a89-b045-08d891a63501 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:57.303731 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc4694-fee3-4183-838a-bf111d31a35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:57.304397 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc4694-fee3-4183-838a-bf111d31a35f None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:57.304677 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc4694-fee3-4183-838a-bf111d31a35f None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:57.304943 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc4694-fee3-4183-838a-bf111d31a35f None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:57.305672 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc4694-fee3-4183-838a-bf111d31a35f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:57.306010 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc4694-fee3-4183-838a-bf111d31a35f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:57.307420 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc4694-fee3-4183-838a-bf111d31a35f None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:57.310462 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:57.318663 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 247/508] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:57.319457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc4694-fee3-4183-838a-bf111d31a35f None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:57.320872 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1f4b5-a0b1-4ebf-ba93-0766d60a1a1b None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:57.356696 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57dafb7-ff6e-4e3b-b37c-bb6112f8ee97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:57.357498 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57dafb7-ff6e-4e3b-b37c-bb6112f8ee97 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:57.357776 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57dafb7-ff6e-4e3b-b37c-bb6112f8ee97 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:57.358088 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57dafb7-ff6e-4e3b-b37c-bb6112f8ee97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:57.368947 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57dafb7-ff6e-4e3b-b37c-bb6112f8ee97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:57.370462 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57dafb7-ff6e-4e3b-b37c-bb6112f8ee97 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:57.387658 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-c57dafb7-ff6e-4e3b-b37c-bb6112f8ee97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:35:57.387658 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:57.387658 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:57.387658 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:57.387658 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:57.387658 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:57.387658 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:57.387658 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:57.387658 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:57.387658 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:57.387658 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:57.387658 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:57.387658 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:35:57.387658 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:35:57.387658 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:35:57.388532 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:35:57.388532 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:57.388532 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:57.388532 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:57.388532 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:57.388532 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:57.388532 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:57.388532 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:57.388532 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:57.388532 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:57.388532 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:57.388532 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:57.388532 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:57.388532 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:57.388532 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:57.388532 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:57.388532 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:57.389377 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:35:57.389377 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:35:57.389377 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:35:57.389377 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:57.390361 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 262/509] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:35:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:57.391192 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57dafb7-ff6e-4e3b-b37c-bb6112f8ee97 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:57.420597 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc4694-fee3-4183-838a-bf111d31a35f None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:57.454329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742a18e-702b-4c6f-8865-96cee9bb4936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:57.454976 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742a18e-702b-4c6f-8865-96cee9bb4936 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:57.455262 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742a18e-702b-4c6f-8865-96cee9bb4936 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:57.455537 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742a18e-702b-4c6f-8865-96cee9bb4936 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:57.463873 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:57.491041 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57dafb7-ff6e-4e3b-b37c-bb6112f8ee97 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:57.521339 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742a18e-702b-4c6f-8865-96cee9bb4936 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:57.522919 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8742a18e-702b-4c6f-8865-96cee9bb4936 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:57.523701 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31c41a-6c8c-484a-b939-ffe1840bcfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:57.524337 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31c41a-6c8c-484a-b939-ffe1840bcfa9 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:57.524649 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31c41a-6c8c-484a-b939-ffe1840bcfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:57.524919 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31c41a-6c8c-484a-b939-ffe1840bcfa9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:57.539513 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:57.596637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31c41a-6c8c-484a-b939-ffe1840bcfa9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:57.598143 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31c41a-6c8c-484a-b939-ffe1840bcfa9 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:57.632719 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 248/510] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:35:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:35:57.633629 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742a18e-702b-4c6f-8865-96cee9bb4936 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:57.671224 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:57.697250 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 263/511] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:35:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:35:57.698141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31c41a-6c8c-484a-b939-ffe1840bcfa9 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:57.736127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742a18e-702b-4c6f-8865-96cee9bb4936 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:57.742186 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:57.769867 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39eaaf-9e9b-4437-8200-cb7bca3e85cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:57.770670 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39eaaf-9e9b-4437-8200-cb7bca3e85cf None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:57.770952 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39eaaf-9e9b-4437-8200-cb7bca3e85cf None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:57.771226 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39eaaf-9e9b-4437-8200-cb7bca3e85cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:57.781194 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39eaaf-9e9b-4437-8200-cb7bca3e85cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:57.782658 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39eaaf-9e9b-4437-8200-cb7bca3e85cf None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:57.799530 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31c41a-6c8c-484a-b939-ffe1840bcfa9 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:57.800106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-fe39eaaf-9e9b-4437-8200-cb7bca3e85cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:35:57.800106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:57.800106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:57.800106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:57.800106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:57.800106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:57.800106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:57.800106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:57.800106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:57.800106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:57.800106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:57.800106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:57.800106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:35:57.800106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:35:57.800106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:35:57.801434 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:35:57.801434 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:57.801434 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:57.801434 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:57.801434 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:57.801434 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:57.801434 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:57.801434 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:57.801434 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:57.801434 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:57.801434 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:57.801434 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:57.801434 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:57.801434 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:57.801434 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:57.801434 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:57.801434 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:57.802451 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:35:57.802451 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:35:57.802451 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:35:57.802451 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:35:57.806182 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 249/512] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:35:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:57.807025 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39eaaf-9e9b-4437-8200-cb7bca3e85cf None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:57.834738 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4c295-17b0-43c3-bd99-a9004f244027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:57.835536 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4c295-17b0-43c3-bd99-a9004f244027 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:57.835816 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4c295-17b0-43c3-bd99-a9004f244027 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:57.836089 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4c295-17b0-43c3-bd99-a9004f244027 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:57.843397 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef4c295-17b0-43c3-bd99-a9004f244027 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:57.845523 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef4c295-17b0-43c3-bd99-a9004f244027 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:57.859923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-bef4c295-17b0-43c3-bd99-a9004f244027 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 20:35:57.859923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:57.859923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:57.859923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:57.859923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:57.859923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:57.859923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:57.859923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:57.859923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:57.859923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:57.859923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:57.859923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:57.859923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:35:57.859923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:35:57.859923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:35:57.859923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:35:57.861033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:57.861033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:57.861033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:35:57.861033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:35:57.861033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:35:57.861033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:35:57.861033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:57.861033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:57.861033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:57.861033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:57.861033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:57.861033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:57.861033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:57.861033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:57.861033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:57.861033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:57.861033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:57.861033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:57.862004 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:57.862004 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:57.862004 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:35:57.862004 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:35:57.862004 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:35:57.862004 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:35:57.862004 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:35:57.862004 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:35:57.862004 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 20:35:57.862004 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:57.862004 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 264/513] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:35:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:57.862004 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4c295-17b0-43c3-bd99-a9004f244027 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:57.903689 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:57.914126 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39eaaf-9e9b-4437-8200-cb7bca3e85cf None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:57.947946 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b092bd-9c30-4c51-bdac-eb3c5f00e987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:57.948677 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b092bd-9c30-4c51-bdac-eb3c5f00e987 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:57.948965 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b092bd-9c30-4c51-bdac-eb3c5f00e987 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:57.949245 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b092bd-9c30-4c51-bdac-eb3c5f00e987 None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:57.950002 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b092bd-9c30-4c51-bdac-eb3c5f00e987 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:57.950336 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b092bd-9c30-4c51-bdac-eb3c5f00e987 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:57.951739 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b092bd-9c30-4c51-bdac-eb3c5f00e987 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:57.962408 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4c295-17b0-43c3-bd99-a9004f244027 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:57.963430 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 250/514] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:57.964036 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:57.964270 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b092bd-9c30-4c51-bdac-eb3c5f00e987 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:57.998617 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b440a6-e9ca-4938-b102-af4e176cf2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:57.999416 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b440a6-e9ca-4938-b102-af4e176cf2e2 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:57.999689 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b440a6-e9ca-4938-b102-af4e176cf2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:57.999957 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b440a6-e9ca-4938-b102-af4e176cf2e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:58.010020 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b440a6-e9ca-4938-b102-af4e176cf2e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:58.011477 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b440a6-e9ca-4938-b102-af4e176cf2e2 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:58.029167 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-22b440a6-e9ca-4938-b102-af4e176cf2e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:35:58.029167 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:58.029167 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:58.029167 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:58.029167 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:58.029167 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:58.029167 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:58.029167 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:58.029167 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:58.029167 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:58.029167 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:58.029167 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:58.029167 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:35:58.029167 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:35:58.029167 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:35:58.030131 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:35:58.030131 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:58.030131 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:58.030131 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:58.030131 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:58.030131 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:58.030131 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:58.030131 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:58.030131 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:58.030131 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:58.030131 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:58.030131 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:58.030131 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:58.030131 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:58.030131 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:58.030131 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:58.030131 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:58.035877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:35:58.035877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:35:58.035877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:35:58.035877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:58.035877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 265/515] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:35:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:58.035877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b440a6-e9ca-4938-b102-af4e176cf2e2 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:58.064751 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b092bd-9c30-4c51-bdac-eb3c5f00e987 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:58.098204 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a5ae5-3b76-4873-b76f-10a91fca2951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:58.098994 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a5ae5-3b76-4873-b76f-10a91fca2951 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:58.099271 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a5ae5-3b76-4873-b76f-10a91fca2951 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:58.099541 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a5ae5-3b76-4873-b76f-10a91fca2951 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:58.110077 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a5ae5-3b76-4873-b76f-10a91fca2951 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:58.111560 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a5ae5-3b76-4873-b76f-10a91fca2951 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:58.129214 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-ff1a5ae5-3b76-4873-b76f-10a91fca2951 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:35:58.129214 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:58.129214 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:58.129214 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:58.129214 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:58.129214 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:58.129214 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:58.129214 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:58.129214 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:58.129214 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:58.129214 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:58.129214 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:58.129214 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:35:58.129214 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:35:58.129214 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:35:58.130245 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:35:58.130245 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:58.130245 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:58.130245 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:58.130245 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:58.130245 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:58.130245 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:58.130245 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:58.130245 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:58.130245 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:58.130245 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:58.130245 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:58.130245 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:58.130245 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:58.130245 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:58.130245 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:58.130245 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:58.131297 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:35:58.131297 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:35:58.131297 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:35:58.131297 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:35:58.131297 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 251/516] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:35:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:58.131297 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a5ae5-3b76-4873-b76f-10a91fca2951 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:58.132823 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b440a6-e9ca-4938-b102-af4e176cf2e2 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:58.134120 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:58.172998 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb3f6c-b92b-4aa9-a5ed-5ae16c90ce1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:58.173667 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb3f6c-b92b-4aa9-a5ed-5ae16c90ce1c None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:58.173981 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb3f6c-b92b-4aa9-a5ed-5ae16c90ce1c None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:58.174259 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb3f6c-b92b-4aa9-a5ed-5ae16c90ce1c None admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:58.174995 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb3f6c-b92b-4aa9-a5ed-5ae16c90ce1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:58.175662 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb3f6c-b92b-4aa9-a5ed-5ae16c90ce1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:58.177049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb3f6c-b92b-4aa9-a5ed-5ae16c90ce1c None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:58.192550 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 266/517] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:58.192550 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb3f6c-b92b-4aa9-a5ed-5ae16c90ce1c None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:58.208065 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:58.229827 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a5ae5-3b76-4873-b76f-10a91fca2951 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:58.264086 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d7dc5-32aa-4fa4-bd95-5bc3ae730da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:58.264708 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d7dc5-32aa-4fa4-bd95-5bc3ae730da8 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:58.265029 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d7dc5-32aa-4fa4-bd95-5bc3ae730da8 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:58.265303 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d7dc5-32aa-4fa4-bd95-5bc3ae730da8 None admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:58.266176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d7dc5-32aa-4fa4-bd95-5bc3ae730da8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:58.266485 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d7dc5-32aa-4fa4-bd95-5bc3ae730da8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:58.267937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d7dc5-32aa-4fa4-bd95-5bc3ae730da8 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:58.285144 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 252/518] 10.222.0.27 () {56 vars in 1137 bytes} [Tue Jul 5 20:35:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:58.285745 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d7dc5-32aa-4fa4-bd95-5bc3ae730da8 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:58.299450 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb3f6c-b92b-4aa9-a5ed-5ae16c90ce1c None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:58.333240 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db51c7-bcae-4b96-82c3-14dba6d0d3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:58.333918 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db51c7-bcae-4b96-82c3-14dba6d0d3c1 None admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:58.334203 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db51c7-bcae-4b96-82c3-14dba6d0d3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:58.334456 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db51c7-bcae-4b96-82c3-14dba6d0d3c1 None admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:58.335151 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db51c7-bcae-4b96-82c3-14dba6d0d3c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:58.336614 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db51c7-bcae-4b96-82c3-14dba6d0d3c1 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:58.342211 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:58.357569 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 267/519] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Jul 5 20:35:58 2022] POST /identity/v3/users => generated 247 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:35:58.358418 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db51c7-bcae-4b96-82c3-14dba6d0d3c1 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:58.385556 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d7dc5-32aa-4fa4-bd95-5bc3ae730da8 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:58.421819 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee9265-f42b-4166-ba36-3046f2181001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:58.422573 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee9265-f42b-4166-ba36-3046f2181001 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:58.422860 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee9265-f42b-4166-ba36-3046f2181001 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:58.423155 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee9265-f42b-4166-ba36-3046f2181001 None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:58.423862 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee9265-f42b-4166-ba36-3046f2181001 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:58.424167 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee9265-f42b-4166-ba36-3046f2181001 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:58.426001 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee9265-f42b-4166-ba36-3046f2181001 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:58.438383 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 253/520] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:58.439251 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee9265-f42b-4166-ba36-3046f2181001 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:58.441489 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:58.481169 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db51c7-bcae-4b96-82c3-14dba6d0d3c1 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:58.519554 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c287dde-de8f-4fb2-b429-2798561aac8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:58.520226 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c287dde-de8f-4fb2-b429-2798561aac8c None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:58.520516 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c287dde-de8f-4fb2-b429-2798561aac8c None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:58.520786 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c287dde-de8f-4fb2-b429-2798561aac8c None admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:58.521521 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c287dde-de8f-4fb2-b429-2798561aac8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:58.521824 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c287dde-de8f-4fb2-b429-2798561aac8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:58.523250 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c287dde-de8f-4fb2-b429-2798561aac8c None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:58.536208 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 268/521] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:58.537128 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c287dde-de8f-4fb2-b429-2798561aac8c None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:58.555803 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee9265-f42b-4166-ba36-3046f2181001 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:58.578959 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:58.595225 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0612281-3a5c-46d0-bd3b-c44e27641f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:58.596032 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0612281-3a5c-46d0-bd3b-c44e27641f89 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:58.596646 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0612281-3a5c-46d0-bd3b-c44e27641f89 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:58.596646 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0612281-3a5c-46d0-bd3b-c44e27641f89 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:58.604754 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0612281-3a5c-46d0-bd3b-c44e27641f89 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:58.606576 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0612281-3a5c-46d0-bd3b-c44e27641f89 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:58.624878 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-b0612281-3a5c-46d0-bd3b-c44e27641f89 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 20:35:58.624878 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:58.624878 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:58.624878 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:58.624878 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:58.624878 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:58.624878 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:58.624878 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:58.624878 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:58.624878 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:58.624878 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:58.624878 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:58.624878 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:35:58.624878 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:35:58.624878 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:35:58.624878 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:35:58.625793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:58.625793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:58.625793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:35:58.625793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:35:58.625793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:35:58.625793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:35:58.625793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:58.625793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:58.625793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:58.625793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:58.625793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:58.625793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:58.625793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:58.625793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:58.625793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:58.625793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:58.625793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:58.625793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:58.627034 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:58.627034 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:58.627034 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:35:58.627034 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:35:58.627034 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:35:58.627034 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:35:58.627034 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:35:58.627034 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:35:58.627034 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 20:35:58.627034 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:35:58.627034 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 254/522] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 5 20:35:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:58.627598 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0612281-3a5c-46d0-bd3b-c44e27641f89 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:58.656566 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c287dde-de8f-4fb2-b429-2798561aac8c None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:58.693113 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:58.699971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854adcd3-e44b-44e8-b258-637e1fd1f66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:58.700739 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854adcd3-e44b-44e8-b258-637e1fd1f66d None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:58.700941 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854adcd3-e44b-44e8-b258-637e1fd1f66d None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:58.701215 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854adcd3-e44b-44e8-b258-637e1fd1f66d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:58.733857 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0612281-3a5c-46d0-bd3b-c44e27641f89 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:58.767269 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e755f-850e-4600-af31-5f0a7483439f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:58.768074 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e755f-850e-4600-af31-5f0a7483439f None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:58.768347 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e755f-850e-4600-af31-5f0a7483439f None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:58.768615 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e755f-850e-4600-af31-5f0a7483439f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:58.775409 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e755f-850e-4600-af31-5f0a7483439f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:58.775590 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854adcd3-e44b-44e8-b258-637e1fd1f66d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:58.776867 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e755f-850e-4600-af31-5f0a7483439f None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:58.777023 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854adcd3-e44b-44e8-b258-637e1fd1f66d None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:58.792379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-fa5e755f-850e-4600-af31-5f0a7483439f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:35:58.792379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:58.792379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:58.792379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:58.792379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:58.792379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:58.792379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:58.792379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:58.792379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:58.792379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:58.792379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:58.792379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:58.792379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:35:58.792379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:35:58.792379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:35:58.793282 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:35:58.793282 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:58.793282 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:58.793282 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:58.793282 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:58.793282 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:58.793282 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:58.793282 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:58.793282 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:58.793282 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:58.793282 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:58.793282 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:58.793282 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:58.793282 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:58.793282 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:58.793282 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:58.793282 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:58.794704 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:35:58.794704 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:35:58.794704 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:35:58.794704 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:35:58.794704 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:35:58.794704 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:35:58.794704 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:35:58.794704 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:35:58.794704 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 255/523] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:35:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:58.794704 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e755f-850e-4600-af31-5f0a7483439f None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:58.842413 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:58.897259 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 269/524] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:35:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:35:58.898586 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854adcd3-e44b-44e8-b258-637e1fd1f66d None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:58.923082 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e755f-850e-4600-af31-5f0a7483439f None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:58.931538 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:58.958878 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794035c-8fb6-4706-8252-0c70c1cf779f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:58.959685 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794035c-8fb6-4706-8252-0c70c1cf779f None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:58.959968 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794035c-8fb6-4706-8252-0c70c1cf779f None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:58.960249 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794035c-8fb6-4706-8252-0c70c1cf779f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:58.967153 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794035c-8fb6-4706-8252-0c70c1cf779f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:58.968635 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794035c-8fb6-4706-8252-0c70c1cf779f None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:58.982264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-0794035c-8fb6-4706-8252-0c70c1cf779f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:35:58.982264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:58.982264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:58.982264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:58.982264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:58.982264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:58.982264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:58.982264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:58.982264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:58.982264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:58.982264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:58.982264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:58.982264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:35:58.982264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:35:58.982264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:35:58.983156 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:35:58.983156 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:58.983156 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:58.983156 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:58.983156 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:58.983156 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:58.983156 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:58.983156 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:58.983156 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:58.983156 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:58.983156 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:58.983156 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:58.983156 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:58.983156 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:58.983156 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:58.983156 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:58.983156 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:58.984009 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:35:58.984009 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:35:58.984009 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:35:58.984009 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:35:58.984009 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:35:58.984009 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:35:58.984009 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:35:58.984009 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:35:58.984009 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 256/525] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:35:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:58.985125 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794035c-8fb6-4706-8252-0c70c1cf779f None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:59.009961 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854adcd3-e44b-44e8-b258-637e1fd1f66d None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:59.048813 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f20e5-8d3c-47f3-ac9a-d87e6362be05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:59.049487 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f20e5-8d3c-47f3-ac9a-d87e6362be05 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:59.049766 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f20e5-8d3c-47f3-ac9a-d87e6362be05 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:59.050103 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f20e5-8d3c-47f3-ac9a-d87e6362be05 None admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:59.051260 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f20e5-8d3c-47f3-ac9a-d87e6362be05 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:59.051571 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f20e5-8d3c-47f3-ac9a-d87e6362be05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:59.053015 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f20e5-8d3c-47f3-ac9a-d87e6362be05 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:59.074486 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 270/526] 10.222.0.27 () {56 vars in 1139 bytes} [Tue Jul 5 20:35:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:59.074486 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f20e5-8d3c-47f3-ac9a-d87e6362be05 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:59.098799 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:59.102570 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794035c-8fb6-4706-8252-0c70c1cf779f None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:59.145453 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549c640-74b6-44df-afaa-9d3647ad20cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:59.146175 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549c640-74b6-44df-afaa-9d3647ad20cb None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:59.146463 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549c640-74b6-44df-afaa-9d3647ad20cb None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:59.146741 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549c640-74b6-44df-afaa-9d3647ad20cb None admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:59.147544 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549c640-74b6-44df-afaa-9d3647ad20cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:59.150007 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549c640-74b6-44df-afaa-9d3647ad20cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:59.151053 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549c640-74b6-44df-afaa-9d3647ad20cb None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:59.162254 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:59.177359 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 257/527] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 5 20:35:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:59.177359 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549c640-74b6-44df-afaa-9d3647ad20cb None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:59.182314 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f20e5-8d3c-47f3-ac9a-d87e6362be05 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:59.220534 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3c320-7950-454d-a1ef-37ae99c34a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:59.221663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3c320-7950-454d-a1ef-37ae99c34a0c None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:59.222574 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3c320-7950-454d-a1ef-37ae99c34a0c None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:59.223024 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3c320-7950-454d-a1ef-37ae99c34a0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:59.234662 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3c320-7950-454d-a1ef-37ae99c34a0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:59.236128 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3c320-7950-454d-a1ef-37ae99c34a0c None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:59.258003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-60d3c320-7950-454d-a1ef-37ae99c34a0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:35:59.258003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:59.258003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:59.258003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:59.258003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:59.258003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:59.258003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:59.258003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:59.258003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:59.258003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:59.258003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:59.258003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:59.258003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:35:59.258003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:35:59.258003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:35:59.258866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:35:59.258866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:59.258866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:59.258866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:59.258866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:59.258866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:59.258866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:59.258866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:59.258866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:59.258866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:59.258866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:59.258866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:59.258866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:59.258866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:59.258866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:59.258866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:59.258866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:59.259801 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:35:59.259801 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:35:59.259801 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:35:59.259801 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:35:59.266412 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 271/528] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:35:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:59.266412 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3c320-7950-454d-a1ef-37ae99c34a0c None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:59.288287 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549c640-74b6-44df-afaa-9d3647ad20cb None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:59.323697 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0278309-0041-4a60-870b-43486cf5ec80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:59.324370 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0278309-0041-4a60-870b-43486cf5ec80 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:59.324651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0278309-0041-4a60-870b-43486cf5ec80 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:59.324935 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0278309-0041-4a60-870b-43486cf5ec80 None admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:59.325757 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0278309-0041-4a60-870b-43486cf5ec80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:59.326093 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0278309-0041-4a60-870b-43486cf5ec80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:59.327563 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0278309-0041-4a60-870b-43486cf5ec80 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:59.339391 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 258/529] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 5 20:35:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:59.340203 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0278309-0041-4a60-870b-43486cf5ec80 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:59.363612 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:59.370681 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3c320-7950-454d-a1ef-37ae99c34a0c None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:59.406583 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd220257-2836-4f72-9254-07f2526157bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:59.407230 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd220257-2836-4f72-9254-07f2526157bb None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:59.407505 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd220257-2836-4f72-9254-07f2526157bb None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:59.407778 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd220257-2836-4f72-9254-07f2526157bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:59.418725 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:59.454817 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0278309-0041-4a60-870b-43486cf5ec80 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:59.478880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd220257-2836-4f72-9254-07f2526157bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:59.480426 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd220257-2836-4f72-9254-07f2526157bb None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:59.491393 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2f8cf-e739-469f-940a-42d365965205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:59.492529 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2f8cf-e739-469f-940a-42d365965205 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:59.492958 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2f8cf-e739-469f-940a-42d365965205 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:59.493232 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2f8cf-e739-469f-940a-42d365965205 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:59.494111 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a2f8cf-e739-469f-940a-42d365965205 None admin] RBAC: Adding query filter params (role.id=4f5057900b094e6fb792884693177cd3, scope.project.id=b321588ec1f14bcb94a184310cf72856, user.id=a05f331339d143c09eaa12efe2b80653) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:59.494415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a2f8cf-e739-469f-940a-42d365965205 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:59.495870 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a2f8cf-e739-469f-940a-42d365965205 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:59.502472 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 259/530] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:35:59 2022] GET /identity/v3/role_assignments?user.id=a05f331339d143c09eaa12efe2b80653&scope.project.id=b321588ec1f14bcb94a184310cf72856&role.id=4f5057900b094e6fb792884693177cd3 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:59.503228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2f8cf-e739-469f-940a-42d365965205 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:59.608858 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 272/531] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:35:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:35:59.609735 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:59.610396 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd220257-2836-4f72-9254-07f2526157bb None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:59.627794 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2f8cf-e739-469f-940a-42d365965205 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:59.658295 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:59.664642 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379e6e6-0f5c-4863-b5a1-f05e7279f49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:59.665320 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379e6e6-0f5c-4863-b5a1-f05e7279f49c None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:59.665656 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379e6e6-0f5c-4863-b5a1-f05e7279f49c None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:59.665980 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379e6e6-0f5c-4863-b5a1-f05e7279f49c None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:59.666760 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379e6e6-0f5c-4863-b5a1-f05e7279f49c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:59.667117 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379e6e6-0f5c-4863-b5a1-f05e7279f49c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:59.668451 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379e6e6-0f5c-4863-b5a1-f05e7279f49c None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:59.682476 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 260/532] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:59.683379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379e6e6-0f5c-4863-b5a1-f05e7279f49c None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:59.721386 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd220257-2836-4f72-9254-07f2526157bb None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:59.755356 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eded9c0-566e-49cd-8f80-70c7084641cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:59.756161 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eded9c0-566e-49cd-8f80-70c7084641cb None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:59.756532 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eded9c0-566e-49cd-8f80-70c7084641cb None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:59.756895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eded9c0-566e-49cd-8f80-70c7084641cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:59.757829 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eded9c0-566e-49cd-8f80-70c7084641cb None admin] RBAC: Adding query filter params (role.id=4f5057900b094e6fb792884693177cd3, scope.project.id=b321588ec1f14bcb94a184310cf72856, user.id=814b675b98b844a2a12a39890ee69d2b) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:35:59.758272 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eded9c0-566e-49cd-8f80-70c7084641cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:59.759813 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eded9c0-566e-49cd-8f80-70c7084641cb None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:59.765990 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 273/533] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:35:59 2022] GET /identity/v3/role_assignments?user.id=814b675b98b844a2a12a39890ee69d2b&scope.project.id=b321588ec1f14bcb94a184310cf72856&role.id=4f5057900b094e6fb792884693177cd3 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:35:59.766889 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eded9c0-566e-49cd-8f80-70c7084641cb None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:59.790741 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379e6e6-0f5c-4863-b5a1-f05e7279f49c None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:59.832864 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bafc3-3c7b-424f-852a-7f466eaed1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:35:59.833728 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bafc3-3c7b-424f-852a-7f466eaed1be None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:35:59.834148 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bafc3-3c7b-424f-852a-7f466eaed1be None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:35:59.834422 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bafc3-3c7b-424f-852a-7f466eaed1be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:35:59.848757 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00bafc3-3c7b-424f-852a-7f466eaed1be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:35:59.848757 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00bafc3-3c7b-424f-852a-7f466eaed1be None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:35:59.850895 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:59.868738 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-f00bafc3-3c7b-424f-852a-7f466eaed1be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:35:59.868738 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:35:59.868738 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:35:59.868738 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:35:59.868738 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:35:59.868738 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:35:59.868738 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:35:59.868738 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:35:59.868738 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:35:59.868738 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:35:59.868738 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:35:59.868738 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:35:59.868738 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:35:59.868738 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:35:59.868738 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:35:59.869880 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:35:59.869880 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:35:59.869880 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:35:59.869880 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:35:59.869880 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:35:59.869880 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:35:59.869880 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:35:59.869880 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:35:59.869880 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:35:59.869880 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:35:59.869880 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:35:59.869880 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:35:59.869880 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:35:59.869880 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:35:59.869880 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:35:59.869880 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:35:59.869880 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:35:59.870947 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:35:59.870947 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:35:59.870947 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:35:59.870947 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:35:59.870947 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 261/534] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:35:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:35:59.878219 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bafc3-3c7b-424f-852a-7f466eaed1be None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:35:59.980979 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eded9c0-566e-49cd-8f80-70c7084641cb None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:35:59.994903 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:35:59.999143 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bafc3-3c7b-424f-852a-7f466eaed1be None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:00.045025 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a41e8c-c185-4a3c-9313-da0b9e1f4683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:00.045874 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a41e8c-c185-4a3c-9313-da0b9e1f4683 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:00.046157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a41e8c-c185-4a3c-9313-da0b9e1f4683 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:00.046522 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a41e8c-c185-4a3c-9313-da0b9e1f4683 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:00.054331 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a41e8c-c185-4a3c-9313-da0b9e1f4683 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:00.054569 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79744a-5a31-45d7-ae17-4f808762aaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:00.055259 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79744a-5a31-45d7-ae17-4f808762aaf3 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:00.055539 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79744a-5a31-45d7-ae17-4f808762aaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:00.055794 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a41e8c-c185-4a3c-9313-da0b9e1f4683 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:00.055898 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79744a-5a31-45d7-ae17-4f808762aaf3 None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:00.056533 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be79744a-5a31-45d7-ae17-4f808762aaf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:00.056836 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be79744a-5a31-45d7-ae17-4f808762aaf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:00.058235 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be79744a-5a31-45d7-ae17-4f808762aaf3 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:00.071089 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-00a41e8c-c185-4a3c-9313-da0b9e1f4683 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:00.071089 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:00.071089 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:00.071089 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:00.071089 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:00.071089 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:00.071089 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:00.071089 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:00.071089 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:00.071089 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:00.071089 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:00.071089 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:00.071089 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:36:00.071089 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:36:00.071089 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:36:00.072151 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:36:00.072151 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:00.072151 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:00.072151 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:00.072151 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:00.072151 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:00.072151 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:00.072151 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:00.072151 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:00.072151 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:00.072151 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:00.072151 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:00.072151 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:00.072151 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:00.072151 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:00.072151 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:00.072151 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:00.073178 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:36:00.073178 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:36:00.073178 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:36:00.073178 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:36:00.073178 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:36:00.073178 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:36:00.073178 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:00.073178 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:00.073178 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 274/535] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:35:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:00.079201 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a41e8c-c185-4a3c-9313-da0b9e1f4683 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:00.084972 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 262/536] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:00.091009 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79744a-5a31-45d7-ae17-4f808762aaf3 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:00.202216 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:00.273261 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a41e8c-c185-4a3c-9313-da0b9e1f4683 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:00.288564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79744a-5a31-45d7-ae17-4f808762aaf3 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:00.343345 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfaa657-789f-4a9f-996b-5dfcf0231ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:00.344013 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfaa657-789f-4a9f-996b-5dfcf0231ff9 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:00.344293 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfaa657-789f-4a9f-996b-5dfcf0231ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:00.344562 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfaa657-789f-4a9f-996b-5dfcf0231ff9 None admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:00.345358 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfaa657-789f-4a9f-996b-5dfcf0231ff9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:00.345663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfaa657-789f-4a9f-996b-5dfcf0231ff9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:00.347148 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfaa657-789f-4a9f-996b-5dfcf0231ff9 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:00.352165 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d0207-1f27-4b38-a18f-528440976db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:00.352977 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d0207-1f27-4b38-a18f-528440976db6 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:00.353257 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d0207-1f27-4b38-a18f-528440976db6 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:00.353533 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d0207-1f27-4b38-a18f-528440976db6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:00.361256 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d0207-1f27-4b38-a18f-528440976db6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:00.362750 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d0207-1f27-4b38-a18f-528440976db6 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:00.378536 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-198d0207-1f27-4b38-a18f-528440976db6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:00.378536 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:00.378536 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:00.378536 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:00.378536 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:00.378536 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:00.378536 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:00.378536 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:00.378536 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:00.378536 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:00.378536 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:00.378536 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:00.378536 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:36:00.378536 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:36:00.378536 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:36:00.379459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:36:00.379459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:00.379459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:00.379459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:00.379459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:00.379459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:00.379459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:00.379459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:00.379459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:00.379459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:00.379459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:00.379459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:00.379459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:00.379459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:00.379459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:00.379459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:00.379459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:00.380368 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:36:00.380368 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:36:00.380368 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:36:00.380368 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:36:00.380368 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:36:00.380368 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:36:00.380368 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:00.380368 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:00.380368 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 263/537] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:36:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:36:00.385259 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d0207-1f27-4b38-a18f-528440976db6 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:00.388016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 275/538] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 5 20:36:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:36:00.394196 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfaa657-789f-4a9f-996b-5dfcf0231ff9 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:00.434936 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:00.554055 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d0207-1f27-4b38-a18f-528440976db6 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:00.560477 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfaa657-789f-4a9f-996b-5dfcf0231ff9 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:00.574225 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:00.594569 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e29f7-049c-4026-ae6f-eb6bfee85101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:00.595560 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e29f7-049c-4026-ae6f-eb6bfee85101 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:00.595943 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e29f7-049c-4026-ae6f-eb6bfee85101 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:00.596290 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e29f7-049c-4026-ae6f-eb6bfee85101 None admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:00.597198 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e29f7-049c-4026-ae6f-eb6bfee85101 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:00.597629 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e29f7-049c-4026-ae6f-eb6bfee85101 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:00.599183 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e29f7-049c-4026-ae6f-eb6bfee85101 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:00.617884 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 264/539] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 5 20:36:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:36:00.617884 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a32ef-2463-40b8-ab2f-c3a3c9dd7001 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:00.617884 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a32ef-2463-40b8-ab2f-c3a3c9dd7001 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:00.617884 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a32ef-2463-40b8-ab2f-c3a3c9dd7001 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:00.617884 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 265/540] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:00.617884 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a32ef-2463-40b8-ab2f-c3a3c9dd7001 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:00.618825 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e878ec-e392-4ff8-aa00-bbd104bd5ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:00.619670 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e878ec-e392-4ff8-aa00-bbd104bd5ff5 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:00.620109 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e878ec-e392-4ff8-aa00-bbd104bd5ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:00.620536 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e878ec-e392-4ff8-aa00-bbd104bd5ff5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:00.621833 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e878ec-e392-4ff8-aa00-bbd104bd5ff5 None admin] RBAC: Adding query filter params (role.id=4f5057900b094e6fb792884693177cd3, scope.project.id=b321588ec1f14bcb94a184310cf72856, user.id=2141561d059043baa440e966a5e1c6cf) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:00.621833 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e878ec-e392-4ff8-aa00-bbd104bd5ff5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:00.627416 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e878ec-e392-4ff8-aa00-bbd104bd5ff5 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:00.638413 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 276/541] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:36:00 2022] GET /identity/v3/role_assignments?user.id=2141561d059043baa440e966a5e1c6cf&scope.project.id=b321588ec1f14bcb94a184310cf72856&role.id=4f5057900b094e6fb792884693177cd3 => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:36:00.639831 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ad5d5-b73e-4181-adef-2bd4420279c6 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:00.640253 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ad5d5-b73e-4181-adef-2bd4420279c6 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:00.640708 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ad5d5-b73e-4181-adef-2bd4420279c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:00.661583 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-7c5ad5d5-b73e-4181-adef-2bd4420279c6 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:00.663305 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-7c5ad5d5-b73e-4181-adef-2bd4420279c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:00.763703 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 277/542] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:36:00.793129 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ad5d5-b73e-4181-adef-2bd4420279c6 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:00.823129 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:00.852649 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a32ef-2463-40b8-ab2f-c3a3c9dd7001 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:00.899304 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77feef-89f2-42de-a520-33488aecff1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:00.900320 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77feef-89f2-42de-a520-33488aecff1b None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:00.900982 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77feef-89f2-42de-a520-33488aecff1b None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:00.901484 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77feef-89f2-42de-a520-33488aecff1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:00.907195 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f77feef-89f2-42de-a520-33488aecff1b None admin] RBAC: Adding query filter params (role.id=4f5057900b094e6fb792884693177cd3, scope.project.id=b321588ec1f14bcb94a184310cf72856, user.id=157a258bcff642cb91a0a474f8f50941) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:00.907195 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f77feef-89f2-42de-a520-33488aecff1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:00.907195 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f77feef-89f2-42de-a520-33488aecff1b None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:00.915479 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 266/543] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:36:00 2022] GET /identity/v3/role_assignments?user.id=157a258bcff642cb91a0a474f8f50941&scope.project.id=b321588ec1f14bcb94a184310cf72856&role.id=4f5057900b094e6fb792884693177cd3 => generated 259 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:00.925119 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ad5d5-b73e-4181-adef-2bd4420279c6 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:00.972583 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fab82-995f-4026-a78c-b55fc7881f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:00.973576 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fab82-995f-4026-a78c-b55fc7881f2e None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:00.974018 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fab82-995f-4026-a78c-b55fc7881f2e None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:00.974393 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fab82-995f-4026-a78c-b55fc7881f2e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:00.990733 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82fab82-995f-4026-a78c-b55fc7881f2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:36:00.999269 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-b82fab82-995f-4026-a78c-b55fc7881f2e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:36:00.999269 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:00.999269 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:00.999269 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:00.999269 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:00.999269 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:00.999269 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:00.999269 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:00.999269 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:00.999269 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:00.999269 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:00.999269 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:00.999269 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:36:00.999269 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:36:00.999269 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:36:00.999269 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:36:01.000436 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:36:01.000436 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:36:01.000436 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:36:01.000436 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:36:01.000436 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:01.000436 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:01.000436 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:01.000436 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:01.000436 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:01.000436 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:01.000436 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:01.000436 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:01.000436 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:01.000436 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:01.000436 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:01.000436 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:01.001435 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:01.001435 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:01.001435 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:01.001435 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:01.001435 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:36:01.001435 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:36:01.001435 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:36:01.001435 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:36:01.001435 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:36:01.001435 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:36:01.001435 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:36:01.001435 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:01.011376 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77feef-89f2-42de-a520-33488aecff1b None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:01.011945 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 278/544] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 5 20:36:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:36:01.071453 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:01.137796 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77feef-89f2-42de-a520-33488aecff1b None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:01.194768 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf783c2d-e963-48e9-8a1b-edbe2daeb48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:01.195540 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf783c2d-e963-48e9-8a1b-edbe2daeb48e None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:01.195918 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf783c2d-e963-48e9-8a1b-edbe2daeb48e None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:01.196395 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf783c2d-e963-48e9-8a1b-edbe2daeb48e None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:01.197254 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf783c2d-e963-48e9-8a1b-edbe2daeb48e None admin] RBAC: Adding query filter params (name=service) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:01.197662 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf783c2d-e963-48e9-8a1b-edbe2daeb48e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:01.199190 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf783c2d-e963-48e9-8a1b-edbe2daeb48e None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:01.213108 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 267/545] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 5 20:36:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:01.218628 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fab82-995f-4026-a78c-b55fc7881f2e None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:01.334324 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:01.368695 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fab82-995f-4026-a78c-b55fc7881f2e None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:01.415767 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03c7a6-6887-4008-97f3-12c3d84a1ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:01.416578 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03c7a6-6887-4008-97f3-12c3d84a1ee2 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:01.416859 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03c7a6-6887-4008-97f3-12c3d84a1ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:01.417131 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03c7a6-6887-4008-97f3-12c3d84a1ee2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:01.438552 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03c7a6-6887-4008-97f3-12c3d84a1ee2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:01.440033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03c7a6-6887-4008-97f3-12c3d84a1ee2 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:01.461156 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-2b03c7a6-6887-4008-97f3-12c3d84a1ee2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:01.461156 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:01.461156 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:01.461156 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:01.461156 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:01.461156 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:01.461156 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:01.461156 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:01.461156 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:01.461156 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:01.461156 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:01.461156 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:01.461156 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:01.461156 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:01.461156 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:01.462081 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:01.462081 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:01.462081 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:01.462081 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:01.462081 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:01.462081 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:01.462081 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:01.462081 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:01.462081 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:01.462081 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:01.462081 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:01.462081 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:01.462081 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:01.462081 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:01.462081 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:01.462081 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:01.462081 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:01.462912 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:01.462912 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:01.462912 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:01.462912 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:01.466553 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 279/546] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:01.472244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf783c2d-e963-48e9-8a1b-edbe2daeb48e None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:01.597282 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf783c2d-e963-48e9-8a1b-edbe2daeb48e None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:01.599330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:01.634353 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f74627d-2f07-4da3-b977-b2c27aac457b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:01.635024 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f74627d-2f07-4da3-b977-b2c27aac457b None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:01.635306 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f74627d-2f07-4da3-b977-b2c27aac457b None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:01.635580 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f74627d-2f07-4da3-b977-b2c27aac457b None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:01.636308 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f74627d-2f07-4da3-b977-b2c27aac457b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:01.636610 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f74627d-2f07-4da3-b977-b2c27aac457b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:01.638104 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f74627d-2f07-4da3-b977-b2c27aac457b None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:01.650700 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 268/547] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:01.660058 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03c7a6-6887-4008-97f3-12c3d84a1ee2 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:01.771456 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879e132-3203-4ae0-a893-9144a6613637 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:01.771639 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879e132-3203-4ae0-a893-9144a6613637 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:01.771913 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879e132-3203-4ae0-a893-9144a6613637 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:01.773820 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 269/548] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:36:01.776669 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03c7a6-6887-4008-97f3-12c3d84a1ee2 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:01.781267 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e89176-547a-4a7b-a789-5314c38d787b None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:01.781267 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e89176-547a-4a7b-a789-5314c38d787b None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:01.781267 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e89176-547a-4a7b-a789-5314c38d787b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:01.799819 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-70e89176-547a-4a7b-a789-5314c38d787b None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:01.801655 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-70e89176-547a-4a7b-a789-5314c38d787b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:01.838268 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:01.845194 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9bfd1-bfaf-422f-b2c1-8c29b8bc4213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:01.846024 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9bfd1-bfaf-422f-b2c1-8c29b8bc4213 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:01.846306 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9bfd1-bfaf-422f-b2c1-8c29b8bc4213 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:01.846661 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9bfd1-bfaf-422f-b2c1-8c29b8bc4213 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:01.862435 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9bfd1-bfaf-422f-b2c1-8c29b8bc4213 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:01.864664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9bfd1-bfaf-422f-b2c1-8c29b8bc4213 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:01.896225 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-4cd9bfd1-bfaf-422f-b2c1-8c29b8bc4213 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 20:36:01.896225 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:01.896225 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:01.896225 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:01.896225 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:01.896225 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:01.896225 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:01.896225 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:01.896225 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:01.896225 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:01.896225 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:01.896225 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:01.896225 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:36:01.896225 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:36:01.896225 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:36:01.896225 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:36:01.897905 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:01.897905 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:01.897905 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:36:01.897905 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:01.897905 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:36:01.897905 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:01.897905 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:01.897905 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:01.897905 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:01.897905 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:01.897905 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:01.897905 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:01.897905 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:01.897905 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:01.897905 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:01.897905 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:01.897905 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:01.897905 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:01.899495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:01.899495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:01.899495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:36:01.899495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:36:01.899495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:36:01.899495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:36:01.899495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:36:01.899495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:36:01.899495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 20:36:01.899495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:01.900254 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 280/549] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 5 20:36:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:01.906222 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9bfd1-bfaf-422f-b2c1-8c29b8bc4213 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:01.939551 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 270/550] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:36:01.982959 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e89176-547a-4a7b-a789-5314c38d787b None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:02.015323 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9bfd1-bfaf-422f-b2c1-8c29b8bc4213 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:02.049499 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aae813-fe16-4d65-b6cb-fb433d9a80e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:02.050125 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aae813-fe16-4d65-b6cb-fb433d9a80e3 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:02.050782 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aae813-fe16-4d65-b6cb-fb433d9a80e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:02.051059 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aae813-fe16-4d65-b6cb-fb433d9a80e3 None admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:02.051907 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aae813-fe16-4d65-b6cb-fb433d9a80e3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:02.052253 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aae813-fe16-4d65-b6cb-fb433d9a80e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:02.053769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aae813-fe16-4d65-b6cb-fb433d9a80e3 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:02.072814 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 281/551] 10.222.0.27 () {56 vars in 1135 bytes} [Tue Jul 5 20:36:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:36:02.078289 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aae813-fe16-4d65-b6cb-fb433d9a80e3 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:02.148689 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:02.149277 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:02.166099 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e89176-547a-4a7b-a789-5314c38d787b None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:02.203978 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc07e62-b77a-4ea1-8dc8-b033dca3ea52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:02.204792 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc07e62-b77a-4ea1-8dc8-b033dca3ea52 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:02.205070 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc07e62-b77a-4ea1-8dc8-b033dca3ea52 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:02.205344 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc07e62-b77a-4ea1-8dc8-b033dca3ea52 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:02.215601 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aae813-fe16-4d65-b6cb-fb433d9a80e3 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:02.215905 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc07e62-b77a-4ea1-8dc8-b033dca3ea52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:36:02.223742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-6bc07e62-b77a-4ea1-8dc8-b033dca3ea52 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:36:02.223742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:02.223742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:02.223742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:02.223742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:02.223742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:02.223742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:02.223742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:02.223742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:02.223742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:02.223742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:02.223742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:02.223742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:36:02.223742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:36:02.223742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:36:02.223742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:36:02.224626 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:36:02.224626 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:36:02.224626 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:36:02.224626 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:36:02.224626 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:02.224626 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:02.224626 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:02.224626 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:02.224626 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:02.224626 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:02.224626 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:02.224626 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:02.224626 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:02.224626 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:02.224626 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:02.224626 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:02.225568 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:02.225568 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:02.225568 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:02.225568 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:02.225568 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:36:02.225568 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:36:02.225568 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:36:02.225568 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:36:02.225568 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:36:02.225568 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:36:02.225568 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:36:02.225568 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:02.229988 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 271/552] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 5 20:36:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:02.231299 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247dd7e-9da5-4597-9419-917be5b49a04 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:02.231646 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247dd7e-9da5-4597-9419-917be5b49a04 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:02.231923 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247dd7e-9da5-4597-9419-917be5b49a04 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:02.233633 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 272/553] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:02.239494 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa021a-b437-4554-b388-f2535c16240c None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:02.239773 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa021a-b437-4554-b388-f2535c16240c None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:02.240044 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa021a-b437-4554-b388-f2535c16240c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:02.252823 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2492b1a0-4800-405d-aa7c-04e3e00ad3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:02.253586 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492b1a0-4800-405d-aa7c-04e3e00ad3e9 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:02.253949 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492b1a0-4800-405d-aa7c-04e3e00ad3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:02.254323 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492b1a0-4800-405d-aa7c-04e3e00ad3e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:02.259562 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-67fa021a-b437-4554-b388-f2535c16240c None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:02.260732 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-67fa021a-b437-4554-b388-f2535c16240c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:02.335770 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2492b1a0-4800-405d-aa7c-04e3e00ad3e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:02.337239 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2492b1a0-4800-405d-aa7c-04e3e00ad3e9 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:02.337512 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 273/554] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:36:02.338383 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa021a-b437-4554-b388-f2535c16240c None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:02.400279 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:02.449369 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:02.464832 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 282/555] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:36:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 05 20:36:02.465525 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2492b1a0-4800-405d-aa7c-04e3e00ad3e9 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:02.475955 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa021a-b437-4554-b388-f2535c16240c None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:02.523302 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c3f4a-cc86-46be-bd2e-ee74ad08e54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:02.524758 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c3f4a-cc86-46be-bd2e-ee74ad08e54a None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:02.525238 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c3f4a-cc86-46be-bd2e-ee74ad08e54a None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:02.525965 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c3f4a-cc86-46be-bd2e-ee74ad08e54a None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:02.527170 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c3f4a-cc86-46be-bd2e-ee74ad08e54a None admin] RBAC: Adding query filter params (name=service) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:02.527972 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c3f4a-cc86-46be-bd2e-ee74ad08e54a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:02.530045 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c3f4a-cc86-46be-bd2e-ee74ad08e54a None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:02.541498 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 274/556] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 5 20:36:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:02.542698 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c3f4a-cc86-46be-bd2e-ee74ad08e54a None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:02.569666 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2492b1a0-4800-405d-aa7c-04e3e00ad3e9 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:02.605479 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e17ec-1f2e-4b1d-a498-a498ef9aefa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:02.606275 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e17ec-1f2e-4b1d-a498-a498ef9aefa8 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:02.606558 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e17ec-1f2e-4b1d-a498-a498ef9aefa8 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:02.606871 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e17ec-1f2e-4b1d-a498-a498ef9aefa8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:02.617682 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e17ec-1f2e-4b1d-a498-a498ef9aefa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:36:02.626026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-fa9e17ec-1f2e-4b1d-a498-a498ef9aefa8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:36:02.626026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:02.626026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:02.626026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:02.626026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:02.626026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:02.626026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:02.626026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:02.626026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:02.626026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:02.626026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:02.626026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:02.626026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:36:02.626026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:36:02.626026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:36:02.626026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:36:02.626937 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:36:02.626937 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:36:02.626937 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:36:02.626937 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:36:02.626937 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:02.626937 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:02.626937 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:02.626937 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:02.626937 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:02.626937 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:02.626937 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:02.626937 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:02.626937 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:02.626937 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:02.626937 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:02.626937 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:02.627766 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:02.627766 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:02.627766 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:02.627766 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:02.627766 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:36:02.627766 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:36:02.627766 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:36:02.627766 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:36:02.627766 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:36:02.627766 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:36:02.627766 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:36:02.627766 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:02.632788 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 283/557] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 5 20:36:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:02.633085 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e17ec-1f2e-4b1d-a498-a498ef9aefa8 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:02.644832 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:02.669704 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c3f4a-cc86-46be-bd2e-ee74ad08e54a None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:02.711605 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757bcef2-5a15-4949-bae7-55db6baa326b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:02.712744 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757bcef2-5a15-4949-bae7-55db6baa326b None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:02.713226 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757bcef2-5a15-4949-bae7-55db6baa326b None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:02.713686 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757bcef2-5a15-4949-bae7-55db6baa326b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:02.729330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757bcef2-5a15-4949-bae7-55db6baa326b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:02.731765 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757bcef2-5a15-4949-bae7-55db6baa326b None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:02.735506 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:02.743594 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e17ec-1f2e-4b1d-a498-a498ef9aefa8 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:02.755384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-757bcef2-5a15-4949-bae7-55db6baa326b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:02.755384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:02.755384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:02.755384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:02.755384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:02.755384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:02.755384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:02.755384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:02.755384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:02.755384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:02.755384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:02.755384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:02.755384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:02.755384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:02.755384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:02.756742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:02.756742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:02.756742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:02.756742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:02.756742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:02.756742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:02.756742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:02.756742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:02.756742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:02.756742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:02.756742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:02.756742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:02.756742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:02.756742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:02.756742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:02.756742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:02.756742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:02.757623 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:02.757623 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:02.757623 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:02.757623 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:02.761633 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 275/558] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:02.762506 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757bcef2-5a15-4949-bae7-55db6baa326b None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:02.786869 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eda367-ec05-4e73-b5f3-aeccfb4719ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:02.788093 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eda367-ec05-4e73-b5f3-aeccfb4719ed None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:02.788580 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eda367-ec05-4e73-b5f3-aeccfb4719ed None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:02.789086 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eda367-ec05-4e73-b5f3-aeccfb4719ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:02.800987 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eda367-ec05-4e73-b5f3-aeccfb4719ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:02.802753 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eda367-ec05-4e73-b5f3-aeccfb4719ed None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:02.820717 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-08eda367-ec05-4e73-b5f3-aeccfb4719ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:02.820717 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:02.820717 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:02.820717 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:02.820717 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:02.820717 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:02.820717 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:02.820717 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:02.820717 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:02.820717 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:02.820717 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:02.820717 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:02.820717 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:02.820717 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:02.820717 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:02.821621 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:02.821621 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:02.821621 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:02.821621 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:02.821621 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:02.821621 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:02.821621 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:02.821621 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:02.821621 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:02.821621 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:02.821621 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:02.821621 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:02.821621 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:02.821621 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:02.821621 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:02.821621 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:02.821621 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:02.822687 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:02.822687 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:02.822687 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:02.822687 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:02.824545 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 284/559] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:02.825734 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eda367-ec05-4e73-b5f3-aeccfb4719ed None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:02.869300 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757bcef2-5a15-4949-bae7-55db6baa326b None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:02.887426 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:02.908625 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755f6bb-2db2-4fab-abc8-2f9b69642f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:02.909307 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755f6bb-2db2-4fab-abc8-2f9b69642f7b None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:02.909586 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755f6bb-2db2-4fab-abc8-2f9b69642f7b None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:02.909878 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755f6bb-2db2-4fab-abc8-2f9b69642f7b None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:02.910633 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7755f6bb-2db2-4fab-abc8-2f9b69642f7b None admin] RBAC: Adding query filter params (name=service) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:02.911238 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7755f6bb-2db2-4fab-abc8-2f9b69642f7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:02.912402 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7755f6bb-2db2-4fab-abc8-2f9b69642f7b None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:02.926171 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 276/560] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 5 20:36:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:02.927058 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755f6bb-2db2-4fab-abc8-2f9b69642f7b None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:02.934176 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eda367-ec05-4e73-b5f3-aeccfb4719ed None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:02.969327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a856a63-89df-4e05-a396-91e433a413e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:02.970425 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a856a63-89df-4e05-a396-91e433a413e5 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:02.970917 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a856a63-89df-4e05-a396-91e433a413e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:02.971436 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a856a63-89df-4e05-a396-91e433a413e5 None admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:02.972348 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a856a63-89df-4e05-a396-91e433a413e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:02.972868 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a856a63-89df-4e05-a396-91e433a413e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:02.974516 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a856a63-89df-4e05-a396-91e433a413e5 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:02.987799 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 285/561] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:02.989005 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a856a63-89df-4e05-a396-91e433a413e5 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:02.996124 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:03.041162 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755f6bb-2db2-4fab-abc8-2f9b69642f7b None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:03.083643 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba98ebf-b76c-4030-a169-a6e385afcf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:03.084361 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba98ebf-b76c-4030-a169-a6e385afcf21 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:03.084614 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba98ebf-b76c-4030-a169-a6e385afcf21 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:03.084895 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba98ebf-b76c-4030-a169-a6e385afcf21 None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:03.085627 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba98ebf-b76c-4030-a169-a6e385afcf21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:03.085979 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba98ebf-b76c-4030-a169-a6e385afcf21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:03.087374 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba98ebf-b76c-4030-a169-a6e385afcf21 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:03.099666 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 277/562] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:03.100488 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba98ebf-b76c-4030-a169-a6e385afcf21 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:03.109711 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a856a63-89df-4e05-a396-91e433a413e5 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:03.131668 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:03.149267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdaa78b-b068-4da1-ae51-bd4cd6b9bdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:03.150114 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdaa78b-b068-4da1-ae51-bd4cd6b9bdc0 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:03.150387 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdaa78b-b068-4da1-ae51-bd4cd6b9bdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:03.150661 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdaa78b-b068-4da1-ae51-bd4cd6b9bdc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:03.161480 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdaa78b-b068-4da1-ae51-bd4cd6b9bdc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:03.162982 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdaa78b-b068-4da1-ae51-bd4cd6b9bdc0 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:03.181159 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-fbdaa78b-b068-4da1-ae51-bd4cd6b9bdc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:03.181159 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:03.181159 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:03.181159 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:03.181159 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:03.181159 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:03.181159 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:03.181159 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:03.181159 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:03.181159 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:03.181159 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:03.181159 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:03.181159 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:03.181159 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:03.181159 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:03.182065 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:03.182065 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:03.182065 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:03.182065 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:03.182065 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:03.182065 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:03.182065 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:03.182065 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:03.182065 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:03.182065 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:03.182065 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:03.182065 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:03.182065 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:03.182065 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:03.182065 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:03.182065 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:03.182065 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:03.182951 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:03.182951 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:03.182951 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:03.182951 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:03.182951 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 286/563] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:03.184247 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196c1e7-2e40-42d8-a512-be676ffe02c2 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:03.184687 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196c1e7-2e40-42d8-a512-be676ffe02c2 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:03.185036 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196c1e7-2e40-42d8-a512-be676ffe02c2 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:03.186514 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 287/564] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:03.187286 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196c1e7-2e40-42d8-a512-be676ffe02c2 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:03.224741 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba98ebf-b76c-4030-a169-a6e385afcf21 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:03.244334 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:03.264337 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad6696c-75f8-4c6f-8b52-2049afd71586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:03.265206 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6696c-75f8-4c6f-8b52-2049afd71586 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:03.265489 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6696c-75f8-4c6f-8b52-2049afd71586 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:03.265810 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6696c-75f8-4c6f-8b52-2049afd71586 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:03.273200 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad6696c-75f8-4c6f-8b52-2049afd71586 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:03.274748 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad6696c-75f8-4c6f-8b52-2049afd71586 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:03.289311 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-cad6696c-75f8-4c6f-8b52-2049afd71586 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:03.289311 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:03.289311 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:03.289311 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:03.289311 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:03.289311 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:03.289311 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:03.289311 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:03.289311 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:03.289311 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:03.289311 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:03.289311 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:03.289311 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:36:03.289311 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:36:03.289311 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:36:03.290228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:36:03.290228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:03.290228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:03.290228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:03.290228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:03.290228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:03.290228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:03.290228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:03.290228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:03.290228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:03.290228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:03.290228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:03.290228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:03.290228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:03.290228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:03.290228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:03.290228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:03.291127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:36:03.291127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:36:03.291127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:36:03.291127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:36:03.291127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:36:03.291127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:36:03.291127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:03.291127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:03.291127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 278/565] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:36:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:03.291604 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad6696c-75f8-4c6f-8b52-2049afd71586 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:03.302678 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196c1e7-2e40-42d8-a512-be676ffe02c2 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:03.342260 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cafc4e4-f857-4b89-9e45-f3adff63cbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:03.343814 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafc4e4-f857-4b89-9e45-f3adff63cbc3 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:03.344355 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafc4e4-f857-4b89-9e45-f3adff63cbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:03.344765 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafc4e4-f857-4b89-9e45-f3adff63cbc3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:03.352824 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cafc4e4-f857-4b89-9e45-f3adff63cbc3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:03.354527 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cafc4e4-f857-4b89-9e45-f3adff63cbc3 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:03.370246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-4cafc4e4-f857-4b89-9e45-f3adff63cbc3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 05 20:36:03.370246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:03.370246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:03.370246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:03.370246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:03.370246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:03.370246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:03.370246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:03.370246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:03.370246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:03.370246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:03.370246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:03.370246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:36:03.370246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:36:03.370246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:36:03.370246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:36:03.371222 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:03.371222 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:03.371222 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:36:03.371222 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:03.371222 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:36:03.371222 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:03.371222 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:03.371222 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:03.371222 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:03.371222 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:03.371222 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:03.371222 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:03.371222 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:03.371222 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:03.371222 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:03.371222 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:03.371222 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:03.371222 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:03.372233 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:03.372233 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:03.372233 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:36:03.372233 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:36:03.372233 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:36:03.372233 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:36:03.372233 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:36:03.372233 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:36:03.372233 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 05 20:36:03.372233 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:03.373288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 288/566] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:36:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:03.374592 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60047073-86fd-48c1-b150-efe794f5de5f None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:03.374805 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60047073-86fd-48c1-b150-efe794f5de5f None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:03.375078 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60047073-86fd-48c1-b150-efe794f5de5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:03.391689 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-60047073-86fd-48c1-b150-efe794f5de5f None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:03.392810 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-60047073-86fd-48c1-b150-efe794f5de5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:03.408932 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad6696c-75f8-4c6f-8b52-2049afd71586 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:03.418825 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:03.448325 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d03e1-6b6d-4d23-8c6b-c64205ea205f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:03.448998 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d03e1-6b6d-4d23-8c6b-c64205ea205f None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:03.449278 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d03e1-6b6d-4d23-8c6b-c64205ea205f None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:03.449553 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d03e1-6b6d-4d23-8c6b-c64205ea205f None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:03.450349 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d03e1-6b6d-4d23-8c6b-c64205ea205f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:03.450652 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d03e1-6b6d-4d23-8c6b-c64205ea205f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:03.452039 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d03e1-6b6d-4d23-8c6b-c64205ea205f None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:03.463743 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 279/567] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:03.464518 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d03e1-6b6d-4d23-8c6b-c64205ea205f None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:03.469970 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 289/568] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:36:03.469970 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60047073-86fd-48c1-b150-efe794f5de5f None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:03.507446 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:03.565765 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60047073-86fd-48c1-b150-efe794f5de5f None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:03.565987 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d03e1-6b6d-4d23-8c6b-c64205ea205f None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:03.597978 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3289ff1-8103-4727-a27c-1cdc9f605964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:03.598413 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cd3be-341c-4a05-883c-4b9af47c699a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:03.598639 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3289ff1-8103-4727-a27c-1cdc9f605964 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:03.598911 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3289ff1-8103-4727-a27c-1cdc9f605964 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:03.599074 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cd3be-341c-4a05-883c-4b9af47c699a None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:03.599179 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3289ff1-8103-4727-a27c-1cdc9f605964 None admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:03.599355 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cd3be-341c-4a05-883c-4b9af47c699a None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:03.599628 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cd3be-341c-4a05-883c-4b9af47c699a None admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:03.599994 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3289ff1-8103-4727-a27c-1cdc9f605964 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:03.600297 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3289ff1-8103-4727-a27c-1cdc9f605964 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:03.600423 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66cd3be-341c-4a05-883c-4b9af47c699a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:03.600727 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66cd3be-341c-4a05-883c-4b9af47c699a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:03.601741 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3289ff1-8103-4727-a27c-1cdc9f605964 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:03.602171 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66cd3be-341c-4a05-883c-4b9af47c699a None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:03.613616 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 280/569] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 5 20:36:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:03.614891 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ddeee-c255-4e53-8b6c-26e304687134 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:03.615176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ddeee-c255-4e53-8b6c-26e304687134 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:03.615454 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ddeee-c255-4e53-8b6c-26e304687134 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:03.620436 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 281/570] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:03.620436 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ddeee-c255-4e53-8b6c-26e304687134 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:03.627041 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 290/571] 10.222.0.27 () {56 vars in 1137 bytes} [Tue Jul 5 20:36:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:03.627041 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3289ff1-8103-4727-a27c-1cdc9f605964 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:03.646485 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:03.712715 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:03.717669 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ddeee-c255-4e53-8b6c-26e304687134 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:03.724522 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3289ff1-8103-4727-a27c-1cdc9f605964 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:03.751266 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee7566-b155-4cf3-b658-91f61d9124e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:03.752058 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee7566-b155-4cf3-b658-91f61d9124e8 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:03.752334 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee7566-b155-4cf3-b658-91f61d9124e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:03.752602 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee7566-b155-4cf3-b658-91f61d9124e8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:03.757476 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15697875-7aab-43d3-b917-c2a8dc7e02bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:03.758296 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15697875-7aab-43d3-b917-c2a8dc7e02bb None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:03.758580 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15697875-7aab-43d3-b917-c2a8dc7e02bb None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:03.758849 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15697875-7aab-43d3-b917-c2a8dc7e02bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:03.759575 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee7566-b155-4cf3-b658-91f61d9124e8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:03.761019 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee7566-b155-4cf3-b658-91f61d9124e8 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:03.768983 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15697875-7aab-43d3-b917-c2a8dc7e02bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:36:03.775127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-edee7566-b155-4cf3-b658-91f61d9124e8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 20:36:03.775127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:03.775127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:03.775127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:03.775127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:03.775127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:03.775127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:03.775127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:03.775127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:03.775127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:03.775127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:03.775127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:03.775127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:36:03.775127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:36:03.775127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:36:03.775127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:36:03.776223 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:03.776223 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:03.776223 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:36:03.776223 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:03.776223 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:36:03.776223 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:03.776223 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:03.776223 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:03.776223 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:03.776223 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:03.776223 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:03.776223 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:03.776223 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:03.776223 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:03.776223 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:03.776223 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:03.776223 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:03.776223 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:03.777291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:03.777291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:03.777291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:36:03.777291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:36:03.777291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:36:03.777291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:36:03.777291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:36:03.777291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:36:03.777291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 20:36:03.777291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:03.777291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 282/572] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Jul 5 20:36:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:03.777902 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-15697875-7aab-43d3-b917-c2a8dc7e02bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:36:03.777902 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:03.777902 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:03.777902 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:03.777902 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:03.777902 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:03.777902 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:03.777902 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:03.777902 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:03.777902 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:03.777902 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:03.777902 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:03.777902 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:36:03.777902 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:36:03.777902 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:36:03.777902 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:36:03.778817 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:36:03.778817 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:36:03.778817 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:36:03.778817 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:36:03.778817 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:03.778817 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:03.778817 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:03.778817 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:03.778817 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:03.778817 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:03.778817 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:03.778817 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:03.778817 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:03.778817 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:03.778817 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:03.778817 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:03.779663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:03.779663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:03.779663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:03.779663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:03.779663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:36:03.779663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:36:03.779663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:36:03.779663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:36:03.779663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:36:03.779663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:36:03.779663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:36:03.779663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:03.780293 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee7566-b155-4cf3-b658-91f61d9124e8 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:03.780377 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 291/573] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 5 20:36:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:03.780377 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97f029-147c-4195-8410-84b2e48294cc None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:03.780377 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97f029-147c-4195-8410-84b2e48294cc None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:03.780377 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97f029-147c-4195-8410-84b2e48294cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:03.796518 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-7a97f029-147c-4195-8410-84b2e48294cc None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:03.797700 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-7a97f029-147c-4195-8410-84b2e48294cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:03.867128 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 292/574] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:36:03.867741 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97f029-147c-4195-8410-84b2e48294cc None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:03.879143 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:03.881884 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee7566-b155-4cf3-b658-91f61d9124e8 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:03.916590 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21e2b9-aed2-4192-b688-eeb5344e0d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:03.917156 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21e2b9-aed2-4192-b688-eeb5344e0d47 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:03.917432 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21e2b9-aed2-4192-b688-eeb5344e0d47 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:03.917677 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21e2b9-aed2-4192-b688-eeb5344e0d47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:03.918563 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21e2b9-aed2-4192-b688-eeb5344e0d47 None admin] RBAC: Adding query filter params (role.id=4f5057900b094e6fb792884693177cd3, scope.project.id=b321588ec1f14bcb94a184310cf72856, user.id=90aa580a2e10467a93c2d79d1906bd8a) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:03.918869 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21e2b9-aed2-4192-b688-eeb5344e0d47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:03.920368 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21e2b9-aed2-4192-b688-eeb5344e0d47 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:03.926025 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 283/575] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:36:03 2022] GET /identity/v3/role_assignments?user.id=90aa580a2e10467a93c2d79d1906bd8a&scope.project.id=b321588ec1f14bcb94a184310cf72856&role.id=4f5057900b094e6fb792884693177cd3 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:03.926803 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21e2b9-aed2-4192-b688-eeb5344e0d47 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:03.971312 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:03.978521 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97f029-147c-4195-8410-84b2e48294cc None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:04.017159 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654643be-0cff-49f7-9f85-421e6547bd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:04.018011 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654643be-0cff-49f7-9f85-421e6547bd20 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:04.018294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654643be-0cff-49f7-9f85-421e6547bd20 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:04.018567 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654643be-0cff-49f7-9f85-421e6547bd20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:04.030397 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654643be-0cff-49f7-9f85-421e6547bd20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:04.031888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654643be-0cff-49f7-9f85-421e6547bd20 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:04.051351 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-654643be-0cff-49f7-9f85-421e6547bd20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:04.051351 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:04.051351 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:04.051351 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:04.051351 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:04.051351 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:04.051351 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:04.051351 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:04.051351 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:04.051351 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:04.051351 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:04.051351 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:04.051351 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:04.051351 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:04.051351 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:04.052325 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:04.052325 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:04.052325 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:04.052325 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:04.052325 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:04.052325 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:04.052325 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:04.052325 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:04.052325 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:04.052325 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:04.052325 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:04.052325 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:04.052325 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:04.052325 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:04.052325 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:04.052325 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:04.052325 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:04.053192 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:04.053192 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:04.053192 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:04.053192 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:04.053192 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 293/576] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:04.053472 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654643be-0cff-49f7-9f85-421e6547bd20 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:04.064523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21e2b9-aed2-4192-b688-eeb5344e0d47 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:04.103622 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a60a8-2376-4295-aa25-0982707f9337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:04.104301 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a60a8-2376-4295-aa25-0982707f9337 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:04.104578 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a60a8-2376-4295-aa25-0982707f9337 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:04.104844 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a60a8-2376-4295-aa25-0982707f9337 None admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:04.105684 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a60a8-2376-4295-aa25-0982707f9337 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:04.106019 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a60a8-2376-4295-aa25-0982707f9337 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:04.107516 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a60a8-2376-4295-aa25-0982707f9337 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:04.119754 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:04.129231 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 284/577] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Jul 5 20:36:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:04.129231 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a60a8-2376-4295-aa25-0982707f9337 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:04.174234 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654643be-0cff-49f7-9f85-421e6547bd20 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:04.210723 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7108c2-b1f6-45f2-972f-d914d04c85ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:04.211400 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7108c2-b1f6-45f2-972f-d914d04c85ef None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:04.211674 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7108c2-b1f6-45f2-972f-d914d04c85ef None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:04.211942 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7108c2-b1f6-45f2-972f-d914d04c85ef None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:04.212676 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7108c2-b1f6-45f2-972f-d914d04c85ef None admin] RBAC: Adding query filter params (name=service) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:04.212976 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7108c2-b1f6-45f2-972f-d914d04c85ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:04.214161 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:04.214381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7108c2-b1f6-45f2-972f-d914d04c85ef None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:04.223249 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 294/578] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 5 20:36:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:04.223937 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7108c2-b1f6-45f2-972f-d914d04c85ef None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:04.239728 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a60a8-2376-4295-aa25-0982707f9337 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:04.276331 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba4090-ffc6-4429-82a9-bb1028c183d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:04.277164 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba4090-ffc6-4429-82a9-bb1028c183d4 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:04.277443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba4090-ffc6-4429-82a9-bb1028c183d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:04.277713 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba4090-ffc6-4429-82a9-bb1028c183d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:04.288256 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba4090-ffc6-4429-82a9-bb1028c183d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:36:04.296155 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-f4ba4090-ffc6-4429-82a9-bb1028c183d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:36:04.296155 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:04.296155 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:04.296155 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:04.296155 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:04.296155 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:04.296155 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:04.296155 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:04.296155 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:04.296155 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:04.296155 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:04.296155 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:04.296155 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:36:04.296155 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:36:04.296155 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:36:04.296155 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:36:04.297207 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:36:04.297207 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:36:04.297207 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:36:04.297207 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:36:04.297207 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:04.297207 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:04.297207 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:04.297207 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:04.297207 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:04.297207 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:04.297207 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:04.297207 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:04.297207 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:04.297207 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:04.297207 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:04.297207 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:04.298139 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:04.298139 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:04.298139 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:04.298139 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:04.298139 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:36:04.298139 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:36:04.298139 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:36:04.298139 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:36:04.298139 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:36:04.298139 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:36:04.298139 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:36:04.298139 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:04.300530 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 285/579] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 5 20:36:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:04.301552 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba4090-ffc6-4429-82a9-bb1028c183d4 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:04.333996 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7108c2-b1f6-45f2-972f-d914d04c85ef None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:04.358470 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:04.369970 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d63ff-19fa-4a47-9e8d-8f45613cd83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:04.370636 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d63ff-19fa-4a47-9e8d-8f45613cd83a None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:04.370914 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d63ff-19fa-4a47-9e8d-8f45613cd83a None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:04.371182 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d63ff-19fa-4a47-9e8d-8f45613cd83a None admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:04.371899 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d63ff-19fa-4a47-9e8d-8f45613cd83a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:04.372230 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d63ff-19fa-4a47-9e8d-8f45613cd83a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:04.373614 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d63ff-19fa-4a47-9e8d-8f45613cd83a None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:04.389831 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 295/580] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:04.389831 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d63ff-19fa-4a47-9e8d-8f45613cd83a None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:04.413648 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba4090-ffc6-4429-82a9-bb1028c183d4 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:04.451876 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32ab76-2f81-4932-8f15-f0e20abb5dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:04.452599 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32ab76-2f81-4932-8f15-f0e20abb5dba None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:04.452876 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32ab76-2f81-4932-8f15-f0e20abb5dba None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:04.453150 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32ab76-2f81-4932-8f15-f0e20abb5dba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:04.461813 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:04.464118 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32ab76-2f81-4932-8f15-f0e20abb5dba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:04.465658 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32ab76-2f81-4932-8f15-f0e20abb5dba None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:04.483651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-2e32ab76-2f81-4932-8f15-f0e20abb5dba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:04.483651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:04.483651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:04.483651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:04.483651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:04.483651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:04.483651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:04.483651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:04.483651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:04.483651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:04.483651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:04.483651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:04.483651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:04.483651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:04.483651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:04.484739 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:04.484739 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:04.484739 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:04.484739 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:04.484739 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:04.484739 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:04.484739 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:04.484739 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:04.484739 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:04.484739 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:04.484739 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:04.484739 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:04.484739 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:04.484739 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:04.484739 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:04.484739 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:04.484739 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:04.485716 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:04.485716 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:04.485716 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:04.485716 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:04.485716 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 286/581] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:04.485716 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32ab76-2f81-4932-8f15-f0e20abb5dba None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:04.498552 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d63ff-19fa-4a47-9e8d-8f45613cd83a None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:04.533285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf4f68-4f76-492a-8f62-b20958622299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:04.534108 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf4f68-4f76-492a-8f62-b20958622299 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:04.534385 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf4f68-4f76-492a-8f62-b20958622299 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:04.534656 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf4f68-4f76-492a-8f62-b20958622299 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:04.545680 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf4f68-4f76-492a-8f62-b20958622299 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:04.547159 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf4f68-4f76-492a-8f62-b20958622299 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:04.565135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-44bf4f68-4f76-492a-8f62-b20958622299 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:04.565135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:04.565135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:04.565135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:04.565135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:04.565135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:04.565135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:04.565135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:04.565135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:04.565135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:04.565135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:04.565135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:04.565135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:04.565135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:04.565135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:04.566105 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:04.566105 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:04.566105 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:04.566105 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:04.566105 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:04.566105 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:04.566105 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:04.566105 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:04.566105 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:04.566105 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:04.566105 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:04.566105 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:04.566105 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:04.566105 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:04.566105 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:04.566105 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:04.566105 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:04.567005 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:04.567005 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:04.567005 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:04.567005 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:04.567005 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 296/582] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:04.567298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf4f68-4f76-492a-8f62-b20958622299 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:04.596336 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32ab76-2f81-4932-8f15-f0e20abb5dba None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:04.603128 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:04.637987 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d6592-cb30-4f50-a075-0870bec6cd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:04.638954 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d6592-cb30-4f50-a075-0870bec6cd15 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:04.639392 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d6592-cb30-4f50-a075-0870bec6cd15 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:04.639669 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d6592-cb30-4f50-a075-0870bec6cd15 None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:04.640432 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d6592-cb30-4f50-a075-0870bec6cd15 None admin] RBAC: Adding query filter params (name=service) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:04.640828 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d6592-cb30-4f50-a075-0870bec6cd15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:04.642138 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d6592-cb30-4f50-a075-0870bec6cd15 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:04.656245 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 287/583] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 5 20:36:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:04.656245 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d6592-cb30-4f50-a075-0870bec6cd15 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:04.678824 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf4f68-4f76-492a-8f62-b20958622299 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:04.712580 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:04.714286 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a94b37-4cf1-45a9-a8a8-327903c8da28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:04.715162 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a94b37-4cf1-45a9-a8a8-327903c8da28 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:04.715440 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a94b37-4cf1-45a9-a8a8-327903c8da28 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:04.715777 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a94b37-4cf1-45a9-a8a8-327903c8da28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:04.722663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a94b37-4cf1-45a9-a8a8-327903c8da28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:04.724105 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a94b37-4cf1-45a9-a8a8-327903c8da28 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:04.737541 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-b8a94b37-4cf1-45a9-a8a8-327903c8da28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:04.737541 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:04.737541 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:04.737541 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:04.737541 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:04.737541 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:04.737541 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:04.737541 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:04.737541 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:04.737541 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:04.737541 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:04.737541 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:04.737541 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:36:04.737541 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:36:04.737541 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:36:04.738610 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:36:04.738610 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:04.738610 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:04.738610 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:04.738610 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:04.738610 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:04.738610 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:04.738610 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:04.738610 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:04.738610 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:04.738610 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:04.738610 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:04.738610 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:04.738610 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:04.738610 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:04.738610 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:04.738610 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:04.739475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:36:04.739475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:36:04.739475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:36:04.739475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:36:04.739475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:36:04.739475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:36:04.739475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:04.739475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:04.739475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 297/584] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:36:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:04.739475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a94b37-4cf1-45a9-a8a8-327903c8da28 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:04.762727 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d6592-cb30-4f50-a075-0870bec6cd15 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:04.798022 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd360e-9283-44bf-b5b5-286bb07bf6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:04.798591 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd360e-9283-44bf-b5b5-286bb07bf6aa None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:04.798947 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd360e-9283-44bf-b5b5-286bb07bf6aa None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:04.799137 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd360e-9283-44bf-b5b5-286bb07bf6aa None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:04.799882 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd360e-9283-44bf-b5b5-286bb07bf6aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:04.800508 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd360e-9283-44bf-b5b5-286bb07bf6aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:04.801910 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd360e-9283-44bf-b5b5-286bb07bf6aa None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:04.813825 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 288/585] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:04.814628 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd360e-9283-44bf-b5b5-286bb07bf6aa None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:04.844088 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:04.851959 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a94b37-4cf1-45a9-a8a8-327903c8da28 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:04.887223 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f676a7-d18d-4440-8765-2e9efb7e7ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:04.887916 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f676a7-d18d-4440-8765-2e9efb7e7ea8 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:04.888190 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f676a7-d18d-4440-8765-2e9efb7e7ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:04.888460 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f676a7-d18d-4440-8765-2e9efb7e7ea8 None admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:04.889188 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f676a7-d18d-4440-8765-2e9efb7e7ea8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:04.889476 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f676a7-d18d-4440-8765-2e9efb7e7ea8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:04.890901 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f676a7-d18d-4440-8765-2e9efb7e7ea8 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:04.903680 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 298/586] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:04.904414 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f676a7-d18d-4440-8765-2e9efb7e7ea8 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:04.929764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd360e-9283-44bf-b5b5-286bb07bf6aa None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:04.948163 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:04.972334 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050afbf0-8bc3-41f0-a872-0db77dac5fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:04.973065 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050afbf0-8bc3-41f0-a872-0db77dac5fda None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:04.973352 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050afbf0-8bc3-41f0-a872-0db77dac5fda None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:04.973631 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050afbf0-8bc3-41f0-a872-0db77dac5fda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:04.984076 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050afbf0-8bc3-41f0-a872-0db77dac5fda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:04.985566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050afbf0-8bc3-41f0-a872-0db77dac5fda None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:05.003512 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-050afbf0-8bc3-41f0-a872-0db77dac5fda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:05.003512 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:05.003512 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:05.003512 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:05.003512 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:05.003512 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:05.003512 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:05.003512 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:05.003512 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:05.003512 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:05.003512 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:05.003512 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:05.003512 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:05.003512 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:05.003512 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:05.004415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:05.004415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:05.004415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:05.004415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:05.004415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:05.004415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:05.004415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:05.004415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:05.004415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:05.004415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:05.004415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:05.004415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:05.004415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:05.004415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:05.004415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:05.004415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:05.004415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:05.005289 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:05.005289 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:05.005289 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:05.005289 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:05.005289 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 289/587] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:05.005577 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050afbf0-8bc3-41f0-a872-0db77dac5fda None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:05.021856 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f676a7-d18d-4440-8765-2e9efb7e7ea8 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:05.058781 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6bc6c5-2ea7-41ba-91e2-cb1b57a46d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:05.059467 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6bc6c5-2ea7-41ba-91e2-cb1b57a46d20 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:05.059788 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6bc6c5-2ea7-41ba-91e2-cb1b57a46d20 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:05.060167 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6bc6c5-2ea7-41ba-91e2-cb1b57a46d20 None admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:05.061081 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6bc6c5-2ea7-41ba-91e2-cb1b57a46d20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:05.061392 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6bc6c5-2ea7-41ba-91e2-cb1b57a46d20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:05.062923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6bc6c5-2ea7-41ba-91e2-cb1b57a46d20 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:05.081815 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 299/588] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 5 20:36:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:05.081815 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6bc6c5-2ea7-41ba-91e2-cb1b57a46d20 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:05.099448 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:05.120228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050afbf0-8bc3-41f0-a872-0db77dac5fda None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:05.161625 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98bd8e-5e6e-4321-ab6a-bf717d790794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:05.163239 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98bd8e-5e6e-4321-ab6a-bf717d790794 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:05.163516 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98bd8e-5e6e-4321-ab6a-bf717d790794 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:05.163800 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98bd8e-5e6e-4321-ab6a-bf717d790794 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:05.172339 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b98bd8e-5e6e-4321-ab6a-bf717d790794 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:05.174119 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b98bd8e-5e6e-4321-ab6a-bf717d790794 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:05.190090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-3b98bd8e-5e6e-4321-ab6a-bf717d790794 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:05.190090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:05.190090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:05.190090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:05.190090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:05.190090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:05.190090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:05.190090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:05.190090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:05.190090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:05.190090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:05.190090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:05.190090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:36:05.190090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:36:05.190090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:36:05.191006 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:36:05.191006 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:05.191006 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:05.191006 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:05.191006 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:05.191006 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:05.191006 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:05.191006 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:05.191006 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:05.191006 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:05.191006 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:05.191006 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:05.191006 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:05.191006 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:05.191006 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:05.191006 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:05.191006 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:05.192040 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:36:05.192040 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:36:05.192040 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:36:05.192040 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:36:05.192040 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:36:05.192040 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:36:05.192040 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:05.192040 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:05.192040 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 290/589] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:36:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:05.192040 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98bd8e-5e6e-4321-ab6a-bf717d790794 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:05.198370 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6bc6c5-2ea7-41ba-91e2-cb1b57a46d20 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:05.223431 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:05.234925 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db6c95-88f2-4570-a4db-b0a88a0cc166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:05.235976 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db6c95-88f2-4570-a4db-b0a88a0cc166 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:05.236465 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db6c95-88f2-4570-a4db-b0a88a0cc166 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:05.236961 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db6c95-88f2-4570-a4db-b0a88a0cc166 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:05.244948 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29db6c95-88f2-4570-a4db-b0a88a0cc166 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:05.246665 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29db6c95-88f2-4570-a4db-b0a88a0cc166 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:05.261049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-29db6c95-88f2-4570-a4db-b0a88a0cc166 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 20:36:05.261049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:05.261049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:05.261049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:05.261049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:05.261049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:05.261049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:05.261049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:05.261049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:05.261049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:05.261049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:05.261049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:05.261049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:36:05.261049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:36:05.261049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:36:05.261049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:36:05.262214 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:05.262214 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:05.262214 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:36:05.262214 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:05.262214 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:36:05.262214 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:05.262214 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:05.262214 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:05.262214 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:05.262214 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:05.262214 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:05.262214 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:05.262214 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:05.262214 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:05.262214 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:05.262214 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:05.262214 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:05.262214 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:05.263458 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:05.263458 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:05.263458 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:36:05.263458 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:36:05.263458 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:36:05.263458 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:36:05.263458 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:36:05.263458 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:36:05.263458 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 20:36:05.263458 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:05.265349 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 300/590] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:36:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:05.266373 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db6c95-88f2-4570-a4db-b0a88a0cc166 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:05.304458 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98bd8e-5e6e-4321-ab6a-bf717d790794 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:05.340283 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e9189-6bdf-4ce5-bc90-308edb3b46be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:05.340987 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e9189-6bdf-4ce5-bc90-308edb3b46be None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:05.341273 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e9189-6bdf-4ce5-bc90-308edb3b46be None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:05.341557 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e9189-6bdf-4ce5-bc90-308edb3b46be None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:05.342314 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e9189-6bdf-4ce5-bc90-308edb3b46be None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:05.342625 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e9189-6bdf-4ce5-bc90-308edb3b46be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:05.344015 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e9189-6bdf-4ce5-bc90-308edb3b46be None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:05.347858 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:05.360366 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 291/591] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:05.361119 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e9189-6bdf-4ce5-bc90-308edb3b46be None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:05.372613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db6c95-88f2-4570-a4db-b0a88a0cc166 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:05.409474 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616065f-882e-4bf5-9798-8a9e5facf95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:05.410555 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616065f-882e-4bf5-9798-8a9e5facf95b None admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:05.410935 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616065f-882e-4bf5-9798-8a9e5facf95b None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:05.411308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616065f-882e-4bf5-9798-8a9e5facf95b None admin] PATH_INFO: `/v3/projects/b321588ec1f14bcb94a184310cf72856/users/a05f331339d143c09eaa12efe2b80653/roles/4f5057900b094e6fb792884693177cd3` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:05.428104 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2616065f-882e-4bf5-9798-8a9e5facf95b None admin] RBAC: Authorizing `identity:create_grant(project_id=b321588ec1f14bcb94a184310cf72856, user_id=a05f331339d143c09eaa12efe2b80653, role_id=4f5057900b094e6fb792884693177cd3)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:05.429656 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2616065f-882e-4bf5-9798-8a9e5facf95b None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:05.451269 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 301/592] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 5 20:36:05 2022] PUT /identity/v3/projects/b321588ec1f14bcb94a184310cf72856/users/a05f331339d143c09eaa12efe2b80653/roles/4f5057900b094e6fb792884693177cd3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:36:05.451269 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616065f-882e-4bf5-9798-8a9e5facf95b None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:05.459072 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:05.472268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e9189-6bdf-4ce5-bc90-308edb3b46be None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:05.511860 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b81d2c-e352-4547-a9cc-a4bedf06541e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:05.512603 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b81d2c-e352-4547-a9cc-a4bedf06541e None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:05.512955 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b81d2c-e352-4547-a9cc-a4bedf06541e None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:05.513295 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b81d2c-e352-4547-a9cc-a4bedf06541e None admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:05.514222 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b81d2c-e352-4547-a9cc-a4bedf06541e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:05.514593 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b81d2c-e352-4547-a9cc-a4bedf06541e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:05.516165 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b81d2c-e352-4547-a9cc-a4bedf06541e None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:05.534265 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 292/593] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 5 20:36:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:05.535352 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b81d2c-e352-4547-a9cc-a4bedf06541e None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:05.581085 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616065f-882e-4bf5-9798-8a9e5facf95b None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:05.611526 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:05.624755 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4080d7f-035c-4f1d-b154-4e46a8cbf061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:05.625424 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4080d7f-035c-4f1d-b154-4e46a8cbf061 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:05.626555 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4080d7f-035c-4f1d-b154-4e46a8cbf061 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:05.626930 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4080d7f-035c-4f1d-b154-4e46a8cbf061 None admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:05.627894 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4080d7f-035c-4f1d-b154-4e46a8cbf061 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:05.628303 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4080d7f-035c-4f1d-b154-4e46a8cbf061 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:05.629873 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4080d7f-035c-4f1d-b154-4e46a8cbf061 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:05.656284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 302/594] 10.222.0.27 () {56 vars in 1137 bytes} [Tue Jul 5 20:36:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:05.657113 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4080d7f-035c-4f1d-b154-4e46a8cbf061 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:05.676538 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b81d2c-e352-4547-a9cc-a4bedf06541e None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:05.719214 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ce941-85d6-449b-a658-7e541923697e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:05.720307 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ce941-85d6-449b-a658-7e541923697e None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:05.721159 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ce941-85d6-449b-a658-7e541923697e None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:05.721588 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ce941-85d6-449b-a658-7e541923697e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:05.732196 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ce941-85d6-449b-a658-7e541923697e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:05.733940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ce941-85d6-449b-a658-7e541923697e None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:05.752903 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-389ce941-85d6-449b-a658-7e541923697e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 20:36:05.752903 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:05.752903 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:05.752903 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:05.752903 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:05.752903 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:05.752903 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:05.752903 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:05.752903 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:05.752903 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:05.752903 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:05.752903 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:05.752903 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:36:05.752903 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:36:05.752903 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:36:05.752903 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:36:05.754091 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:05.754091 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:05.754091 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:36:05.754091 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:05.754091 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:36:05.754091 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:05.754091 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:05.754091 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:05.754091 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:05.754091 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:05.754091 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:05.754091 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:05.754091 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:05.754091 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:05.754091 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:05.754091 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:05.754091 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:05.754091 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:05.755271 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:05.755271 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:05.755271 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:36:05.755271 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:36:05.755271 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:36:05.755271 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:36:05.755271 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:36:05.755271 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:36:05.755271 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 20:36:05.755271 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:05.757955 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 293/595] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 5 20:36:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:05.758983 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ce941-85d6-449b-a658-7e541923697e None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:05.770830 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:05.775474 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4080d7f-035c-4f1d-b154-4e46a8cbf061 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:05.822117 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3499e3e-3254-4bba-bb05-5fe09b1fbf53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:05.823023 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3499e3e-3254-4bba-bb05-5fe09b1fbf53 None admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:05.823306 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3499e3e-3254-4bba-bb05-5fe09b1fbf53 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:05.823582 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3499e3e-3254-4bba-bb05-5fe09b1fbf53 None admin] PATH_INFO: `/v3/projects/b321588ec1f14bcb94a184310cf72856/users/814b675b98b844a2a12a39890ee69d2b/roles/4f5057900b094e6fb792884693177cd3` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:05.843506 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3499e3e-3254-4bba-bb05-5fe09b1fbf53 None admin] RBAC: Authorizing `identity:create_grant(project_id=b321588ec1f14bcb94a184310cf72856, user_id=814b675b98b844a2a12a39890ee69d2b, role_id=4f5057900b094e6fb792884693177cd3)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:05.845381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3499e3e-3254-4bba-bb05-5fe09b1fbf53 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:05.869869 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 303/596] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 5 20:36:05 2022] PUT /identity/v3/projects/b321588ec1f14bcb94a184310cf72856/users/814b675b98b844a2a12a39890ee69d2b/roles/4f5057900b094e6fb792884693177cd3 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:36:05.869869 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3499e3e-3254-4bba-bb05-5fe09b1fbf53 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:05.892334 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ce941-85d6-449b-a658-7e541923697e None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:05.942456 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:05.950160 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf3d90-879b-4bb0-bf84-97d8095c4613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:05.951305 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf3d90-879b-4bb0-bf84-97d8095c4613 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:05.951305 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf3d90-879b-4bb0-bf84-97d8095c4613 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:05.951759 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf3d90-879b-4bb0-bf84-97d8095c4613 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:05.964630 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf3d90-879b-4bb0-bf84-97d8095c4613 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:05.965836 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edf3d90-879b-4bb0-bf84-97d8095c4613 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:05.985379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-1edf3d90-879b-4bb0-bf84-97d8095c4613 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:05.985379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:05.985379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:05.985379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:05.985379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:05.985379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:05.985379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:05.985379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:05.985379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:05.985379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:05.985379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:05.985379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:05.985379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:05.985379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:05.985379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:05.986443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:05.986443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:05.986443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:05.986443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:05.986443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:05.986443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:05.986443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:05.986443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:05.986443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:05.986443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:05.986443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:05.986443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:05.986443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:05.986443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:05.986443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:05.986443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:05.986443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:05.987335 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:05.987335 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:05.987335 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:05.987335 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:05.987335 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 294/597] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:05.988367 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7cb2e5-0e82-4f02-a130-1a8d031a15c1 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:05.988648 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7cb2e5-0e82-4f02-a130-1a8d031a15c1 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:05.988923 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7cb2e5-0e82-4f02-a130-1a8d031a15c1 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:05.995220 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 295/598] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:05.996216 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7cb2e5-0e82-4f02-a130-1a8d031a15c1 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:06.032146 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3499e3e-3254-4bba-bb05-5fe09b1fbf53 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:06.074550 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ede02-f667-40d3-a164-b3991bc98191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:06.075460 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ede02-f667-40d3-a164-b3991bc98191 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:06.075745 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ede02-f667-40d3-a164-b3991bc98191 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:06.076023 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ede02-f667-40d3-a164-b3991bc98191 None admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:06.077362 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ede02-f667-40d3-a164-b3991bc98191 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:06.077687 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ede02-f667-40d3-a164-b3991bc98191 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:06.079498 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ede02-f667-40d3-a164-b3991bc98191 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:06.080602 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:06.101616 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 304/599] 10.222.0.27 () {56 vars in 1139 bytes} [Tue Jul 5 20:36:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:06.103433 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f1264-11c2-4eb0-9911-3ee7d402b548 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:06.103722 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f1264-11c2-4eb0-9911-3ee7d402b548 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:06.104000 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f1264-11c2-4eb0-9911-3ee7d402b548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:06.116163 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7cb2e5-0e82-4f02-a130-1a8d031a15c1 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:06.125078 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-b99f1264-11c2-4eb0-9911-3ee7d402b548 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:06.126763 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-b99f1264-11c2-4eb0-9911-3ee7d402b548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:06.160262 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37207c-c100-4e04-bf9c-9987fd065bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:06.161084 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37207c-c100-4e04-bf9c-9987fd065bdc None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:06.161467 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37207c-c100-4e04-bf9c-9987fd065bdc None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:06.161869 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37207c-c100-4e04-bf9c-9987fd065bdc None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:06.162714 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37207c-c100-4e04-bf9c-9987fd065bdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:06.163125 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37207c-c100-4e04-bf9c-9987fd065bdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:06.164626 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37207c-c100-4e04-bf9c-9987fd065bdc None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:06.178090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 296/600] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:06.183264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37207c-c100-4e04-bf9c-9987fd065bdc None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:06.224940 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 305/601] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:36:06.226002 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f1264-11c2-4eb0-9911-3ee7d402b548 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:06.259512 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:06.296111 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37207c-c100-4e04-bf9c-9987fd065bdc None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:06.315390 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:06.333547 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84412bdf-2c5c-476a-ad27-c4000d9265f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:06.333754 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84412bdf-2c5c-476a-ad27-c4000d9265f3 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:06.334035 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84412bdf-2c5c-476a-ad27-c4000d9265f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:06.334611 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84412bdf-2c5c-476a-ad27-c4000d9265f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:06.346108 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84412bdf-2c5c-476a-ad27-c4000d9265f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:06.347771 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84412bdf-2c5c-476a-ad27-c4000d9265f3 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:06.366500 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-84412bdf-2c5c-476a-ad27-c4000d9265f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:06.366500 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:06.366500 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:06.366500 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:06.366500 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:06.366500 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:06.366500 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:06.366500 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:06.366500 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:06.366500 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:06.366500 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:06.366500 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:06.366500 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:06.366500 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:06.366500 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:06.367657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:06.367657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:06.367657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:06.367657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:06.367657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:06.367657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:06.367657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:06.367657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:06.367657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:06.367657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:06.367657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:06.367657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:06.367657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:06.367657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:06.367657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:06.367657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:06.367657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:06.368790 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:06.368790 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:06.368790 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:06.368790 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:06.370370 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 297/602] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:06.371355 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84412bdf-2c5c-476a-ad27-c4000d9265f3 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:06.373086 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f1264-11c2-4eb0-9911-3ee7d402b548 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:06.424695 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de03771-6d05-4a9c-adc6-4e1f7e6fbe44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:06.426869 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de03771-6d05-4a9c-adc6-4e1f7e6fbe44 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:06.427381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de03771-6d05-4a9c-adc6-4e1f7e6fbe44 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:06.427853 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de03771-6d05-4a9c-adc6-4e1f7e6fbe44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:06.438163 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de03771-6d05-4a9c-adc6-4e1f7e6fbe44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:06.441101 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de03771-6d05-4a9c-adc6-4e1f7e6fbe44 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:06.460679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-9de03771-6d05-4a9c-adc6-4e1f7e6fbe44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:06.460679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:06.460679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:06.460679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:06.460679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:06.460679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:06.460679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:06.460679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:06.460679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:06.460679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:06.460679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:06.460679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:06.460679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:36:06.460679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:36:06.460679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:36:06.461809 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:36:06.461809 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:06.461809 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:06.461809 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:06.461809 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:06.461809 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:06.461809 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:06.461809 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:06.461809 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:06.461809 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:06.461809 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:06.461809 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:06.461809 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:06.461809 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:06.461809 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:06.461809 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:06.461809 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:06.462942 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:36:06.462942 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:36:06.462942 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:36:06.462942 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:36:06.462942 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:36:06.462942 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:36:06.462942 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:06.462942 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:06.465028 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 306/603] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:36:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:06.466197 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de03771-6d05-4a9c-adc6-4e1f7e6fbe44 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:06.490638 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84412bdf-2c5c-476a-ad27-c4000d9265f3 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:06.536641 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ea284-5898-48b6-a9df-d825fee482e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:06.538065 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ea284-5898-48b6-a9df-d825fee482e0 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:06.538528 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ea284-5898-48b6-a9df-d825fee482e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:06.539242 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ea284-5898-48b6-a9df-d825fee482e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:06.554824 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ea284-5898-48b6-a9df-d825fee482e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:36:06.564905 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:06.566331 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-fc9ea284-5898-48b6-a9df-d825fee482e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:36:06.566331 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:06.566331 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:06.566331 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:06.566331 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:06.566331 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:06.566331 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:06.566331 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:06.566331 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:06.566331 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:06.566331 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:06.566331 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:06.566331 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:36:06.566331 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:36:06.566331 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:36:06.566331 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:36:06.568145 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:36:06.568145 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:36:06.568145 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:36:06.568145 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:36:06.568145 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:06.568145 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:06.568145 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:06.568145 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:06.568145 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:06.568145 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:06.568145 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:06.568145 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:06.568145 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:06.568145 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:06.568145 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:06.568145 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:06.569098 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:06.569098 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:06.569098 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:06.569098 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:06.569098 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:36:06.569098 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:36:06.569098 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:36:06.569098 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:36:06.569098 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:36:06.569098 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:36:06.569098 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:36:06.569098 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:06.577041 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 298/604] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 5 20:36:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:06.578468 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ea284-5898-48b6-a9df-d825fee482e0 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:06.589938 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de03771-6d05-4a9c-adc6-4e1f7e6fbe44 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:06.616012 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:06.631011 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3768fe-553e-45f9-a4ac-5817dc5134cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:06.632109 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3768fe-553e-45f9-a4ac-5817dc5134cb None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:06.632388 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3768fe-553e-45f9-a4ac-5817dc5134cb None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:06.632716 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3768fe-553e-45f9-a4ac-5817dc5134cb None admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:06.633819 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3768fe-553e-45f9-a4ac-5817dc5134cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:06.634157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3768fe-553e-45f9-a4ac-5817dc5134cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:06.635770 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3768fe-553e-45f9-a4ac-5817dc5134cb None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:06.650298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 307/605] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:06.651240 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3768fe-553e-45f9-a4ac-5817dc5134cb None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:06.695966 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ea284-5898-48b6-a9df-d825fee482e0 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:06.730928 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75401017-b6b2-4e5d-840f-cd9f31c9509f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:06.731646 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75401017-b6b2-4e5d-840f-cd9f31c9509f None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:06.731923 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75401017-b6b2-4e5d-840f-cd9f31c9509f None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:06.732195 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75401017-b6b2-4e5d-840f-cd9f31c9509f None admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:06.732978 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75401017-b6b2-4e5d-840f-cd9f31c9509f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:06.733282 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75401017-b6b2-4e5d-840f-cd9f31c9509f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:06.734862 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75401017-b6b2-4e5d-840f-cd9f31c9509f None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:06.748447 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 299/606] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 5 20:36:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:06.749464 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75401017-b6b2-4e5d-840f-cd9f31c9509f None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:06.761671 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3768fe-553e-45f9-a4ac-5817dc5134cb None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:06.798978 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b156ddb-7113-4da7-ba99-b4183a7d5c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:06.799657 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b156ddb-7113-4da7-ba99-b4183a7d5c09 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:06.799940 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b156ddb-7113-4da7-ba99-b4183a7d5c09 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:06.800665 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b156ddb-7113-4da7-ba99-b4183a7d5c09 None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:06.801514 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b156ddb-7113-4da7-ba99-b4183a7d5c09 None admin] RBAC: Adding query filter params (name=service) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:06.801823 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b156ddb-7113-4da7-ba99-b4183a7d5c09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:06.803241 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b156ddb-7113-4da7-ba99-b4183a7d5c09 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:06.817092 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 308/607] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 5 20:36:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:06.818009 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b156ddb-7113-4da7-ba99-b4183a7d5c09 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:06.821734 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:06.845879 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:06.857050 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75401017-b6b2-4e5d-840f-cd9f31c9509f None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:06.893471 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d9890-bf1d-4147-87ce-f8c37c6580f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:06.894590 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d9890-bf1d-4147-87ce-f8c37c6580f5 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:06.895037 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d9890-bf1d-4147-87ce-f8c37c6580f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:06.895519 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d9890-bf1d-4147-87ce-f8c37c6580f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:06.903734 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d9890-bf1d-4147-87ce-f8c37c6580f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:06.905539 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d9890-bf1d-4147-87ce-f8c37c6580f5 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:06.920856 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-015d9890-bf1d-4147-87ce-f8c37c6580f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:06.920856 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:06.920856 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:06.920856 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:06.920856 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:06.920856 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:06.920856 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:06.920856 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:06.920856 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:06.920856 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:06.920856 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:06.920856 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:06.920856 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:36:06.920856 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:36:06.920856 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:36:06.921986 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:36:06.921986 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:06.921986 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:06.921986 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:06.921986 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:06.921986 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:06.921986 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:06.921986 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:06.921986 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:06.921986 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:06.921986 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:06.921986 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:06.921986 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:06.921986 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:06.921986 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:06.921986 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:06.921986 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:06.923164 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:36:06.923164 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:36:06.923164 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:36:06.923164 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:36:06.923164 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:36:06.923164 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:36:06.923164 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:06.923164 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:06.930132 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b156ddb-7113-4da7-ba99-b4183a7d5c09 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:06.930411 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 300/608] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:36:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:06.931488 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d9890-bf1d-4147-87ce-f8c37c6580f5 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:06.971279 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d9819-914d-4f85-9a4a-f1df13bcb051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:06.972181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d9819-914d-4f85-9a4a-f1df13bcb051 None admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:06.972464 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d9819-914d-4f85-9a4a-f1df13bcb051 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:06.972738 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d9819-914d-4f85-9a4a-f1df13bcb051 None admin] PATH_INFO: `/v3/projects/b321588ec1f14bcb94a184310cf72856/users/2141561d059043baa440e966a5e1c6cf/roles/4f5057900b094e6fb792884693177cd3` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:06.989019 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d9819-914d-4f85-9a4a-f1df13bcb051 None admin] RBAC: Authorizing `identity:create_grant(project_id=b321588ec1f14bcb94a184310cf72856, user_id=2141561d059043baa440e966a5e1c6cf, role_id=4f5057900b094e6fb792884693177cd3)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:06.990689 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d9819-914d-4f85-9a4a-f1df13bcb051 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:07.012417 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 309/609] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 5 20:36:06 2022] PUT /identity/v3/projects/b321588ec1f14bcb94a184310cf72856/users/2141561d059043baa440e966a5e1c6cf/roles/4f5057900b094e6fb792884693177cd3 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:36:07.014622 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d9819-914d-4f85-9a4a-f1df13bcb051 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:07.060105 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d9890-bf1d-4147-87ce-f8c37c6580f5 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:07.121667 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:07.149868 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342c846-c1b2-4429-8084-2c67979fe119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:07.149868 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342c846-c1b2-4429-8084-2c67979fe119 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:07.149868 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342c846-c1b2-4429-8084-2c67979fe119 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:07.149868 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342c846-c1b2-4429-8084-2c67979fe119 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:07.173680 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342c846-c1b2-4429-8084-2c67979fe119 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:07.176543 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342c846-c1b2-4429-8084-2c67979fe119 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:07.198682 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-8342c846-c1b2-4429-8084-2c67979fe119 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:07.198682 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:07.198682 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:07.198682 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:07.198682 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:07.198682 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:07.198682 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:07.198682 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:07.198682 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:07.198682 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:07.198682 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:07.198682 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:07.198682 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:07.198682 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:07.198682 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:07.199644 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:07.199644 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:07.199644 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:07.199644 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:07.199644 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:07.199644 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:07.199644 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:07.199644 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:07.199644 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:07.199644 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:07.199644 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:07.199644 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:07.199644 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:07.199644 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:07.199644 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:07.199644 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:07.199644 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:07.200592 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:07.200592 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:07.200592 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:07.200592 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:07.204559 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 301/610] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:07.206237 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342c846-c1b2-4429-8084-2c67979fe119 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:07.209516 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:07.216565 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d9819-914d-4f85-9a4a-f1df13bcb051 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:07.258922 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69472ce0-6416-4ae8-bd06-d09ae3a45fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:07.259845 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69472ce0-6416-4ae8-bd06-d09ae3a45fde None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:07.260299 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69472ce0-6416-4ae8-bd06-d09ae3a45fde None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:07.260724 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69472ce0-6416-4ae8-bd06-d09ae3a45fde None admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:07.262232 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69472ce0-6416-4ae8-bd06-d09ae3a45fde None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:07.262726 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69472ce0-6416-4ae8-bd06-d09ae3a45fde None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:07.265274 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69472ce0-6416-4ae8-bd06-d09ae3a45fde None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:07.282905 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 310/611] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 5 20:36:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:07.288913 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69472ce0-6416-4ae8-bd06-d09ae3a45fde None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:07.336973 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342c846-c1b2-4429-8084-2c67979fe119 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:07.373560 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25800a82-be57-4699-a0b7-c384869bc1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:07.374940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25800a82-be57-4699-a0b7-c384869bc1b7 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:07.375432 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25800a82-be57-4699-a0b7-c384869bc1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:07.375864 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25800a82-be57-4699-a0b7-c384869bc1b7 None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:07.376740 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25800a82-be57-4699-a0b7-c384869bc1b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:07.377199 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25800a82-be57-4699-a0b7-c384869bc1b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:07.378772 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25800a82-be57-4699-a0b7-c384869bc1b7 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:07.393827 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 302/612] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:07.402422 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25800a82-be57-4699-a0b7-c384869bc1b7 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:07.476835 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69472ce0-6416-4ae8-bd06-d09ae3a45fde None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:07.497071 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:07.504995 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:07.542664 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25800a82-be57-4699-a0b7-c384869bc1b7 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:07.555456 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45209a40-1df1-4cf2-8c14-6da2c5b4e6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:07.556374 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45209a40-1df1-4cf2-8c14-6da2c5b4e6b2 None admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:07.556657 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45209a40-1df1-4cf2-8c14-6da2c5b4e6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:07.556936 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45209a40-1df1-4cf2-8c14-6da2c5b4e6b2 None admin] PATH_INFO: `/v3/projects/b321588ec1f14bcb94a184310cf72856/users/157a258bcff642cb91a0a474f8f50941/roles/4f5057900b094e6fb792884693177cd3` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:07.581208 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926470a4-604a-4eaa-be9d-67945796a9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:07.582089 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926470a4-604a-4eaa-be9d-67945796a9d3 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:07.582463 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926470a4-604a-4eaa-be9d-67945796a9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:07.582788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926470a4-604a-4eaa-be9d-67945796a9d3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:07.586448 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45209a40-1df1-4cf2-8c14-6da2c5b4e6b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=b321588ec1f14bcb94a184310cf72856, user_id=157a258bcff642cb91a0a474f8f50941, role_id=4f5057900b094e6fb792884693177cd3)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:07.587997 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45209a40-1df1-4cf2-8c14-6da2c5b4e6b2 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:07.597469 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926470a4-604a-4eaa-be9d-67945796a9d3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:07.599193 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926470a4-604a-4eaa-be9d-67945796a9d3 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:07.610759 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 311/613] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 5 20:36:07 2022] PUT /identity/v3/projects/b321588ec1f14bcb94a184310cf72856/users/157a258bcff642cb91a0a474f8f50941/roles/4f5057900b094e6fb792884693177cd3 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:36:07.623849 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-926470a4-604a-4eaa-be9d-67945796a9d3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 20:36:07.623849 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:07.623849 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:07.623849 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:07.623849 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:07.623849 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:07.623849 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:07.623849 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:07.623849 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:07.623849 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:07.623849 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:07.623849 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:07.623849 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:36:07.623849 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:36:07.623849 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:36:07.623849 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:36:07.624833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:07.624833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:07.624833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:36:07.624833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:07.624833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:36:07.624833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:07.624833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:07.624833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:07.624833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:07.624833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:07.624833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:07.624833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:07.624833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:07.624833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:07.624833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:07.624833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:07.624833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:07.624833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:07.625762 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:07.625762 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:07.625762 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:36:07.625762 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:36:07.625762 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:36:07.625762 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:36:07.625762 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:36:07.625762 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:36:07.625762 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 20:36:07.625762 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:07.625762 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 303/614] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 5 20:36:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:36:07.631529 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45209a40-1df1-4cf2-8c14-6da2c5b4e6b2 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:07.764237 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45209a40-1df1-4cf2-8c14-6da2c5b4e6b2 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:07.800975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352bb69-dfbc-4888-a658-63f57630f23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:07.801996 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352bb69-dfbc-4888-a658-63f57630f23b None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:07.802455 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352bb69-dfbc-4888-a658-63f57630f23b None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:07.802931 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352bb69-dfbc-4888-a658-63f57630f23b None admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:07.803953 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4352bb69-dfbc-4888-a658-63f57630f23b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:07.804435 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4352bb69-dfbc-4888-a658-63f57630f23b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:07.806094 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4352bb69-dfbc-4888-a658-63f57630f23b None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:07.826767 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 312/615] 10.222.0.27 () {56 vars in 1135 bytes} [Tue Jul 5 20:36:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:07.833903 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926470a4-604a-4eaa-be9d-67945796a9d3 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:07.924710 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5fd15-553f-4905-b250-59dee61cea5d None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:07.925017 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5fd15-553f-4905-b250-59dee61cea5d None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:07.925559 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5fd15-553f-4905-b250-59dee61cea5d None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:07.926968 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 313/616] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:36:07.932505 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9224b-d88b-4d81-8b90-4ec86540f968 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:07.932787 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9224b-d88b-4d81-8b90-4ec86540f968 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:07.933062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9224b-d88b-4d81-8b90-4ec86540f968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:07.951217 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-b0b9224b-d88b-4d81-8b90-4ec86540f968 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:07.952425 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-b0b9224b-d88b-4d81-8b90-4ec86540f968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:07.970379 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:07.996876 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926470a4-604a-4eaa-be9d-67945796a9d3 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:08.030222 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:08.039891 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10759608-19e5-4837-9b85-231f4b24b87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:08.041008 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10759608-19e5-4837-9b85-231f4b24b87f None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:08.041435 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10759608-19e5-4837-9b85-231f4b24b87f None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:08.042290 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10759608-19e5-4837-9b85-231f4b24b87f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:08.055399 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10759608-19e5-4837-9b85-231f4b24b87f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:08.057403 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10759608-19e5-4837-9b85-231f4b24b87f None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:08.077816 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-10759608-19e5-4837-9b85-231f4b24b87f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:08.077816 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:08.077816 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:08.077816 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:08.077816 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:08.077816 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:08.077816 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:08.077816 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:08.077816 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:08.077816 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:08.077816 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:08.077816 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:08.077816 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:08.077816 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:08.077816 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:08.078807 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:08.078807 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:08.078807 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:08.078807 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:08.078807 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:08.078807 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:08.078807 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:08.078807 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:08.078807 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:08.078807 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:08.078807 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:08.078807 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:08.078807 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:08.078807 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:08.078807 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:08.078807 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:08.078807 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:08.079696 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:08.079696 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:08.079696 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:08.079696 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:08.079696 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 304/617] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:08.080614 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43d3e4-cd9b-4451-bf8b-fe9ac2e76696 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:08.080867 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43d3e4-cd9b-4451-bf8b-fe9ac2e76696 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:08.081138 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43d3e4-cd9b-4451-bf8b-fe9ac2e76696 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:08.082679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 305/618] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:08.085016 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43d3e4-cd9b-4451-bf8b-fe9ac2e76696 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:08.093521 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 314/619] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:36:08.095158 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285dcc8-a0d8-46cd-83de-059f5eecbc14 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:08.095576 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285dcc8-a0d8-46cd-83de-059f5eecbc14 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:08.096014 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285dcc8-a0d8-46cd-83de-059f5eecbc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:08.112897 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-8285dcc8-a0d8-46cd-83de-059f5eecbc14 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:08.114328 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-8285dcc8-a0d8-46cd-83de-059f5eecbc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:08.196733 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 315/620] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:36:08.202574 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285dcc8-a0d8-46cd-83de-059f5eecbc14 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:08.207654 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43d3e4-cd9b-4451-bf8b-fe9ac2e76696 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:08.242027 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c48ca-9094-4afe-8974-e3e069ce2acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:08.247713 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c48ca-9094-4afe-8974-e3e069ce2acf None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:08.247713 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c48ca-9094-4afe-8974-e3e069ce2acf None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:08.247713 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c48ca-9094-4afe-8974-e3e069ce2acf None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:08.247713 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c48ca-9094-4afe-8974-e3e069ce2acf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:08.247713 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c48ca-9094-4afe-8974-e3e069ce2acf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:08.247713 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c48ca-9094-4afe-8974-e3e069ce2acf None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:08.257970 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 306/621] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:36:08.259291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c48ca-9094-4afe-8974-e3e069ce2acf None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:08.294221 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:08.308871 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:08.328723 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285dcc8-a0d8-46cd-83de-059f5eecbc14 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:08.361449 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c48ca-9094-4afe-8974-e3e069ce2acf None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:08.364016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d79bae-9a4f-46d2-92f7-aecc350a32f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:08.365239 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d79bae-9a4f-46d2-92f7-aecc350a32f4 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:08.365710 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d79bae-9a4f-46d2-92f7-aecc350a32f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:08.366235 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d79bae-9a4f-46d2-92f7-aecc350a32f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:08.378623 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d79bae-9a4f-46d2-92f7-aecc350a32f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:36:08.389430 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-32d79bae-9a4f-46d2-92f7-aecc350a32f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:36:08.389430 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:08.389430 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:08.389430 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:08.389430 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:08.389430 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:08.389430 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:08.389430 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:08.389430 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:08.389430 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:08.389430 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:08.389430 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:08.389430 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:36:08.389430 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:36:08.389430 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:36:08.389430 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:36:08.390469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:36:08.390469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:36:08.390469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:36:08.390469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:36:08.390469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:08.390469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:08.390469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:08.390469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:08.390469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:08.390469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:08.390469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:08.390469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:08.390469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:08.390469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:08.390469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:08.390469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:08.391313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:08.391313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:08.391313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:08.391313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:08.391313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:36:08.391313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:36:08.391313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:36:08.391313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:36:08.391313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:36:08.391313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:36:08.391313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:36:08.391313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:08.394645 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 316/622] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 5 20:36:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:08.395701 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d79bae-9a4f-46d2-92f7-aecc350a32f4 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:08.401408 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874760d4-b4ab-4fa9-b653-68d4268df60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:08.402265 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874760d4-b4ab-4fa9-b653-68d4268df60f None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:08.402545 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874760d4-b4ab-4fa9-b653-68d4268df60f None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:08.402816 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874760d4-b4ab-4fa9-b653-68d4268df60f None admin] PATH_INFO: `/v3/roles/service` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:08.414209 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874760d4-b4ab-4fa9-b653-68d4268df60f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:36:08.421999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-874760d4-b4ab-4fa9-b653-68d4268df60f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:36:08.421999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:08.421999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:08.421999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:08.421999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:08.421999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:08.421999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:08.421999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:08.421999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:08.421999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:08.421999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:08.421999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:08.421999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:36:08.421999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:36:08.421999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:36:08.421999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:36:08.422950 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:36:08.422950 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:36:08.422950 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:36:08.422950 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:36:08.422950 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:08.422950 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:08.422950 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:08.422950 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:08.422950 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:08.422950 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:08.422950 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:08.422950 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:08.422950 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:08.422950 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:08.422950 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:08.422950 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:08.423804 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:08.423804 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:08.423804 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:08.423804 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:08.423804 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:36:08.423804 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:36:08.423804 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:36:08.423804 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:36:08.423804 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:36:08.423804 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:36:08.423804 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:36:08.423804 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:08.429093 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 307/623] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 5 20:36:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:08.429919 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874760d4-b4ab-4fa9-b653-68d4268df60f None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:08.519374 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d79bae-9a4f-46d2-92f7-aecc350a32f4 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:08.547844 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:08.558533 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874760d4-b4ab-4fa9-b653-68d4268df60f None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:08.562251 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b908f-1157-4a22-8448-1bdaf1137727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:08.567144 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b908f-1157-4a22-8448-1bdaf1137727 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:08.567450 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b908f-1157-4a22-8448-1bdaf1137727 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:08.567731 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b908f-1157-4a22-8448-1bdaf1137727 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:08.576623 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b908f-1157-4a22-8448-1bdaf1137727 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:08.578671 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b908f-1157-4a22-8448-1bdaf1137727 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:08.596094 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e29817-ca3d-4f1e-aba5-03290df5ead0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:08.596261 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-bc9b908f-1157-4a22-8448-1bdaf1137727 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:08.596261 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:08.596261 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:08.596261 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:08.596261 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:08.596261 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:08.596261 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:08.596261 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:08.596261 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:08.596261 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:08.596261 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:08.596261 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:08.596261 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:36:08.596261 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:36:08.596261 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:36:08.597097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:36:08.597097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:08.597097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:08.597097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:08.597097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:08.597097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:08.597097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:08.597097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:08.597097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:08.597097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:08.597097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:08.597097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:08.597097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:08.597097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:08.597097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:08.597097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:08.597097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:08.598031 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:36:08.598031 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:36:08.598031 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:36:08.598031 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:36:08.598031 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:36:08.598031 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:36:08.598031 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:08.598031 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:08.598031 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 317/624] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:36:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:08.598534 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b908f-1157-4a22-8448-1bdaf1137727 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:08.599885 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e29817-ca3d-4f1e-aba5-03290df5ead0 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:08.600408 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e29817-ca3d-4f1e-aba5-03290df5ead0 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:08.600881 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e29817-ca3d-4f1e-aba5-03290df5ead0 None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:08.601386 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:08.602044 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e29817-ca3d-4f1e-aba5-03290df5ead0 None admin] RBAC: Adding query filter params (name=service) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:08.602722 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e29817-ca3d-4f1e-aba5-03290df5ead0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:08.605422 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e29817-ca3d-4f1e-aba5-03290df5ead0 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:08.616368 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 308/625] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 5 20:36:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:08.617439 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e29817-ca3d-4f1e-aba5-03290df5ead0 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:08.722515 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b908f-1157-4a22-8448-1bdaf1137727 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:08.731529 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e29817-ca3d-4f1e-aba5-03290df5ead0 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:08.759523 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36512a6c-08ca-4a4b-9b29-dc1cd6e8716d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:08.760598 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36512a6c-08ca-4a4b-9b29-dc1cd6e8716d None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:08.761090 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36512a6c-08ca-4a4b-9b29-dc1cd6e8716d None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:08.761561 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36512a6c-08ca-4a4b-9b29-dc1cd6e8716d None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:08.762738 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36512a6c-08ca-4a4b-9b29-dc1cd6e8716d None admin] RBAC: Adding query filter params (name=service) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:08.763301 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36512a6c-08ca-4a4b-9b29-dc1cd6e8716d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:08.764841 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d9079-3fef-42ff-b4b7-27e7c37ce389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:08.765212 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36512a6c-08ca-4a4b-9b29-dc1cd6e8716d None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:08.765507 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d9079-3fef-42ff-b4b7-27e7c37ce389 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:08.765784 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d9079-3fef-42ff-b4b7-27e7c37ce389 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:08.766081 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d9079-3fef-42ff-b4b7-27e7c37ce389 None admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:08.766869 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248d9079-3fef-42ff-b4b7-27e7c37ce389 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:08.767175 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248d9079-3fef-42ff-b4b7-27e7c37ce389 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:08.768593 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248d9079-3fef-42ff-b4b7-27e7c37ce389 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:08.775738 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 318/626] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 5 20:36:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:08.776811 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36512a6c-08ca-4a4b-9b29-dc1cd6e8716d None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:08.785700 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 309/627] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 5 20:36:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:08.786600 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d9079-3fef-42ff-b4b7-27e7c37ce389 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:08.804611 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:08.847771 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:08.886665 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d9079-3fef-42ff-b4b7-27e7c37ce389 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:08.890925 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36512a6c-08ca-4a4b-9b29-dc1cd6e8716d None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:08.921785 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d6d3b-f176-467d-a6cf-da309179e93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:08.922642 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d6d3b-f176-467d-a6cf-da309179e93e None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:08.922921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d6d3b-f176-467d-a6cf-da309179e93e None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:08.923194 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d6d3b-f176-467d-a6cf-da309179e93e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:08.930595 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e321b7-f711-43b3-92e0-9035d9bc1b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:08.931688 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e321b7-f711-43b3-92e0-9035d9bc1b32 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:08.932269 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e321b7-f711-43b3-92e0-9035d9bc1b32 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:08.932730 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e321b7-f711-43b3-92e0-9035d9bc1b32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:08.934256 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d6d3b-f176-467d-a6cf-da309179e93e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:08.935779 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d6d3b-f176-467d-a6cf-da309179e93e None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:08.945330 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e321b7-f711-43b3-92e0-9035d9bc1b32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:08.947098 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e321b7-f711-43b3-92e0-9035d9bc1b32 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:08.953852 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-8f4d6d3b-f176-467d-a6cf-da309179e93e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:08.953852 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:08.953852 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:08.953852 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:08.953852 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:08.953852 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:08.953852 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:08.953852 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:08.953852 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:08.953852 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:08.953852 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:08.953852 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:08.953852 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:08.953852 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:08.953852 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:08.954827 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:08.954827 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:08.954827 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:08.954827 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:08.954827 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:08.954827 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:08.954827 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:08.954827 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:08.954827 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:08.954827 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:08.954827 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:08.954827 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:08.954827 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:08.954827 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:08.954827 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:08.954827 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:08.954827 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:08.955727 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:08.955727 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:08.955727 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:08.955727 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:08.959675 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 310/628] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:08.960499 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d6d3b-f176-467d-a6cf-da309179e93e None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:08.968797 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-94e321b7-f711-43b3-92e0-9035d9bc1b32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:08.968797 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:08.968797 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:08.968797 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:08.968797 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:08.968797 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:08.968797 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:08.968797 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:08.968797 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:08.968797 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:08.968797 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:08.968797 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:08.968797 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:08.968797 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:08.968797 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:08.969690 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:08.969690 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:08.969690 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:08.969690 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:08.969690 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:08.969690 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:08.969690 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:08.969690 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:08.969690 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:08.969690 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:08.969690 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:08.969690 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:08.969690 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:08.969690 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:08.969690 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:08.969690 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:08.969690 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:08.970624 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:08.970624 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:08.970624 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:08.970624 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:08.972953 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 319/629] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:08.974117 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e321b7-f711-43b3-92e0-9035d9bc1b32 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:09.034704 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:09.070754 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d6d3b-f176-467d-a6cf-da309179e93e None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:09.088593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e321b7-f711-43b3-92e0-9035d9bc1b32 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:09.105147 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72463800-381b-40bf-b2cd-fcc584703627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:09.106009 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72463800-381b-40bf-b2cd-fcc584703627 None admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:09.106355 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72463800-381b-40bf-b2cd-fcc584703627 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:09.106622 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72463800-381b-40bf-b2cd-fcc584703627 None admin] PATH_INFO: `/v3/projects/b321588ec1f14bcb94a184310cf72856/users/90aa580a2e10467a93c2d79d1906bd8a/roles/4f5057900b094e6fb792884693177cd3` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:09.107727 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:09.123915 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72463800-381b-40bf-b2cd-fcc584703627 None admin] RBAC: Authorizing `identity:create_grant(project_id=b321588ec1f14bcb94a184310cf72856, user_id=90aa580a2e10467a93c2d79d1906bd8a, role_id=4f5057900b094e6fb792884693177cd3)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:09.125377 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72463800-381b-40bf-b2cd-fcc584703627 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:09.132774 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e6d72-f923-417e-8b7f-c5ac46481842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:09.133770 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e6d72-f923-417e-8b7f-c5ac46481842 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:09.134260 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e6d72-f923-417e-8b7f-c5ac46481842 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:09.134586 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e6d72-f923-417e-8b7f-c5ac46481842 None admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:09.135451 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e6d72-f923-417e-8b7f-c5ac46481842 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:09.135765 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e6d72-f923-417e-8b7f-c5ac46481842 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:09.137208 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e6d72-f923-417e-8b7f-c5ac46481842 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:09.150570 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 311/630] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 5 20:36:08 2022] PUT /identity/v3/projects/b321588ec1f14bcb94a184310cf72856/users/90aa580a2e10467a93c2d79d1906bd8a/roles/4f5057900b094e6fb792884693177cd3 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:36:09.150570 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72463800-381b-40bf-b2cd-fcc584703627 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:09.169904 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 320/631] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:09.177625 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e6d72-f923-417e-8b7f-c5ac46481842 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:09.359564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72463800-381b-40bf-b2cd-fcc584703627 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:09.369965 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e6d72-f923-417e-8b7f-c5ac46481842 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:09.376975 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:09.395945 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbf529-aef8-413d-9656-fce58accc0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:09.396626 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbf529-aef8-413d-9656-fce58accc0a2 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:09.396907 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbf529-aef8-413d-9656-fce58accc0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:09.397182 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbf529-aef8-413d-9656-fce58accc0a2 None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:09.397953 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fbf529-aef8-413d-9656-fce58accc0a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:09.398270 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fbf529-aef8-413d-9656-fce58accc0a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:09.399664 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fbf529-aef8-413d-9656-fce58accc0a2 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:09.411943 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd18a62-d3b3-4011-9f48-dad2868939c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:09.413036 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd18a62-d3b3-4011-9f48-dad2868939c8 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:09.413513 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd18a62-d3b3-4011-9f48-dad2868939c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:09.413834 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 312/632] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:09.414256 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd18a62-d3b3-4011-9f48-dad2868939c8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:09.415530 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d530bc-cf86-4fc2-ab6e-336b7612107f None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:09.415817 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d530bc-cf86-4fc2-ab6e-336b7612107f None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:09.416094 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d530bc-cf86-4fc2-ab6e-336b7612107f None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:09.421823 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 313/633] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:09.422633 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d530bc-cf86-4fc2-ab6e-336b7612107f None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:09.423748 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd18a62-d3b3-4011-9f48-dad2868939c8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:09.426020 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd18a62-d3b3-4011-9f48-dad2868939c8 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:09.448170 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-2cd18a62-d3b3-4011-9f48-dad2868939c8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 20:36:09.448170 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:09.448170 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:09.448170 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:09.448170 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:09.448170 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:09.448170 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:09.448170 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:09.448170 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:09.448170 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:09.448170 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:09.448170 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:09.448170 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:36:09.448170 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:36:09.448170 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:36:09.448170 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:36:09.449193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:09.449193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:09.449193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:36:09.449193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:09.449193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:36:09.449193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:09.449193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:09.449193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:09.449193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:09.449193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:09.449193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:09.449193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:09.449193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:09.449193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:09.449193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:09.449193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:09.449193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:09.449193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:09.450231 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:09.450231 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:09.450231 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:36:09.450231 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:36:09.450231 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:36:09.450231 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:36:09.450231 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:36:09.450231 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:36:09.450231 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 20:36:09.450231 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:09.453209 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 321/634] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Jul 5 20:36:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:09.454959 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e6427-6a85-44ce-9f4e-680122957ff7 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:09.455376 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e6427-6a85-44ce-9f4e-680122957ff7 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:09.455771 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e6427-6a85-44ce-9f4e-680122957ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:09.476673 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-7d5e6427-6a85-44ce-9f4e-680122957ff7 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:09.478505 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-7d5e6427-6a85-44ce-9f4e-680122957ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:09.515412 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:09.542494 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d530bc-cf86-4fc2-ab6e-336b7612107f None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:09.564639 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 322/635] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:36:09.566170 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e6427-6a85-44ce-9f4e-680122957ff7 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:09.596068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a5a82-f32a-4dcf-af8a-6b4c5f3c15c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:09.597164 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a5a82-f32a-4dcf-af8a-6b4c5f3c15c7 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:09.597751 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a5a82-f32a-4dcf-af8a-6b4c5f3c15c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:09.598051 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a5a82-f32a-4dcf-af8a-6b4c5f3c15c7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:09.613076 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a5a82-f32a-4dcf-af8a-6b4c5f3c15c7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:09.615179 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a5a82-f32a-4dcf-af8a-6b4c5f3c15c7 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:09.631732 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-236a5a82-f32a-4dcf-af8a-6b4c5f3c15c7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 05 20:36:09.631732 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:09.631732 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:09.631732 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:09.631732 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:09.631732 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:09.631732 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:09.631732 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:09.631732 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:09.631732 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:09.631732 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:09.631732 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:09.631732 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:36:09.631732 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:36:09.631732 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:36:09.631732 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:36:09.632945 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:09.632945 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:09.632945 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:36:09.632945 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:09.632945 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:36:09.632945 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:09.632945 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:09.632945 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:09.632945 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:09.632945 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:09.632945 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:09.632945 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:09.632945 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:09.632945 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:09.632945 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:09.632945 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:09.632945 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:09.632945 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:09.634056 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:09.634056 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:09.634056 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:36:09.634056 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:36:09.634056 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:36:09.634056 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:36:09.634056 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:36:09.634056 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:36:09.634056 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 05 20:36:09.634056 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:09.639955 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 314/636] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:36:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:09.640956 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a5a82-f32a-4dcf-af8a-6b4c5f3c15c7 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:09.689370 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e6427-6a85-44ce-9f4e-680122957ff7 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:09.693611 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:09.728399 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf9106-6684-482c-bb13-99db9dab21e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:09.729259 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf9106-6684-482c-bb13-99db9dab21e4 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:09.729606 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf9106-6684-482c-bb13-99db9dab21e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:09.730013 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf9106-6684-482c-bb13-99db9dab21e4 None admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:09.730989 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf9106-6684-482c-bb13-99db9dab21e4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:09.731470 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf9106-6684-482c-bb13-99db9dab21e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:09.733028 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf9106-6684-482c-bb13-99db9dab21e4 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:09.756206 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 323/637] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Jul 5 20:36:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:09.757195 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf9106-6684-482c-bb13-99db9dab21e4 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:09.765209 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a5a82-f32a-4dcf-af8a-6b4c5f3c15c7 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:09.786262 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:09.808700 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312dce48-b287-4f2f-b808-6f9abc0eb105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:09.810027 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312dce48-b287-4f2f-b808-6f9abc0eb105 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:09.810772 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312dce48-b287-4f2f-b808-6f9abc0eb105 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:09.811219 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312dce48-b287-4f2f-b808-6f9abc0eb105 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:09.824271 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312dce48-b287-4f2f-b808-6f9abc0eb105 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:36:09.834096 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-312dce48-b287-4f2f-b808-6f9abc0eb105 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:36:09.834096 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:09.834096 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:09.834096 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:09.834096 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:09.834096 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:09.834096 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:09.834096 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:09.834096 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:09.834096 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:09.834096 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:09.834096 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:09.834096 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:36:09.834096 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:36:09.834096 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:36:09.834096 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:36:09.835149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:36:09.835149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:36:09.835149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:36:09.835149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:36:09.835149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:09.835149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:09.835149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:09.835149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:09.835149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:09.835149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:09.835149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:09.835149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:09.835149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:09.835149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:09.835149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:09.835149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:09.836008 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:09.836008 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:09.836008 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:09.836008 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:09.836008 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:36:09.836008 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:36:09.836008 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:36:09.836008 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:36:09.836008 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:36:09.836008 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:36:09.836008 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:36:09.836008 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:09.838843 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 315/638] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 5 20:36:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:09.839842 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312dce48-b287-4f2f-b808-6f9abc0eb105 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:09.869329 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf9106-6684-482c-bb13-99db9dab21e4 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:09.907835 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b4b81-48ca-4d25-a6c6-3fc0cfda5e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:09.908625 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b4b81-48ca-4d25-a6c6-3fc0cfda5e6b None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:09.909001 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b4b81-48ca-4d25-a6c6-3fc0cfda5e6b None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:09.909371 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b4b81-48ca-4d25-a6c6-3fc0cfda5e6b None admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:09.910353 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b4b81-48ca-4d25-a6c6-3fc0cfda5e6b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:09.910904 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b4b81-48ca-4d25-a6c6-3fc0cfda5e6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:09.912540 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b4b81-48ca-4d25-a6c6-3fc0cfda5e6b None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:09.932487 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 324/639] 10.222.0.27 () {56 vars in 1137 bytes} [Tue Jul 5 20:36:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:09.933460 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b4b81-48ca-4d25-a6c6-3fc0cfda5e6b None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:09.951330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:09.956149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312dce48-b287-4f2f-b808-6f9abc0eb105 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:09.992001 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ad510-4761-4543-97d1-7abf1772a074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:09.992879 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ad510-4761-4543-97d1-7abf1772a074 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:09.993298 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ad510-4761-4543-97d1-7abf1772a074 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:09.993809 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ad510-4761-4543-97d1-7abf1772a074 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:10.013723 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:10.032725 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b4b81-48ca-4d25-a6c6-3fc0cfda5e6b None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:10.065259 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373ad510-4761-4543-97d1-7abf1772a074 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:10.067131 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373ad510-4761-4543-97d1-7abf1772a074 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:10.069436 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5879a-1863-480f-8da0-3b80a1f432a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:10.070138 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5879a-1863-480f-8da0-3b80a1f432a6 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:10.070416 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5879a-1863-480f-8da0-3b80a1f432a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:10.070686 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5879a-1863-480f-8da0-3b80a1f432a6 None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:10.071429 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de5879a-1863-480f-8da0-3b80a1f432a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:10.071731 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de5879a-1863-480f-8da0-3b80a1f432a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:10.073087 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de5879a-1863-480f-8da0-3b80a1f432a6 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:10.081035 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 325/640] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 5 20:36:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:10.082272 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252e33e-554f-414e-ab9b-59f57bfcbefd None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:10.082556 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252e33e-554f-414e-ab9b-59f57bfcbefd None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:10.082831 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252e33e-554f-414e-ab9b-59f57bfcbefd None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:10.084349 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 326/641] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:10.084858 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252e33e-554f-414e-ab9b-59f57bfcbefd None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:10.179540 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:10.189131 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 316/642] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:36:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:36:10.190073 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ad510-4761-4543-97d1-7abf1772a074 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:10.205573 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252e33e-554f-414e-ab9b-59f57bfcbefd None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:10.240853 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a27c23-8f3d-4251-9272-0c849e3ab3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:10.241732 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a27c23-8f3d-4251-9272-0c849e3ab3f7 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:10.242042 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a27c23-8f3d-4251-9272-0c849e3ab3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:10.242315 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a27c23-8f3d-4251-9272-0c849e3ab3f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:10.256904 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:10.291561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ad510-4761-4543-97d1-7abf1772a074 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:10.318974 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a27c23-8f3d-4251-9272-0c849e3ab3f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:10.320460 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a27c23-8f3d-4251-9272-0c849e3ab3f7 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:10.329729 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c72065-28da-4314-88c5-eaa35d63a02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:10.330561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c72065-28da-4314-88c5-eaa35d63a02b None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:10.330839 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c72065-28da-4314-88c5-eaa35d63a02b None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:10.331120 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c72065-28da-4314-88c5-eaa35d63a02b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:10.342514 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c72065-28da-4314-88c5-eaa35d63a02b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:10.344006 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c72065-28da-4314-88c5-eaa35d63a02b None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:10.361564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-72c72065-28da-4314-88c5-eaa35d63a02b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:10.361564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:10.361564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:10.361564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:10.361564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:10.361564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:10.361564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:10.361564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:10.361564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:10.361564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:10.361564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:10.361564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:10.361564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:10.361564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:10.361564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:10.362592 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:10.362592 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:10.362592 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:10.362592 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:10.362592 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:10.362592 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:10.362592 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:10.362592 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:10.362592 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:10.362592 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:10.362592 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:10.362592 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:10.362592 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:10.362592 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:10.362592 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:10.362592 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:10.362592 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:10.363510 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:10.363510 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:10.363510 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:10.363510 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:10.366569 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 317/643] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:10.368370 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f546e-6b4d-4b53-8fe9-83a722df8fc5 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:10.368765 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f546e-6b4d-4b53-8fe9-83a722df8fc5 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:10.368948 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f546e-6b4d-4b53-8fe9-83a722df8fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:10.385601 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-b92f546e-6b4d-4b53-8fe9-83a722df8fc5 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:10.386898 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-b92f546e-6b4d-4b53-8fe9-83a722df8fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:10.435501 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 327/644] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:36:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:36:10.435501 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a27c23-8f3d-4251-9272-0c849e3ab3f7 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:10.438123 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:10.462978 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 318/645] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:36:10.464023 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f546e-6b4d-4b53-8fe9-83a722df8fc5 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:10.491479 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:10.547254 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a27c23-8f3d-4251-9272-0c849e3ab3f7 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:10.577748 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f546e-6b4d-4b53-8fe9-83a722df8fc5 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:10.583386 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0322e1-8ff2-48d9-943d-ac5d7f35af4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:10.584245 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0322e1-8ff2-48d9-943d-ac5d7f35af4a None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:10.584523 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0322e1-8ff2-48d9-943d-ac5d7f35af4a None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:10.584804 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0322e1-8ff2-48d9-943d-ac5d7f35af4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:10.596135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0322e1-8ff2-48d9-943d-ac5d7f35af4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:10.597697 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0322e1-8ff2-48d9-943d-ac5d7f35af4a None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:10.612799 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798b3e0-e175-4488-8210-60420e96e8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:10.613547 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798b3e0-e175-4488-8210-60420e96e8f4 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:10.613940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798b3e0-e175-4488-8210-60420e96e8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:10.614282 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798b3e0-e175-4488-8210-60420e96e8f4 None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:10.615069 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798b3e0-e175-4488-8210-60420e96e8f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:10.615434 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798b3e0-e175-4488-8210-60420e96e8f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:10.615781 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-ed0322e1-8ff2-48d9-943d-ac5d7f35af4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:10.615781 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:10.615781 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:10.615781 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:10.615781 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:10.615781 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:10.615781 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:10.615781 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:10.615781 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:10.615781 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:10.615781 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:10.615781 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:10.615781 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:10.615781 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:10.615781 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:10.616637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:10.616637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:10.616637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:10.616637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:10.616637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:10.616637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:10.616637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:10.616637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:10.616637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:10.616637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:10.616637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:10.616637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:10.616637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:10.616637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:10.616637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:10.616637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:10.616637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:10.617692 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:10.617692 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:10.617692 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:10.617692 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:10.618183 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798b3e0-e175-4488-8210-60420e96e8f4 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:10.621701 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 328/646] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:10.622589 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0322e1-8ff2-48d9-943d-ac5d7f35af4a None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:10.629286 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 319/647] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:10.634342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798b3e0-e175-4488-8210-60420e96e8f4 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:10.677561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:10.722993 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:10.729165 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0322e1-8ff2-48d9-943d-ac5d7f35af4a None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:10.738266 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798b3e0-e175-4488-8210-60420e96e8f4 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:10.768476 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655551a-2df4-4e28-9ddc-2dfc1ccecd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:10.769587 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655551a-2df4-4e28-9ddc-2dfc1ccecd3e None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:10.769889 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655551a-2df4-4e28-9ddc-2dfc1ccecd3e None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:10.770164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655551a-2df4-4e28-9ddc-2dfc1ccecd3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:10.776368 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294160b-ed81-4e05-9a1c-bc756e1781da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:10.777175 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294160b-ed81-4e05-9a1c-bc756e1781da None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:10.777449 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294160b-ed81-4e05-9a1c-bc756e1781da None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:10.777720 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294160b-ed81-4e05-9a1c-bc756e1781da None admin] PATH_INFO: `/v3/roles/service` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:10.780906 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1655551a-2df4-4e28-9ddc-2dfc1ccecd3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:10.782402 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1655551a-2df4-4e28-9ddc-2dfc1ccecd3e None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:10.788679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e294160b-ed81-4e05-9a1c-bc756e1781da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:36:10.796319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-e294160b-ed81-4e05-9a1c-bc756e1781da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:36:10.796319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:10.796319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:10.796319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:10.796319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:10.796319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:10.796319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:10.796319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:10.796319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:10.796319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:10.796319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:10.796319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:10.796319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:36:10.796319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:36:10.796319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:36:10.796319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:36:10.797244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:36:10.797244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:36:10.797244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:36:10.797244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:36:10.797244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:10.797244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:10.797244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:10.797244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:10.797244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:10.797244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:10.797244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:10.797244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:10.797244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:10.797244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:10.797244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:10.797244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:10.798459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:10.798459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:10.798459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:10.798459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:10.798459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:36:10.798459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:36:10.798459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:36:10.798459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:36:10.798459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:36:10.798459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:36:10.798459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:36:10.798459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:10.798459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 320/648] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 5 20:36:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:10.799175 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294160b-ed81-4e05-9a1c-bc756e1781da None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:10.803333 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-1655551a-2df4-4e28-9ddc-2dfc1ccecd3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:10.803333 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:10.803333 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:10.803333 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:10.803333 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:10.803333 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:10.803333 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:10.803333 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:10.803333 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:10.803333 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:10.803333 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:10.803333 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:10.803333 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:10.803333 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:10.803333 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:10.804387 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:10.804387 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:10.804387 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:10.804387 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:10.804387 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:10.804387 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:10.804387 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:10.804387 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:10.804387 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:10.804387 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:10.804387 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:10.804387 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:10.804387 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:10.804387 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:10.804387 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:10.804387 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:10.804387 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:10.805484 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:10.805484 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:10.805484 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:10.805484 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:10.812343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 329/649] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:10.812343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655551a-2df4-4e28-9ddc-2dfc1ccecd3e None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:10.904851 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:10.908069 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294160b-ed81-4e05-9a1c-bc756e1781da None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:10.921081 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655551a-2df4-4e28-9ddc-2dfc1ccecd3e None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:10.947430 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053c390-ff5e-4d74-8e16-87cbf64f0419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:10.948449 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053c390-ff5e-4d74-8e16-87cbf64f0419 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:10.948905 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053c390-ff5e-4d74-8e16-87cbf64f0419 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:10.949459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053c390-ff5e-4d74-8e16-87cbf64f0419 None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:10.951468 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053c390-ff5e-4d74-8e16-87cbf64f0419 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:10.952380 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053c390-ff5e-4d74-8e16-87cbf64f0419 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:10.954198 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053c390-ff5e-4d74-8e16-87cbf64f0419 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:10.962011 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd94b27-6ffb-40bb-a2cb-9f42e292ee3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:10.962895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd94b27-6ffb-40bb-a2cb-9f42e292ee3c None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:10.963206 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd94b27-6ffb-40bb-a2cb-9f42e292ee3c None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:10.963498 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd94b27-6ffb-40bb-a2cb-9f42e292ee3c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:10.970294 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 321/650] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:10.971389 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053c390-ff5e-4d74-8e16-87cbf64f0419 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:10.972450 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd94b27-6ffb-40bb-a2cb-9f42e292ee3c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:10.973994 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd94b27-6ffb-40bb-a2cb-9f42e292ee3c None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:10.993480 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-9cd94b27-6ffb-40bb-a2cb-9f42e292ee3c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 20:36:10.993480 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:10.993480 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:10.993480 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:10.993480 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:10.993480 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:10.993480 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:10.993480 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:10.993480 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:10.993480 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:10.993480 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:10.993480 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:10.993480 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:36:10.993480 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:36:10.993480 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:36:10.993480 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:36:10.994506 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:10.994506 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:10.994506 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:36:10.994506 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:10.994506 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:36:10.994506 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:10.994506 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:10.994506 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:10.994506 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:10.994506 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:10.994506 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:10.994506 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:10.994506 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:10.994506 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:10.994506 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:10.994506 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:10.994506 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:10.994506 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:10.995476 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:10.995476 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:10.995476 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:36:10.995476 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:36:10.995476 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:36:10.995476 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:36:10.995476 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:36:10.995476 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:36:10.995476 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 20:36:10.995476 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:10.997988 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 330/651] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:36:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:10.998818 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd94b27-6ffb-40bb-a2cb-9f42e292ee3c None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:11.012547 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:11.090234 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053c390-ff5e-4d74-8e16-87cbf64f0419 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:11.127694 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd94b27-6ffb-40bb-a2cb-9f42e292ee3c None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:11.152847 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a64680-eb92-4bfa-a5c1-53fe78cc3d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:11.153686 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a64680-eb92-4bfa-a5c1-53fe78cc3d47 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:11.154137 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a64680-eb92-4bfa-a5c1-53fe78cc3d47 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:11.154391 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a64680-eb92-4bfa-a5c1-53fe78cc3d47 None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:11.155216 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a64680-eb92-4bfa-a5c1-53fe78cc3d47 None admin] RBAC: Adding query filter params (name=service) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:11.155585 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a64680-eb92-4bfa-a5c1-53fe78cc3d47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:11.157049 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a64680-eb92-4bfa-a5c1-53fe78cc3d47 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:11.167699 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 322/652] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 5 20:36:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:11.168659 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a64680-eb92-4bfa-a5c1-53fe78cc3d47 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:11.183896 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5422b6d-5373-4c48-be35-887d1dfd4d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:11.185315 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5422b6d-5373-4c48-be35-887d1dfd4d6d None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:11.186276 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5422b6d-5373-4c48-be35-887d1dfd4d6d None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:11.186730 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5422b6d-5373-4c48-be35-887d1dfd4d6d None admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:11.187912 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5422b6d-5373-4c48-be35-887d1dfd4d6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:11.188633 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5422b6d-5373-4c48-be35-887d1dfd4d6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:11.190602 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5422b6d-5373-4c48-be35-887d1dfd4d6d None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:11.195558 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:11.206745 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 331/653] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:11.207603 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5422b6d-5373-4c48-be35-887d1dfd4d6d None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:11.282559 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:11.284407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a64680-eb92-4bfa-a5c1-53fe78cc3d47 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:11.320371 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5422b6d-5373-4c48-be35-887d1dfd4d6d None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:11.325118 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392d747-159d-4f99-9a93-8fdb5295cc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:11.326067 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392d747-159d-4f99-9a93-8fdb5295cc3d None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:11.326508 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392d747-159d-4f99-9a93-8fdb5295cc3d None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:11.326877 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392d747-159d-4f99-9a93-8fdb5295cc3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:11.334451 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392d747-159d-4f99-9a93-8fdb5295cc3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:11.335908 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392d747-159d-4f99-9a93-8fdb5295cc3d None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:11.350070 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-5392d747-159d-4f99-9a93-8fdb5295cc3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:11.350070 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:11.350070 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:11.350070 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:11.350070 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:11.350070 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:11.350070 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:11.350070 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:11.350070 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:11.350070 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:11.350070 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:11.350070 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:11.350070 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:36:11.350070 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:36:11.350070 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:36:11.351149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:36:11.351149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:11.351149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:11.351149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:11.351149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:11.351149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:11.351149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:11.351149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:11.351149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:11.351149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:11.351149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:11.351149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:11.351149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:11.351149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:11.351149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:11.351149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:11.351149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:11.352304 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:36:11.352304 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:36:11.352304 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:36:11.352304 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:36:11.352304 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:36:11.352304 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:36:11.352304 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:11.352304 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:11.352304 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 323/654] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:36:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:11.352304 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392d747-159d-4f99-9a93-8fdb5295cc3d None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:11.358274 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce74d6e-016f-4581-abfe-1d3ea172a5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:11.358950 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce74d6e-016f-4581-abfe-1d3ea172a5bd None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:11.359232 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce74d6e-016f-4581-abfe-1d3ea172a5bd None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:11.359510 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce74d6e-016f-4581-abfe-1d3ea172a5bd None admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:11.360353 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce74d6e-016f-4581-abfe-1d3ea172a5bd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:11.360658 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce74d6e-016f-4581-abfe-1d3ea172a5bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:11.362205 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce74d6e-016f-4581-abfe-1d3ea172a5bd None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:11.379341 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 332/655] 10.222.0.27 () {56 vars in 1137 bytes} [Tue Jul 5 20:36:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:11.380161 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce74d6e-016f-4581-abfe-1d3ea172a5bd None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:11.432172 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:11.450606 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392d747-159d-4f99-9a93-8fdb5295cc3d None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:11.478547 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce74d6e-016f-4581-abfe-1d3ea172a5bd None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:11.483606 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a85367-7dd0-4b22-9032-ef38c43eefa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:11.484404 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a85367-7dd0-4b22-9032-ef38c43eefa5 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:11.484682 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a85367-7dd0-4b22-9032-ef38c43eefa5 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:11.484952 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a85367-7dd0-4b22-9032-ef38c43eefa5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:11.495035 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a85367-7dd0-4b22-9032-ef38c43eefa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:11.496491 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a85367-7dd0-4b22-9032-ef38c43eefa5 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:11.505445 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:11.514183 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-73a85367-7dd0-4b22-9032-ef38c43eefa5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:11.514183 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:11.514183 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:11.514183 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:11.514183 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:11.514183 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:11.514183 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:11.514183 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:11.514183 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:11.514183 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:11.514183 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:11.514183 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:11.514183 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:11.514183 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:11.514183 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:11.515244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:11.515244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:11.515244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:11.515244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:11.515244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:11.515244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:11.515244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:11.515244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:11.515244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:11.515244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:11.515244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:11.515244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:11.515244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:11.515244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:11.515244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:11.515244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:11.515244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:11.516139 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:11.516139 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:11.516139 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:11.516139 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:11.516369 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527d1d3-cb29-4910-83bf-d689ea051e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:11.516369 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527d1d3-cb29-4910-83bf-d689ea051e8a None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:11.516369 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527d1d3-cb29-4910-83bf-d689ea051e8a None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:11.516711 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 324/656] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:11.516783 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527d1d3-cb29-4910-83bf-d689ea051e8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:11.516857 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afff63-0d40-46a3-ad30-79b735d486eb None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:11.516857 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afff63-0d40-46a3-ad30-79b735d486eb None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:11.517098 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afff63-0d40-46a3-ad30-79b735d486eb None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:11.521876 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 325/657] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:11.521876 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51afff63-0d40-46a3-ad30-79b735d486eb None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:11.527349 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4527d1d3-cb29-4910-83bf-d689ea051e8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:11.528886 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4527d1d3-cb29-4910-83bf-d689ea051e8a None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:11.542557 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-4527d1d3-cb29-4910-83bf-d689ea051e8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:11.542557 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:11.542557 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:11.542557 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:11.542557 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:11.542557 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:11.542557 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:11.542557 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:11.542557 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:11.542557 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:11.542557 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:11.542557 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:11.542557 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:36:11.542557 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:36:11.542557 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:36:11.543555 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:36:11.543555 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:11.543555 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:11.543555 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:11.543555 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:11.543555 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:11.543555 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:11.543555 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:11.543555 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:11.543555 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:11.543555 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:11.543555 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:11.543555 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:11.543555 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:11.543555 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:11.543555 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:11.543555 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:11.544518 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:36:11.544518 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:36:11.544518 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:36:11.544518 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:36:11.544518 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:36:11.544518 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:36:11.544518 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:11.544518 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:11.544518 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 333/658] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:36:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:11.544518 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527d1d3-cb29-4910-83bf-d689ea051e8a None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:11.623361 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51afff63-0d40-46a3-ad30-79b735d486eb None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:11.648450 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527d1d3-cb29-4910-83bf-d689ea051e8a None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:11.656623 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6ce14-0e37-42e8-a8a7-b426acaea8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:11.657288 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6ce14-0e37-42e8-a8a7-b426acaea8f6 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:11.657567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6ce14-0e37-42e8-a8a7-b426acaea8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:11.657869 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6ce14-0e37-42e8-a8a7-b426acaea8f6 None admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:11.658749 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6ce14-0e37-42e8-a8a7-b426acaea8f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:11.659056 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6ce14-0e37-42e8-a8a7-b426acaea8f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:11.660513 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6ce14-0e37-42e8-a8a7-b426acaea8f6 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:11.662125 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:11.673164 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 326/659] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 5 20:36:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:11.674013 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6ce14-0e37-42e8-a8a7-b426acaea8f6 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:11.681125 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc6284-af8d-4949-b5e2-b01911a8a643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:11.681774 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc6284-af8d-4949-b5e2-b01911a8a643 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:11.682087 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc6284-af8d-4949-b5e2-b01911a8a643 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:11.682363 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc6284-af8d-4949-b5e2-b01911a8a643 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:11.735251 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:11.749138 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc6284-af8d-4949-b5e2-b01911a8a643 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:11.750635 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc6284-af8d-4949-b5e2-b01911a8a643 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:11.774162 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6ce14-0e37-42e8-a8a7-b426acaea8f6 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:11.806724 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf3238-b1d3-4a91-881d-9a6a2e92f65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:11.807318 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf3238-b1d3-4a91-881d-9a6a2e92f65e None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:11.807604 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf3238-b1d3-4a91-881d-9a6a2e92f65e None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:11.807882 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf3238-b1d3-4a91-881d-9a6a2e92f65e None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:11.808610 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf3238-b1d3-4a91-881d-9a6a2e92f65e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:11.808921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf3238-b1d3-4a91-881d-9a6a2e92f65e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:11.810429 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf3238-b1d3-4a91-881d-9a6a2e92f65e None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:11.821725 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 327/660] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:11.822939 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349af1d-ed42-4c50-8f9c-5492a3f9849a None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:11.823223 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349af1d-ed42-4c50-8f9c-5492a3f9849a None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:11.823499 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349af1d-ed42-4c50-8f9c-5492a3f9849a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:11.839780 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-3349af1d-ed42-4c50-8f9c-5492a3f9849a None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:11.840988 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-3349af1d-ed42-4c50-8f9c-5492a3f9849a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:11.849595 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 334/661] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:36:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:36:11.850443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc6284-af8d-4949-b5e2-b01911a8a643 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:11.891721 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:11.910286 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 328/662] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:36:11.911106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349af1d-ed42-4c50-8f9c-5492a3f9849a None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:11.936679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:11.952186 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc6284-af8d-4949-b5e2-b01911a8a643 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:11.986263 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408dff1-66be-4af0-897c-be3b2e21427d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:11.986918 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408dff1-66be-4af0-897c-be3b2e21427d None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:11.987194 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408dff1-66be-4af0-897c-be3b2e21427d None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:11.987465 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408dff1-66be-4af0-897c-be3b2e21427d None admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:11.988279 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7408dff1-66be-4af0-897c-be3b2e21427d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:11.988580 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7408dff1-66be-4af0-897c-be3b2e21427d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:11.990042 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7408dff1-66be-4af0-897c-be3b2e21427d None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:12.001896 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 335/663] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 5 20:36:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:12.002581 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408dff1-66be-4af0-897c-be3b2e21427d None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:12.011281 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349af1d-ed42-4c50-8f9c-5492a3f9849a None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:12.044143 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdc54d-ee1a-4eb2-aa1c-9b63979261b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:12.044797 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdc54d-ee1a-4eb2-aa1c-9b63979261b7 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:12.045080 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdc54d-ee1a-4eb2-aa1c-9b63979261b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:12.045350 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdc54d-ee1a-4eb2-aa1c-9b63979261b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:12.046205 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdc54d-ee1a-4eb2-aa1c-9b63979261b7 None admin] RBAC: Adding query filter params (role.id=4f5057900b094e6fb792884693177cd3, scope.project.id=b321588ec1f14bcb94a184310cf72856, user.id=814b675b98b844a2a12a39890ee69d2b) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:12.046514 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdc54d-ee1a-4eb2-aa1c-9b63979261b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:12.047949 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdc54d-ee1a-4eb2-aa1c-9b63979261b7 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:12.053947 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 329/664] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:36:11 2022] GET /identity/v3/role_assignments?user.id=814b675b98b844a2a12a39890ee69d2b&scope.project.id=b321588ec1f14bcb94a184310cf72856&role.id=4f5057900b094e6fb792884693177cd3 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:12.054702 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdc54d-ee1a-4eb2-aa1c-9b63979261b7 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:12.111853 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:12.119802 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408dff1-66be-4af0-897c-be3b2e21427d None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:12.164065 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658f32a-d7bd-4986-9372-b37a201d647f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:12.166182 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658f32a-d7bd-4986-9372-b37a201d647f None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:12.166867 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658f32a-d7bd-4986-9372-b37a201d647f None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:12.167335 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658f32a-d7bd-4986-9372-b37a201d647f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:12.180759 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdc54d-ee1a-4eb2-aa1c-9b63979261b7 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:12.182146 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658f32a-d7bd-4986-9372-b37a201d647f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:12.183952 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658f32a-d7bd-4986-9372-b37a201d647f None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:12.203030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-8658f32a-d7bd-4986-9372-b37a201d647f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 20:36:12.203030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:12.203030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:12.203030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:12.203030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:12.203030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:12.203030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:12.203030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:12.203030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:12.203030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:12.203030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:12.203030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:12.203030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:36:12.203030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:36:12.203030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:36:12.203030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:36:12.204157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:12.204157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:12.204157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:36:12.204157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:12.204157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:36:12.204157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:12.204157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:12.204157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:12.204157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:12.204157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:12.204157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:12.204157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:12.204157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:12.204157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:12.204157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:12.204157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:12.204157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:12.204157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:12.205188 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:12.205188 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:12.205188 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:36:12.205188 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:36:12.205188 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:36:12.205188 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:36:12.205188 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:36:12.205188 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:36:12.205188 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 05 20:36:12.205188 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:12.209236 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 336/665] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 5 20:36:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:12.210249 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658f32a-d7bd-4986-9372-b37a201d647f None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:12.221575 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:12.222449 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e7bfb-3cb0-43ab-80e9-353046899841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:12.223395 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e7bfb-3cb0-43ab-80e9-353046899841 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:12.223704 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e7bfb-3cb0-43ab-80e9-353046899841 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:12.224795 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e7bfb-3cb0-43ab-80e9-353046899841 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:12.235942 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e7bfb-3cb0-43ab-80e9-353046899841 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:12.237410 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e7bfb-3cb0-43ab-80e9-353046899841 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:12.255424 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-9b7e7bfb-3cb0-43ab-80e9-353046899841 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:12.255424 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:12.255424 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:12.255424 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:12.255424 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:12.255424 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:12.255424 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:12.255424 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:12.255424 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:12.255424 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:12.255424 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:12.255424 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:12.255424 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:12.255424 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:12.255424 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:12.256342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:12.256342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:12.256342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:12.256342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:12.256342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:12.256342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:12.256342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:12.256342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:12.256342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:12.256342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:12.256342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:12.256342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:12.256342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:12.256342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:12.256342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:12.256342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:12.256342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:12.257259 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:12.257259 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:12.257259 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:12.257259 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:12.257259 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 330/666] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:12.257567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e7bfb-3cb0-43ab-80e9-353046899841 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:12.334111 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658f32a-d7bd-4986-9372-b37a201d647f None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:12.360607 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:12.364145 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e7bfb-3cb0-43ab-80e9-353046899841 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:12.369512 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0b20e-f5d9-4136-a495-58f53878ecaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:12.370346 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0b20e-f5d9-4136-a495-58f53878ecaa None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:12.370626 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0b20e-f5d9-4136-a495-58f53878ecaa None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:12.370899 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0b20e-f5d9-4136-a495-58f53878ecaa None admin] PATH_INFO: `/v3/roles/service` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:12.381325 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0b20e-f5d9-4136-a495-58f53878ecaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:36:12.389009 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-3fd0b20e-f5d9-4136-a495-58f53878ecaa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:36:12.389009 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:12.389009 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:12.389009 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:12.389009 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:12.389009 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:12.389009 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:12.389009 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:12.389009 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:12.389009 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:12.389009 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:12.389009 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:12.389009 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:36:12.389009 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:36:12.389009 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:36:12.389009 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:36:12.389991 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:36:12.389991 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:36:12.389991 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:36:12.389991 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:36:12.389991 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:12.389991 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:12.389991 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:12.389991 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:12.389991 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:12.389991 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:12.389991 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:12.389991 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:12.389991 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:12.389991 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:12.389991 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:12.389991 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:12.390852 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:12.390852 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:12.390852 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:12.390852 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:12.390852 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:36:12.390852 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:36:12.390852 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:36:12.390852 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:36:12.390852 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:36:12.390852 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:36:12.390852 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:36:12.390852 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:12.390852 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 337/667] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 5 20:36:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:12.391585 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0b20e-f5d9-4136-a495-58f53878ecaa None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:12.406053 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b82c6-5f2e-456a-a37a-e1b380d9790d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:12.406714 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b82c6-5f2e-456a-a37a-e1b380d9790d None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:12.407087 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b82c6-5f2e-456a-a37a-e1b380d9790d None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:12.407373 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b82c6-5f2e-456a-a37a-e1b380d9790d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:12.408341 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b82c6-5f2e-456a-a37a-e1b380d9790d None admin] RBAC: Adding query filter params (role.id=4f5057900b094e6fb792884693177cd3, scope.project.id=b321588ec1f14bcb94a184310cf72856, user.id=a05f331339d143c09eaa12efe2b80653) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:12.408629 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b82c6-5f2e-456a-a37a-e1b380d9790d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:12.410087 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b82c6-5f2e-456a-a37a-e1b380d9790d None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:12.416576 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 331/668] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:36:12 2022] GET /identity/v3/role_assignments?user.id=a05f331339d143c09eaa12efe2b80653&scope.project.id=b321588ec1f14bcb94a184310cf72856&role.id=4f5057900b094e6fb792884693177cd3 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:12.417285 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b82c6-5f2e-456a-a37a-e1b380d9790d None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:12.490045 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:12.529344 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0b20e-f5d9-4136-a495-58f53878ecaa None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:12.563131 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b82c6-5f2e-456a-a37a-e1b380d9790d None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:12.568449 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b3a6e-5c64-4e2e-a040-3f0722f3e6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:12.569230 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b3a6e-5c64-4e2e-a040-3f0722f3e6f3 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:12.569576 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b3a6e-5c64-4e2e-a040-3f0722f3e6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:12.569964 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b3a6e-5c64-4e2e-a040-3f0722f3e6f3 None admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:12.570883 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b3a6e-5c64-4e2e-a040-3f0722f3e6f3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:12.571190 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b3a6e-5c64-4e2e-a040-3f0722f3e6f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:12.572642 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b3a6e-5c64-4e2e-a040-3f0722f3e6f3 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:12.594537 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 338/669] 10.222.0.27 () {56 vars in 1139 bytes} [Tue Jul 5 20:36:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:12.595052 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b3a6e-5c64-4e2e-a040-3f0722f3e6f3 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:12.604885 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932116da-5d32-493f-88e6-72993248f1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:12.605836 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932116da-5d32-493f-88e6-72993248f1ef None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:12.606225 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932116da-5d32-493f-88e6-72993248f1ef None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:12.606503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932116da-5d32-493f-88e6-72993248f1ef None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:12.607236 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932116da-5d32-493f-88e6-72993248f1ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:12.607541 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932116da-5d32-493f-88e6-72993248f1ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:12.608952 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932116da-5d32-493f-88e6-72993248f1ef None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:12.624022 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 332/670] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:12.624851 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932116da-5d32-493f-88e6-72993248f1ef None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:12.655213 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:12.718087 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b3a6e-5c64-4e2e-a040-3f0722f3e6f3 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:12.746302 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:12.754503 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982f1aa-3051-494e-a39b-73ad1684b1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:12.755117 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932116da-5d32-493f-88e6-72993248f1ef None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:12.755233 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982f1aa-3051-494e-a39b-73ad1684b1f9 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:12.755455 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982f1aa-3051-494e-a39b-73ad1684b1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:12.755731 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982f1aa-3051-494e-a39b-73ad1684b1f9 None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:12.756483 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982f1aa-3051-494e-a39b-73ad1684b1f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:12.756786 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982f1aa-3051-494e-a39b-73ad1684b1f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:12.758260 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982f1aa-3051-494e-a39b-73ad1684b1f9 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:12.768020 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 339/671] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 5 20:36:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:12.768862 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982f1aa-3051-494e-a39b-73ad1684b1f9 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:12.796009 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37701114-150f-455a-806b-2c17078aa3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:12.796659 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37701114-150f-455a-806b-2c17078aa3a0 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:12.796935 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37701114-150f-455a-806b-2c17078aa3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:12.797206 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37701114-150f-455a-806b-2c17078aa3a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:12.867230 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37701114-150f-455a-806b-2c17078aa3a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:12.868705 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37701114-150f-455a-806b-2c17078aa3a0 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:12.874864 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982f1aa-3051-494e-a39b-73ad1684b1f9 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:12.893555 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:12.910332 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32eb65b-1ab9-4e69-8111-388e3e943141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:12.911190 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32eb65b-1ab9-4e69-8111-388e3e943141 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:12.911475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32eb65b-1ab9-4e69-8111-388e3e943141 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:12.911745 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32eb65b-1ab9-4e69-8111-388e3e943141 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:12.918997 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32eb65b-1ab9-4e69-8111-388e3e943141 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:12.920472 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32eb65b-1ab9-4e69-8111-388e3e943141 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:12.935419 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-a32eb65b-1ab9-4e69-8111-388e3e943141 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:12.935419 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:12.935419 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:12.935419 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:12.935419 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:12.935419 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:12.935419 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:12.935419 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:12.935419 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:12.935419 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:12.935419 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:12.935419 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:12.935419 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:36:12.935419 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:36:12.935419 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:36:12.936327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:36:12.936327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:12.936327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:12.936327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:12.936327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:12.936327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:12.936327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:12.936327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:12.936327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:12.936327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:12.936327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:12.936327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:12.936327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:12.936327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:12.936327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:12.936327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:12.936327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:12.937285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:36:12.937285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:36:12.937285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:36:12.937285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:36:12.937285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:36:12.937285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:36:12.937285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:12.937285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:12.937285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 340/672] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:36:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:12.937788 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32eb65b-1ab9-4e69-8111-388e3e943141 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:12.977687 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 333/673] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:36:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:36:12.978636 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37701114-150f-455a-806b-2c17078aa3a0 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:12.987061 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:13.043375 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32eb65b-1ab9-4e69-8111-388e3e943141 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:13.079150 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e836a9-02b7-4082-90dc-654821d6f4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:13.079911 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37701114-150f-455a-806b-2c17078aa3a0 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:13.080416 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e836a9-02b7-4082-90dc-654821d6f4f4 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:13.080416 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e836a9-02b7-4082-90dc-654821d6f4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:13.080704 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e836a9-02b7-4082-90dc-654821d6f4f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:13.091435 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e836a9-02b7-4082-90dc-654821d6f4f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:13.092923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e836a9-02b7-4082-90dc-654821d6f4f4 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:13.107143 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:13.111519 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-d0e836a9-02b7-4082-90dc-654821d6f4f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:13.111519 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:13.111519 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:13.111519 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:13.111519 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:13.111519 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:13.111519 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:13.111519 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:13.111519 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:13.111519 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:13.111519 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:13.111519 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:13.111519 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:13.111519 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:13.111519 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:13.113523 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:13.113523 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:13.113523 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:13.113523 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:13.113523 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:13.113523 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:13.113523 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:13.113523 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:13.113523 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:13.113523 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:13.113523 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:13.113523 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:13.113523 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:13.113523 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:13.113523 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:13.113523 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:13.113523 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:13.118598 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:13.118598 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:13.118598 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:13.118598 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:13.118598 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 341/674] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:13.118598 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e836a9-02b7-4082-90dc-654821d6f4f4 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:13.120791 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00316a7-bbd8-4aab-9a95-e4cf7c0727e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:13.121519 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00316a7-bbd8-4aab-9a95-e4cf7c0727e4 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:13.121942 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00316a7-bbd8-4aab-9a95-e4cf7c0727e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:13.122278 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00316a7-bbd8-4aab-9a95-e4cf7c0727e4 None admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:13.123149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00316a7-bbd8-4aab-9a95-e4cf7c0727e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:13.123519 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00316a7-bbd8-4aab-9a95-e4cf7c0727e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:13.125075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00316a7-bbd8-4aab-9a95-e4cf7c0727e4 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:13.146295 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 334/675] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 5 20:36:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:13.147396 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00316a7-bbd8-4aab-9a95-e4cf7c0727e4 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:13.228272 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:13.233298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e836a9-02b7-4082-90dc-654821d6f4f4 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:13.264274 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00316a7-bbd8-4aab-9a95-e4cf7c0727e4 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:13.274849 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e09de-5884-4a7e-a831-aff20ef9d01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:13.275898 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e09de-5884-4a7e-a831-aff20ef9d01f None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:13.276363 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e09de-5884-4a7e-a831-aff20ef9d01f None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:13.276792 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e09de-5884-4a7e-a831-aff20ef9d01f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:13.288034 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e09de-5884-4a7e-a831-aff20ef9d01f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:13.289715 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e09de-5884-4a7e-a831-aff20ef9d01f None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:13.300425 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec0605-dae0-46a6-842b-c0d44c5de503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:13.301148 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec0605-dae0-46a6-842b-c0d44c5de503 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:13.301371 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec0605-dae0-46a6-842b-c0d44c5de503 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:13.301643 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec0605-dae0-46a6-842b-c0d44c5de503 None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:13.302454 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec0605-dae0-46a6-842b-c0d44c5de503 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:13.302757 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec0605-dae0-46a6-842b-c0d44c5de503 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:13.304126 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec0605-dae0-46a6-842b-c0d44c5de503 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:13.310381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-1a8e09de-5884-4a7e-a831-aff20ef9d01f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:13.310381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:13.310381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:13.310381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:13.310381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:13.310381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:13.310381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:13.310381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:13.310381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:13.310381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:13.310381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:13.310381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:13.310381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:13.310381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:13.310381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:13.311495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:13.311495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:13.311495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:13.311495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:13.311495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:13.311495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:13.311495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:13.311495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:13.311495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:13.311495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:13.311495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:13.311495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:13.311495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:13.311495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:13.311495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:13.311495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:13.311495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:13.312632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:13.312632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:13.312632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:13.312632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:13.314551 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 342/676] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:13.315542 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e09de-5884-4a7e-a831-aff20ef9d01f None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:13.320872 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 335/677] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:13.320872 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec0605-dae0-46a6-842b-c0d44c5de503 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:13.366220 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:13.422422 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec0605-dae0-46a6-842b-c0d44c5de503 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:13.423508 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e09de-5884-4a7e-a831-aff20ef9d01f None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:13.457247 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc8978-aa26-4690-ad60-4fd5a8c79f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:13.458148 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc8978-aa26-4690-ad60-4fd5a8c79f1c None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:13.458384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc8978-aa26-4690-ad60-4fd5a8c79f1c None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:13.458660 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc8978-aa26-4690-ad60-4fd5a8c79f1c None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:13.459379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc8978-aa26-4690-ad60-4fd5a8c79f1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:13.459678 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc8978-aa26-4690-ad60-4fd5a8c79f1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:13.460609 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb743e2-33b9-4d04-a31a-b68ca3eda277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:13.461167 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc8978-aa26-4690-ad60-4fd5a8c79f1c None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:13.461694 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb743e2-33b9-4d04-a31a-b68ca3eda277 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:13.462205 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb743e2-33b9-4d04-a31a-b68ca3eda277 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:13.462683 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb743e2-33b9-4d04-a31a-b68ca3eda277 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:13.463750 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb743e2-33b9-4d04-a31a-b68ca3eda277 None admin] RBAC: Adding query filter params (role.id=4f5057900b094e6fb792884693177cd3, scope.project.id=b321588ec1f14bcb94a184310cf72856, user.id=2141561d059043baa440e966a5e1c6cf) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:13.464264 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb743e2-33b9-4d04-a31a-b68ca3eda277 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:13.466080 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb743e2-33b9-4d04-a31a-b68ca3eda277 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:13.472733 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 343/678] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:36:13 2022] GET /identity/v3/role_assignments?user.id=2141561d059043baa440e966a5e1c6cf&scope.project.id=b321588ec1f14bcb94a184310cf72856&role.id=4f5057900b094e6fb792884693177cd3 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:13.473811 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb743e2-33b9-4d04-a31a-b68ca3eda277 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:13.478280 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 336/679] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:13.484293 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc8978-aa26-4690-ad60-4fd5a8c79f1c None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:13.491940 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:13.587787 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb743e2-33b9-4d04-a31a-b68ca3eda277 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:13.626060 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c170f-8e3b-4f2e-b808-e55fa0800dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:13.627228 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c170f-8e3b-4f2e-b808-e55fa0800dcd None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:13.627731 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c170f-8e3b-4f2e-b808-e55fa0800dcd None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:13.628220 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c170f-8e3b-4f2e-b808-e55fa0800dcd None admin] PATH_INFO: `/v3/users/swift` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:13.635333 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc8978-aa26-4690-ad60-4fd5a8c79f1c None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:13.636720 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c170f-8e3b-4f2e-b808-e55fa0800dcd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:13.637996 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:13.638888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c170f-8e3b-4f2e-b808-e55fa0800dcd None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:13.656420 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-f54c170f-8e3b-4f2e-b808-e55fa0800dcd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 20:36:13.656420 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:13.656420 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:13.656420 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:13.656420 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:13.656420 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:13.656420 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:13.656420 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:13.656420 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:13.656420 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:13.656420 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:13.656420 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:13.656420 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:36:13.656420 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:36:13.656420 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:36:13.656420 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:36:13.657472 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:13.657472 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:13.657472 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:36:13.657472 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:13.657472 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:36:13.657472 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:13.657472 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:13.657472 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:13.657472 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:13.657472 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:13.657472 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:13.657472 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:13.657472 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:13.657472 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:13.657472 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:13.657472 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:13.657472 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:13.657472 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:13.658482 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:13.658482 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:13.658482 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:36:13.658482 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:36:13.658482 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:36:13.658482 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:36:13.658482 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:36:13.658482 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:36:13.658482 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 20:36:13.658482 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:13.661379 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 344/680] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 5 20:36:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:13.667634 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c170f-8e3b-4f2e-b808-e55fa0800dcd None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:13.677657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b8269-1854-4d1a-b67f-e9b10a2c2f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:13.678430 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b8269-1854-4d1a-b67f-e9b10a2c2f3c None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:13.678704 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b8269-1854-4d1a-b67f-e9b10a2c2f3c None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:13.678970 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b8269-1854-4d1a-b67f-e9b10a2c2f3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:13.687421 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b8269-1854-4d1a-b67f-e9b10a2c2f3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:13.688874 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b8269-1854-4d1a-b67f-e9b10a2c2f3c None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:13.704097 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-4a3b8269-1854-4d1a-b67f-e9b10a2c2f3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:13.704097 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:13.704097 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:13.704097 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:13.704097 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:13.704097 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:13.704097 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:13.704097 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:13.704097 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:13.704097 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:13.704097 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:13.704097 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:13.704097 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:36:13.704097 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:36:13.704097 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:36:13.705103 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:36:13.705103 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:13.705103 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:13.705103 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:13.705103 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:13.705103 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:13.705103 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:13.705103 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:13.705103 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:13.705103 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:13.705103 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:13.705103 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:13.705103 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:13.705103 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:13.705103 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:13.705103 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:13.705103 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:13.706166 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:36:13.706166 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:36:13.706166 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:36:13.706166 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:36:13.706166 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:36:13.706166 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:36:13.706166 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:13.706166 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:13.706166 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 337/681] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:36:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:36:13.711162 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b8269-1854-4d1a-b67f-e9b10a2c2f3c None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:13.756675 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:13.786087 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c170f-8e3b-4f2e-b808-e55fa0800dcd None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:13.818930 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b8269-1854-4d1a-b67f-e9b10a2c2f3c None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:13.831464 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a6d30-988e-41f8-acd4-f395a4e31759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:13.834263 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a6d30-988e-41f8-acd4-f395a4e31759 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:13.834773 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a6d30-988e-41f8-acd4-f395a4e31759 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:13.835265 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a6d30-988e-41f8-acd4-f395a4e31759 None admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:13.836310 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a6d30-988e-41f8-acd4-f395a4e31759 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:13.836820 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a6d30-988e-41f8-acd4-f395a4e31759 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:13.838536 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a6d30-988e-41f8-acd4-f395a4e31759 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:13.864226 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 345/682] 10.222.0.27 () {56 vars in 1135 bytes} [Tue Jul 5 20:36:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:36:13.871970 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a6d30-988e-41f8-acd4-f395a4e31759 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:13.879546 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868557f-6ca1-4624-bfee-45c23224f401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:13.880219 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868557f-6ca1-4624-bfee-45c23224f401 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:13.880494 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868557f-6ca1-4624-bfee-45c23224f401 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:13.880763 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868557f-6ca1-4624-bfee-45c23224f401 None admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:13.881555 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868557f-6ca1-4624-bfee-45c23224f401 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:13.881880 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868557f-6ca1-4624-bfee-45c23224f401 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:13.883347 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2868557f-6ca1-4624-bfee-45c23224f401 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:13.897469 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 338/683] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 5 20:36:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:13.903105 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868557f-6ca1-4624-bfee-45c23224f401 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:13.933911 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:14.004290 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a6d30-988e-41f8-acd4-f395a4e31759 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:14.022824 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868557f-6ca1-4624-bfee-45c23224f401 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:14.047283 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:14.056861 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac076886-7f5d-4895-8b83-9f865f8d722e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:14.057692 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac076886-7f5d-4895-8b83-9f865f8d722e None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:14.058065 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac076886-7f5d-4895-8b83-9f865f8d722e None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:14.058433 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac076886-7f5d-4895-8b83-9f865f8d722e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:14.069550 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8186a20-e787-4a41-b70c-21c516bd18c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:14.070510 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8186a20-e787-4a41-b70c-21c516bd18c5 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:14.070936 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8186a20-e787-4a41-b70c-21c516bd18c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:14.071372 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8186a20-e787-4a41-b70c-21c516bd18c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:14.072366 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8186a20-e787-4a41-b70c-21c516bd18c5 None admin] RBAC: Adding query filter params (role.id=4f5057900b094e6fb792884693177cd3, scope.project.id=b321588ec1f14bcb94a184310cf72856, user.id=157a258bcff642cb91a0a474f8f50941) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:14.072830 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8186a20-e787-4a41-b70c-21c516bd18c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:14.074471 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8186a20-e787-4a41-b70c-21c516bd18c5 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:14.090097 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 339/684] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:36:13 2022] GET /identity/v3/role_assignments?user.id=157a258bcff642cb91a0a474f8f50941&scope.project.id=b321588ec1f14bcb94a184310cf72856&role.id=4f5057900b094e6fb792884693177cd3 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:36:14.189240 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac076886-7f5d-4895-8b83-9f865f8d722e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:14.190719 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac076886-7f5d-4895-8b83-9f865f8d722e None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:14.322484 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f2f97-ddbc-4746-ae10-c44846ecbad6 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:14.322817 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f2f97-ddbc-4746-ae10-c44846ecbad6 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:14.323041 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f2f97-ddbc-4746-ae10-c44846ecbad6 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:14.326019 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 346/686] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:36:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:36:14.328433 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 340/686] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:36:14.330165 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509442c-54b9-4472-8343-72585721940c None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:14.330619 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509442c-54b9-4472-8343-72585721940c None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:14.330952 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509442c-54b9-4472-8343-72585721940c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:14.331606 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f2f97-ddbc-4746-ae10-c44846ecbad6 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:14.348117 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-8509442c-54b9-4472-8343-72585721940c None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:14.349336 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-8509442c-54b9-4472-8343-72585721940c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:14.388560 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:14.434179 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 347/687] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:36:14.450872 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:14.458331 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509442c-54b9-4472-8343-72585721940c None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:14.468677 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f2f97-ddbc-4746-ae10-c44846ecbad6 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:14.507688 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab10d0-9633-49f3-bc30-a1a46743c533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:14.508496 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab10d0-9633-49f3-bc30-a1a46743c533 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:14.508770 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab10d0-9633-49f3-bc30-a1a46743c533 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:14.509134 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab10d0-9633-49f3-bc30-a1a46743c533 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:14.523537 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab10d0-9633-49f3-bc30-a1a46743c533 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:14.525864 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab10d0-9633-49f3-bc30-a1a46743c533 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:14.547709 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-a3ab10d0-9633-49f3-bc30-a1a46743c533 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:14.547709 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:14.547709 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:14.547709 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:14.547709 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:14.547709 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:14.547709 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:14.547709 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:14.547709 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:14.547709 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:14.547709 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:14.547709 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:14.547709 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:14.547709 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:14.547709 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:14.548657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:14.548657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:14.548657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:14.548657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:14.548657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:14.548657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:14.548657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:14.548657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:14.548657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:14.548657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:14.548657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:14.548657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:14.548657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:14.548657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:14.548657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:14.548657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:14.548657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:14.549534 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:14.549534 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:14.549534 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:14.549534 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:14.549917 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 341/688] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:36:14.556521 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab10d0-9633-49f3-bc30-a1a46743c533 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:14.579246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509442c-54b9-4472-8343-72585721940c None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:14.617980 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6ec37-8a5b-432d-9a31-7287240ce483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:14.618791 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6ec37-8a5b-432d-9a31-7287240ce483 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:14.619099 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6ec37-8a5b-432d-9a31-7287240ce483 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:14.619341 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6ec37-8a5b-432d-9a31-7287240ce483 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:14.630885 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e6ec37-8a5b-432d-9a31-7287240ce483 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:36:14.638888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-b1e6ec37-8a5b-432d-9a31-7287240ce483 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:36:14.638888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:14.638888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:14.638888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:14.638888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:14.638888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:14.638888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:14.638888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:14.638888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:14.638888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:14.638888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:14.638888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:14.638888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:36:14.638888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:36:14.638888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:36:14.638888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:36:14.639810 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:36:14.639810 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:36:14.639810 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:36:14.639810 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:36:14.639810 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:14.639810 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:14.639810 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:14.639810 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:14.639810 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:14.639810 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:14.639810 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:14.639810 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:14.639810 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:14.639810 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:14.639810 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:14.639810 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:14.640660 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:14.640660 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:14.640660 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:14.640660 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:14.640660 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:36:14.640660 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:36:14.640660 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:36:14.640660 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:36:14.640660 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:36:14.640660 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:36:14.640660 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:36:14.640660 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:14.645120 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 348/689] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 5 20:36:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:36:14.646421 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6ec37-8a5b-432d-9a31-7287240ce483 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:14.673072 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:14.683757 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab10d0-9633-49f3-bc30-a1a46743c533 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:14.720715 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa4d2b-3b7a-443f-b2d4-e4e1623a59c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:14.721306 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa4d2b-3b7a-443f-b2d4-e4e1623a59c4 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:14.721590 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa4d2b-3b7a-443f-b2d4-e4e1623a59c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:14.721900 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa4d2b-3b7a-443f-b2d4-e4e1623a59c4 None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:14.722641 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa4d2b-3b7a-443f-b2d4-e4e1623a59c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:14.722948 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa4d2b-3b7a-443f-b2d4-e4e1623a59c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:14.724406 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa4d2b-3b7a-443f-b2d4-e4e1623a59c4 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:14.733744 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:14.742034 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 342/690] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:14.743629 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa4d2b-3b7a-443f-b2d4-e4e1623a59c4 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:14.770172 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6ec37-8a5b-432d-9a31-7287240ce483 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:14.847120 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9e363-4f55-4877-a2f4-5b2b2ed534ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:14.848059 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9e363-4f55-4877-a2f4-5b2b2ed534ac None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:14.848479 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9e363-4f55-4877-a2f4-5b2b2ed534ac None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:14.848876 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9e363-4f55-4877-a2f4-5b2b2ed534ac None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:14.849791 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d9e363-4f55-4877-a2f4-5b2b2ed534ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:14.850269 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d9e363-4f55-4877-a2f4-5b2b2ed534ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:14.851784 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d9e363-4f55-4877-a2f4-5b2b2ed534ac None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:14.868099 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 349/691] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:36:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:36:14.874223 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7924f-6274-4766-a240-005c8336b9f9 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:14.874512 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7924f-6274-4766-a240-005c8336b9f9 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:14.874789 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7924f-6274-4766-a240-005c8336b9f9 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:14.877240 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 350/692] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:36:14.883080 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7924f-6274-4766-a240-005c8336b9f9 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:14.886621 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa4d2b-3b7a-443f-b2d4-e4e1623a59c4 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:14.929526 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50045654-97ce-496c-973f-c9dc9fecbcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:14.930515 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50045654-97ce-496c-973f-c9dc9fecbcc5 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:14.930896 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50045654-97ce-496c-973f-c9dc9fecbcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:14.931266 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50045654-97ce-496c-973f-c9dc9fecbcc5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:14.939346 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50045654-97ce-496c-973f-c9dc9fecbcc5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:14.941143 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50045654-97ce-496c-973f-c9dc9fecbcc5 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:14.956908 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-50045654-97ce-496c-973f-c9dc9fecbcc5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:14.956908 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:14.956908 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:14.956908 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:14.956908 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:14.956908 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:14.956908 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:14.956908 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:14.956908 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:14.956908 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:14.956908 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:14.956908 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:14.956908 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:36:14.956908 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:36:14.956908 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:36:14.958118 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:36:14.958118 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:14.958118 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:14.958118 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:14.958118 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:14.958118 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:14.958118 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:14.958118 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:14.958118 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:14.958118 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:14.958118 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:14.958118 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:14.958118 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:14.958118 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:14.958118 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:14.958118 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:14.958118 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:14.959825 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:36:14.959825 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:36:14.959825 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:36:14.959825 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:36:14.959825 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:36:14.959825 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:36:14.959825 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:14.959825 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:14.965122 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 343/693] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:36:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:36:14.966526 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cbe28-5391-4b19-9f0a-acf2e7b29ae4 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:14.966818 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cbe28-5391-4b19-9f0a-acf2e7b29ae4 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:14.967089 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cbe28-5391-4b19-9f0a-acf2e7b29ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:14.981749 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:14.986413 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-5d3cbe28-5391-4b19-9f0a-acf2e7b29ae4 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:14.987790 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-5d3cbe28-5391-4b19-9f0a-acf2e7b29ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:15.000450 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7924f-6274-4766-a240-005c8336b9f9 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:15.042459 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ef7b6-b8cf-4f2c-bda1-d94557bf175b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:15.043646 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ef7b6-b8cf-4f2c-bda1-d94557bf175b None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:15.043931 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ef7b6-b8cf-4f2c-bda1-d94557bf175b None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:15.044210 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ef7b6-b8cf-4f2c-bda1-d94557bf175b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:15.049977 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:15.058098 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ef7b6-b8cf-4f2c-bda1-d94557bf175b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:15.060153 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ef7b6-b8cf-4f2c-bda1-d94557bf175b None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:15.064057 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 344/694] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:36:15.065128 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3cbe28-5391-4b19-9f0a-acf2e7b29ae4 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:15.095295 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-496ef7b6-b8cf-4f2c-bda1-d94557bf175b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:15.095295 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:15.095295 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:15.095295 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:15.095295 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:15.095295 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:15.095295 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:15.095295 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:15.095295 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:15.095295 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:15.095295 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:15.095295 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:15.095295 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:15.095295 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:15.095295 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:15.096343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:15.096343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:15.096343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:15.096343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:15.096343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:15.096343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:15.096343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:15.096343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:15.096343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:15.096343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:15.096343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:15.096343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:15.096343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:15.096343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:15.096343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:15.096343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:15.096343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:15.097263 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:15.097263 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:15.097263 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:15.097263 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:15.103568 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 351/695] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:15.104565 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ef7b6-b8cf-4f2c-bda1-d94557bf175b None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:15.190202 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3cbe28-5391-4b19-9f0a-acf2e7b29ae4 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:15.223069 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ef7b6-b8cf-4f2c-bda1-d94557bf175b None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:15.224851 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644f19c-5969-4f96-a6bf-d378f37ab8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:15.225492 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644f19c-5969-4f96-a6bf-d378f37ab8e0 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:15.225775 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644f19c-5969-4f96-a6bf-d378f37ab8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:15.226071 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644f19c-5969-4f96-a6bf-d378f37ab8e0 None admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:15.227034 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644f19c-5969-4f96-a6bf-d378f37ab8e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:15.227170 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644f19c-5969-4f96-a6bf-d378f37ab8e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:15.228603 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644f19c-5969-4f96-a6bf-d378f37ab8e0 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:15.245609 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 345/696] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 5 20:36:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:15.245609 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644f19c-5969-4f96-a6bf-d378f37ab8e0 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:15.267743 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67ea92-deea-4c66-81ae-6c179749494a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:15.268860 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67ea92-deea-4c66-81ae-6c179749494a None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:15.269300 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67ea92-deea-4c66-81ae-6c179749494a None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:15.269779 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67ea92-deea-4c66-81ae-6c179749494a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:15.273005 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:15.283966 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67ea92-deea-4c66-81ae-6c179749494a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:15.285721 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67ea92-deea-4c66-81ae-6c179749494a None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:15.291811 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:15.308023 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-6a67ea92-deea-4c66-81ae-6c179749494a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:15.308023 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:15.308023 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:15.308023 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:15.308023 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:15.308023 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:15.308023 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:15.308023 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:15.308023 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:15.308023 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:15.308023 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:15.308023 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:15.308023 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:15.308023 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:15.308023 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:15.310097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:15.310097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:15.310097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:15.310097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:15.310097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:15.310097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:15.310097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:15.310097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:15.310097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:15.310097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:15.310097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:15.310097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:15.310097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:15.310097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:15.310097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:15.310097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:15.310097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:15.312170 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:15.312170 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:15.312170 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:15.312170 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:15.315308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 352/697] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:15.316729 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67ea92-deea-4c66-81ae-6c179749494a None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:15.347456 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644f19c-5969-4f96-a6bf-d378f37ab8e0 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:15.392502 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0254f56c-21f5-4ca8-88a3-90ccf18b8a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:15.393170 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254f56c-21f5-4ca8-88a3-90ccf18b8a12 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:15.393450 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254f56c-21f5-4ca8-88a3-90ccf18b8a12 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:15.393725 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254f56c-21f5-4ca8-88a3-90ccf18b8a12 None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:15.394481 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0254f56c-21f5-4ca8-88a3-90ccf18b8a12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:15.394787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0254f56c-21f5-4ca8-88a3-90ccf18b8a12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:15.396201 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0254f56c-21f5-4ca8-88a3-90ccf18b8a12 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:15.415450 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 346/698] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:15.416317 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0254f56c-21f5-4ca8-88a3-90ccf18b8a12 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:15.451369 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67ea92-deea-4c66-81ae-6c179749494a None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:15.498361 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941be435-8436-487d-8834-5b26e4275437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:15.499639 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941be435-8436-487d-8834-5b26e4275437 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:15.500575 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941be435-8436-487d-8834-5b26e4275437 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:15.501081 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941be435-8436-487d-8834-5b26e4275437 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:15.502370 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941be435-8436-487d-8834-5b26e4275437 None admin] RBAC: Adding query filter params (role.id=4f5057900b094e6fb792884693177cd3, scope.project.id=b321588ec1f14bcb94a184310cf72856, user.id=90aa580a2e10467a93c2d79d1906bd8a) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:15.503115 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941be435-8436-487d-8834-5b26e4275437 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:15.505136 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941be435-8436-487d-8834-5b26e4275437 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:15.519263 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 353/699] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:36:15 2022] GET /identity/v3/role_assignments?user.id=90aa580a2e10467a93c2d79d1906bd8a&scope.project.id=b321588ec1f14bcb94a184310cf72856&role.id=4f5057900b094e6fb792884693177cd3 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:15.519263 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941be435-8436-487d-8834-5b26e4275437 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:15.529237 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0254f56c-21f5-4ca8-88a3-90ccf18b8a12 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:15.563888 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:15.592328 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:15.651323 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c7d3f-0404-4d96-8333-dc5d2bb6bce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:15.652013 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c7d3f-0404-4d96-8333-dc5d2bb6bce9 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:15.652290 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c7d3f-0404-4d96-8333-dc5d2bb6bce9 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:15.652561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c7d3f-0404-4d96-8333-dc5d2bb6bce9 None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:15.653633 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c7d3f-0404-4d96-8333-dc5d2bb6bce9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:15.653633 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c7d3f-0404-4d96-8333-dc5d2bb6bce9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:15.655093 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c7d3f-0404-4d96-8333-dc5d2bb6bce9 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:15.657165 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941be435-8436-487d-8834-5b26e4275437 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:15.676962 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 347/700] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:15.679928 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c7d3f-0404-4d96-8333-dc5d2bb6bce9 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:15.743336 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22537b1c-0e21-4a2f-b5e7-55d32ebde248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:15.744220 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22537b1c-0e21-4a2f-b5e7-55d32ebde248 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:15.744505 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22537b1c-0e21-4a2f-b5e7-55d32ebde248 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:15.744782 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22537b1c-0e21-4a2f-b5e7-55d32ebde248 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:15.764949 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22537b1c-0e21-4a2f-b5e7-55d32ebde248 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:15.766684 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22537b1c-0e21-4a2f-b5e7-55d32ebde248 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:15.787062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-22537b1c-0e21-4a2f-b5e7-55d32ebde248 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 20:36:15.787062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:15.787062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:15.787062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:15.787062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:15.787062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:15.787062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:15.787062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:15.787062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:15.787062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:15.787062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:15.787062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:15.787062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:36:15.787062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:36:15.787062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:36:15.787062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:36:15.788475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:15.788475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:15.788475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:36:15.788475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:15.788475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:36:15.788475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:15.788475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:15.788475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:15.788475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:15.788475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:15.788475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:15.788475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:15.788475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:15.788475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:15.788475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:15.788475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:15.788475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:15.788475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:15.789427 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:15.789427 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:15.789427 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:36:15.789427 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:36:15.789427 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:36:15.789427 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:36:15.789427 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:36:15.789427 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:36:15.789427 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 20:36:15.789427 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:15.794441 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 354/701] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Jul 5 20:36:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:15.797050 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22537b1c-0e21-4a2f-b5e7-55d32ebde248 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:15.813783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c7d3f-0404-4d96-8333-dc5d2bb6bce9 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:15.848396 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491af16-b6e9-400a-9761-5101ac0475e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:15.849361 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491af16-b6e9-400a-9761-5101ac0475e2 None admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:15.849787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491af16-b6e9-400a-9761-5101ac0475e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:15.850226 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491af16-b6e9-400a-9761-5101ac0475e2 None admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:15.851063 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491af16-b6e9-400a-9761-5101ac0475e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:15.852655 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491af16-b6e9-400a-9761-5101ac0475e2 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:15.875732 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 348/702] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Jul 5 20:36:15 2022] POST /identity/v3/users => generated 254 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:36:15.925763 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22537b1c-0e21-4a2f-b5e7-55d32ebde248 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:15.941062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:15.967164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc0e59-27ef-43d8-b3c4-63c5743ef6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:15.968333 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc0e59-27ef-43d8-b3c4-63c5743ef6c5 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:15.968895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc0e59-27ef-43d8-b3c4-63c5743ef6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:15.969367 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc0e59-27ef-43d8-b3c4-63c5743ef6c5 None admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:15.970536 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc0e59-27ef-43d8-b3c4-63c5743ef6c5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:15.971087 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc0e59-27ef-43d8-b3c4-63c5743ef6c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:15.972772 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc0e59-27ef-43d8-b3c4-63c5743ef6c5 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:15.993887 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 355/703] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Jul 5 20:36:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:15.999853 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491af16-b6e9-400a-9761-5101ac0475e2 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:16.035342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:16.089739 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c4516-1930-48b8-8e6e-f57e104033c5 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:16.090108 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c4516-1930-48b8-8e6e-f57e104033c5 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:16.090333 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c4516-1930-48b8-8e6e-f57e104033c5 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:16.092079 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 356/704] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:16.097195 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc21c6d-30ca-4d89-83b6-3825299e178b None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:16.098065 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc21c6d-30ca-4d89-83b6-3825299e178b None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:16.098065 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc21c6d-30ca-4d89-83b6-3825299e178b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:16.119987 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-edc21c6d-30ca-4d89-83b6-3825299e178b None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:16.121203 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-edc21c6d-30ca-4d89-83b6-3825299e178b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:16.124248 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491af16-b6e9-400a-9761-5101ac0475e2 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:16.175586 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0813d6-a1da-41ea-8428-d2f0381f25e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:16.176691 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0813d6-a1da-41ea-8428-d2f0381f25e3 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:16.177286 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0813d6-a1da-41ea-8428-d2f0381f25e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:16.177765 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0813d6-a1da-41ea-8428-d2f0381f25e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:16.218564 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 357/705] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:36:16.246951 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc21c6d-30ca-4d89-83b6-3825299e178b None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:16.272942 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0813d6-a1da-41ea-8428-d2f0381f25e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:16.274398 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0813d6-a1da-41ea-8428-d2f0381f25e3 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:16.302774 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:16.351726 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:16.355264 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc21c6d-30ca-4d89-83b6-3825299e178b None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:16.382011 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 349/706] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:36:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:36:16.388266 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0813d6-a1da-41ea-8428-d2f0381f25e3 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:16.393594 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c2484-6745-493c-bb94-53dae03de5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:16.394699 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c2484-6745-493c-bb94-53dae03de5eb None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:16.395171 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c2484-6745-493c-bb94-53dae03de5eb None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:16.395626 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c2484-6745-493c-bb94-53dae03de5eb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:16.396505 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c2484-6745-493c-bb94-53dae03de5eb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:16.398129 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c2484-6745-493c-bb94-53dae03de5eb None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:16.420895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-4b3c2484-6745-493c-bb94-53dae03de5eb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 20:36:16.420895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:16.420895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:36:16.420895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:36:16.420895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:36:16.420895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:36:16.420895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:36:16.420895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:16.420895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 20:36:16.420895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:16.420895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:36:16.420895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:16.420895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:16.420895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:16.420895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:16.420895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:16.421989 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:16.421989 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:16.421989 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:16.421989 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:16.421989 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:16.421989 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:16.421989 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:16.421989 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:36:16.421989 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:36:16.421989 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:36:16.421989 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:36:16.421989 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:16.421989 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:16.421989 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:16.421989 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:16.421989 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:16.422877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:16.422877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:16.422877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:16.422877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:16.422877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:16.422877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:16.422877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:16.422877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:16.422877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:16.422877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:16.422877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:16.422877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:36:16.422877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:16.422877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 20:36:16.422877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:16.432933 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 358/707] 10.222.0.27 () {56 vars in 1129 bytes} [Tue Jul 5 20:36:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:36:16.440258 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c2484-6745-493c-bb94-53dae03de5eb None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:16.558072 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0813d6-a1da-41ea-8428-d2f0381f25e3 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:16.586517 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:16.587768 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c2484-6745-493c-bb94-53dae03de5eb None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:16.597489 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732e298-670b-4135-b2cb-f80ea469b241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:16.598353 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732e298-670b-4135-b2cb-f80ea469b241 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:16.598635 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732e298-670b-4135-b2cb-f80ea469b241 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:16.599013 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732e298-670b-4135-b2cb-f80ea469b241 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:16.610916 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5732e298-670b-4135-b2cb-f80ea469b241 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:16.612596 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5732e298-670b-4135-b2cb-f80ea469b241 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:16.622600 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3592c7f-d7eb-4b96-8ee7-bd67a7c18752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:16.623288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3592c7f-d7eb-4b96-8ee7-bd67a7c18752 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:16.623567 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3592c7f-d7eb-4b96-8ee7-bd67a7c18752 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:16.623835 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3592c7f-d7eb-4b96-8ee7-bd67a7c18752 None admin] PATH_INFO: `/v3/services` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:16.624539 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3592c7f-d7eb-4b96-8ee7-bd67a7c18752 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:16.624843 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3592c7f-d7eb-4b96-8ee7-bd67a7c18752 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:16.626270 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3592c7f-d7eb-4b96-8ee7-bd67a7c18752 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:16.631645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-5732e298-670b-4135-b2cb-f80ea469b241 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:16.631645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:16.631645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:16.631645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:16.631645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:16.631645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:16.631645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:16.631645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:16.631645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:16.631645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:16.631645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:16.631645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:16.631645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:16.631645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:16.631645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:16.632523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:16.632523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:16.632523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:16.632523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:16.632523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:16.632523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:16.632523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:16.632523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:16.632523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:16.632523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:16.632523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:16.632523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:16.632523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:16.632523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:16.632523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:16.632523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:16.632523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:16.633748 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:16.633748 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:16.633748 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:16.633748 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:16.634021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 359/708] 10.222.0.27 () {56 vars in 1124 bytes} [Tue Jul 5 20:36:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:16.634021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d94b5-44c9-4d6c-a6ec-0fd4db4db434 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:16.634021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d94b5-44c9-4d6c-a6ec-0fd4db4db434 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:16.634021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d94b5-44c9-4d6c-a6ec-0fd4db4db434 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:16.637960 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 350/710] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:16.638853 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732e298-670b-4135-b2cb-f80ea469b241 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:16.639296 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 360/710] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:16.640500 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad693d-f292-44ca-9a86-325df1f4ff96 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:16.640784 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad693d-f292-44ca-9a86-325df1f4ff96 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:16.641061 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad693d-f292-44ca-9a86-325df1f4ff96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:16.658377 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-33ad693d-f292-44ca-9a86-325df1f4ff96 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:16.659868 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-33ad693d-f292-44ca-9a86-325df1f4ff96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:16.689782 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:16.749999 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 361/711] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:36:16.750895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad693d-f292-44ca-9a86-325df1f4ff96 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:16.760820 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732e298-670b-4135-b2cb-f80ea469b241 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:16.812471 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb15cd3-4a58-42da-af68-04eebff01d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:16.813464 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb15cd3-4a58-42da-af68-04eebff01d75 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:16.813856 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb15cd3-4a58-42da-af68-04eebff01d75 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:16.814495 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb15cd3-4a58-42da-af68-04eebff01d75 None admin] PATH_INFO: `/v3/services` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:16.815684 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb15cd3-4a58-42da-af68-04eebff01d75 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:16.816089 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb15cd3-4a58-42da-af68-04eebff01d75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:16.817562 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb15cd3-4a58-42da-af68-04eebff01d75 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:16.826468 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 351/712] 10.222.0.27 () {56 vars in 1124 bytes} [Tue Jul 5 20:36:16 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:16.827641 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb15cd3-4a58-42da-af68-04eebff01d75 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:16.872295 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ad693d-f292-44ca-9a86-325df1f4ff96 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:16.891659 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:16.919504 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e76b28-e738-45e0-887a-e7d63d981f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:16.921245 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e76b28-e738-45e0-887a-e7d63d981f0e None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:16.921245 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e76b28-e738-45e0-887a-e7d63d981f0e None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:16.921245 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e76b28-e738-45e0-887a-e7d63d981f0e None admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:16.921725 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e76b28-e738-45e0-887a-e7d63d981f0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:16.921907 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e76b28-e738-45e0-887a-e7d63d981f0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:16.923277 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e76b28-e738-45e0-887a-e7d63d981f0e None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:16.942004 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 362/713] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:16.943458 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e76b28-e738-45e0-887a-e7d63d981f0e None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:16.971175 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:17.027613 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb15cd3-4a58-42da-af68-04eebff01d75 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:17.053038 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e76b28-e738-45e0-887a-e7d63d981f0e None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:17.089634 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e2a10-a039-4082-8203-7b12f8ba7847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:17.090719 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e2a10-a039-4082-8203-7b12f8ba7847 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:17.091094 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e2a10-a039-4082-8203-7b12f8ba7847 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:17.091482 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e2a10-a039-4082-8203-7b12f8ba7847 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:17.099075 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e2a10-a039-4082-8203-7b12f8ba7847 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:17.099324 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8de784-3e25-4b6e-91c6-ca3a5fde4698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:17.100152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8de784-3e25-4b6e-91c6-ca3a5fde4698 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:17.100436 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8de784-3e25-4b6e-91c6-ca3a5fde4698 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:17.100707 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8de784-3e25-4b6e-91c6-ca3a5fde4698 None admin] PATH_INFO: `/v3/services/network` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:17.101008 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e2a10-a039-4082-8203-7b12f8ba7847 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:17.101372 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8de784-3e25-4b6e-91c6-ca3a5fde4698 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:17.102777 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8de784-3e25-4b6e-91c6-ca3a5fde4698 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:17.116179 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-b97e2a10-a039-4082-8203-7b12f8ba7847 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:17.116179 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:17.116179 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:17.116179 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:17.116179 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:17.116179 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:17.116179 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:17.116179 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:17.116179 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:17.116179 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:17.116179 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:17.116179 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:17.116179 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:36:17.116179 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:36:17.116179 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:36:17.117142 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:36:17.117142 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:17.117142 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:17.117142 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:17.117142 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:17.117142 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:17.117142 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:17.117142 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:17.117142 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:17.117142 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:17.117142 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:17.117142 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:17.117142 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:17.117142 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:17.117142 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:17.117142 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:17.117142 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:17.118043 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:36:17.118043 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:36:17.118043 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:36:17.118043 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:36:17.118043 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:36:17.118043 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:36:17.118043 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:17.118043 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:17.120567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-6b8de784-3e25-4b6e-91c6-ca3a5fde4698 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 20:36:17.120567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:17.120567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:36:17.120567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:36:17.120567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:36:17.120567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:36:17.120567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:36:17.120567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:17.120567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 20:36:17.120567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:17.120567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:36:17.120567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:17.120567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:17.120567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:17.120567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:17.120567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:17.120567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:17.123017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:17.123017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:17.123017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:17.123017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:17.123017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:17.123017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:17.123017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:36:17.123017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:36:17.123017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:36:17.123017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:36:17.123017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:17.123017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:17.123017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:17.123017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:17.123017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:17.123017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:17.124764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:17.124764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:17.124764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:17.124764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:17.124764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:17.124764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:17.124764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:17.124764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:17.124764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:17.124764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:17.124764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:36:17.124764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:17.124764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 20:36:17.124764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:17.126866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 363/714] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:36:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:17.129267 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 352/715] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:36:16 2022] GET /identity/v3/services/network => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:17.129444 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e2a10-a039-4082-8203-7b12f8ba7847 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:17.129940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8de784-3e25-4b6e-91c6-ca3a5fde4698 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:17.244590 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8de784-3e25-4b6e-91c6-ca3a5fde4698 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:17.258330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:17.284419 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c5bee-8e73-4a17-af58-33014ae8b859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:17.285265 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c5bee-8e73-4a17-af58-33014ae8b859 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:17.285632 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c5bee-8e73-4a17-af58-33014ae8b859 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:17.285949 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c5bee-8e73-4a17-af58-33014ae8b859 None admin] PATH_INFO: `/v3/services` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:17.286697 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c5bee-8e73-4a17-af58-33014ae8b859 None admin] RBAC: Adding query filter params (name=network) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:17.287007 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c5bee-8e73-4a17-af58-33014ae8b859 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:17.288402 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c5bee-8e73-4a17-af58-33014ae8b859 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:17.300938 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 353/716] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Jul 5 20:36:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:17.307349 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c5bee-8e73-4a17-af58-33014ae8b859 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:17.330279 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:17.353788 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e2a10-a039-4082-8203-7b12f8ba7847 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:17.390983 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447c17f-7cf7-4cec-88f0-db01fc9576bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:17.391618 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447c17f-7cf7-4cec-88f0-db01fc9576bf None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:17.391899 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447c17f-7cf7-4cec-88f0-db01fc9576bf None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:17.392169 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447c17f-7cf7-4cec-88f0-db01fc9576bf None admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:17.392960 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1447c17f-7cf7-4cec-88f0-db01fc9576bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:17.393266 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1447c17f-7cf7-4cec-88f0-db01fc9576bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:17.394884 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1447c17f-7cf7-4cec-88f0-db01fc9576bf None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:17.408605 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 364/717] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 5 20:36:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:17.414301 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447c17f-7cf7-4cec-88f0-db01fc9576bf None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:17.515991 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c5bee-8e73-4a17-af58-33014ae8b859 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:17.551633 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00f4bf-19ea-4104-bfe0-ece9ddc0371f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:17.552302 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00f4bf-19ea-4104-bfe0-ece9ddc0371f None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:17.552579 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00f4bf-19ea-4104-bfe0-ece9ddc0371f None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:17.552851 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00f4bf-19ea-4104-bfe0-ece9ddc0371f None admin] PATH_INFO: `/v3/services` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:17.553568 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00f4bf-19ea-4104-bfe0-ece9ddc0371f None admin] RBAC: Adding query filter params (type=network) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:17.553889 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00f4bf-19ea-4104-bfe0-ece9ddc0371f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:17.555265 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00f4bf-19ea-4104-bfe0-ece9ddc0371f None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:17.566095 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 354/718] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Jul 5 20:36:17 2022] GET /identity/v3/services?type=network => generated 124 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:36:17.588577 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447c17f-7cf7-4cec-88f0-db01fc9576bf None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:17.641786 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7110319c-f211-4a08-8fc8-825ee24455a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:17.642462 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110319c-f211-4a08-8fc8-825ee24455a9 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:17.642748 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110319c-f211-4a08-8fc8-825ee24455a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:17.643021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110319c-f211-4a08-8fc8-825ee24455a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:17.643984 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7110319c-f211-4a08-8fc8-825ee24455a9 None admin] RBAC: Adding query filter params (role.id=37ba4a62052348d4811b560c19a07e02, scope.project.id=b321588ec1f14bcb94a184310cf72856, user.id=814b675b98b844a2a12a39890ee69d2b) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:17.644193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7110319c-f211-4a08-8fc8-825ee24455a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:17.645705 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7110319c-f211-4a08-8fc8-825ee24455a9 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:17.652930 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 365/719] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:36:17 2022] GET /identity/v3/role_assignments?user.id=814b675b98b844a2a12a39890ee69d2b&scope.project.id=b321588ec1f14bcb94a184310cf72856&role.id=37ba4a62052348d4811b560c19a07e02 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:18.322384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d054f6-7f4d-4d25-9515-2dc6005c8b9e None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:18.322897 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d054f6-7f4d-4d25-9515-2dc6005c8b9e None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:18.323003 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d054f6-7f4d-4d25-9515-2dc6005c8b9e None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:18.324617 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 355/720] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:18.329554 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09653d-4315-4b1d-9e41-2fa55ed5c328 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:18.329979 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09653d-4315-4b1d-9e41-2fa55ed5c328 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:18.330167 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09653d-4315-4b1d-9e41-2fa55ed5c328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:18.335244 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:18.358806 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-0f09653d-4315-4b1d-9e41-2fa55ed5c328 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:18.360001 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-0f09653d-4315-4b1d-9e41-2fa55ed5c328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:18.453241 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 366/721] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 05 20:36:18.489280 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d054f6-7f4d-4d25-9515-2dc6005c8b9e None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:18.532450 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:18.611543 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d054f6-7f4d-4d25-9515-2dc6005c8b9e None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:18.620011 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4158bac-4469-4919-a271-e972ed3dc94e None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:18.620297 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4158bac-4469-4919-a271-e972ed3dc94e None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:18.620570 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4158bac-4469-4919-a271-e972ed3dc94e None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:18.622272 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 367/722] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:18.636658 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64485124-7a8a-40cb-b65b-4bad3d8fa28e None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:18.636997 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64485124-7a8a-40cb-b65b-4bad3d8fa28e None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:18.637324 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64485124-7a8a-40cb-b65b-4bad3d8fa28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:18.667684 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-64485124-7a8a-40cb-b65b-4bad3d8fa28e None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:18.669053 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-64485124-7a8a-40cb-b65b-4bad3d8fa28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:18.683138 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb117c-f54f-412b-82c9-01e2a220aee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:18.683975 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb117c-f54f-412b-82c9-01e2a220aee5 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:18.684261 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb117c-f54f-412b-82c9-01e2a220aee5 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:18.684531 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb117c-f54f-412b-82c9-01e2a220aee5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:18.701689 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb117c-f54f-412b-82c9-01e2a220aee5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:36:18.709373 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-79eb117c-f54f-412b-82c9-01e2a220aee5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:36:18.709373 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:18.709373 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:18.709373 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:18.709373 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:18.709373 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:18.709373 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:18.709373 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:18.709373 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:18.709373 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:18.709373 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:18.709373 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:18.709373 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:36:18.709373 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:36:18.709373 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:36:18.709373 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:36:18.710351 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:36:18.710351 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:36:18.710351 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:36:18.710351 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:36:18.710351 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:18.710351 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:18.710351 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:18.710351 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:18.710351 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:18.710351 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:18.710351 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:18.710351 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:18.710351 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:18.710351 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:18.710351 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:18.710351 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:18.711200 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:18.711200 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:18.711200 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:18.711200 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:18.711200 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:36:18.711200 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:36:18.711200 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:36:18.711200 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:36:18.711200 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:36:18.711200 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:36:18.711200 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:36:18.711200 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:18.720018 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 356/723] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 5 20:36:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:18.724496 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb117c-f54f-412b-82c9-01e2a220aee5 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:18.796998 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 368/724] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:36:18.832302 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:18.833888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64485124-7a8a-40cb-b65b-4bad3d8fa28e None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:18.838802 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb117c-f54f-412b-82c9-01e2a220aee5 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:18.873467 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208a358-d93d-4bd2-b5c7-3f0ccb9ca59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:18.874168 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208a358-d93d-4bd2-b5c7-3f0ccb9ca59e None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:18.874448 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208a358-d93d-4bd2-b5c7-3f0ccb9ca59e None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:18.874721 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208a358-d93d-4bd2-b5c7-3f0ccb9ca59e None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:18.875474 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3208a358-d93d-4bd2-b5c7-3f0ccb9ca59e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:18.875777 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3208a358-d93d-4bd2-b5c7-3f0ccb9ca59e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:18.877163 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3208a358-d93d-4bd2-b5c7-3f0ccb9ca59e None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:18.886063 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 357/725] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:36:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:18.892338 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208a358-d93d-4bd2-b5c7-3f0ccb9ca59e None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:18.951660 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:18.995051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64485124-7a8a-40cb-b65b-4bad3d8fa28e None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:19.054647 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f2c8e-bd45-46a2-b580-1b0f8de3b237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:19.055510 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f2c8e-bd45-46a2-b580-1b0f8de3b237 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:19.055787 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f2c8e-bd45-46a2-b580-1b0f8de3b237 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:19.056057 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f2c8e-bd45-46a2-b580-1b0f8de3b237 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:19.078807 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955f2c8e-bd45-46a2-b580-1b0f8de3b237 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:36:19.083233 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208a358-d93d-4bd2-b5c7-3f0ccb9ca59e None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:19.086998 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-955f2c8e-bd45-46a2-b580-1b0f8de3b237 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:36:19.086998 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:19.086998 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:19.086998 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:19.086998 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:19.086998 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:19.086998 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:19.086998 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:19.086998 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:19.086998 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:19.086998 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:19.086998 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:19.086998 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:36:19.086998 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:36:19.086998 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:36:19.086998 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:36:19.088138 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:36:19.088138 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:36:19.088138 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:36:19.088138 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:36:19.088138 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:19.088138 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:19.088138 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:19.088138 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:19.088138 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:19.088138 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:19.088138 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:19.088138 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:19.088138 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:19.088138 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:19.088138 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:19.088138 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:19.088992 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:19.088992 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:19.088992 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:19.088992 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:19.088992 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:36:19.088992 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:36:19.088992 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:36:19.088992 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:36:19.088992 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:36:19.088992 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:36:19.088992 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:36:19.088992 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:19.098464 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 369/726] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 5 20:36:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:19.103828 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f2c8e-bd45-46a2-b580-1b0f8de3b237 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:19.121905 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c88e8cb-2026-430b-a91b-896ff5e882d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:19.122788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88e8cb-2026-430b-a91b-896ff5e882d0 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:19.123068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88e8cb-2026-430b-a91b-896ff5e882d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:19.123382 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88e8cb-2026-430b-a91b-896ff5e882d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:19.136848 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c88e8cb-2026-430b-a91b-896ff5e882d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:19.141203 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c88e8cb-2026-430b-a91b-896ff5e882d0 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:19.161415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-8c88e8cb-2026-430b-a91b-896ff5e882d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:19.161415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:19.161415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:19.161415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:19.161415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:19.161415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:19.161415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:19.161415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:19.161415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:19.161415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:19.161415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:19.161415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:19.161415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:19.161415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:19.161415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:19.162390 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:19.162390 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:19.162390 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:19.162390 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:19.162390 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:19.162390 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:19.162390 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:19.162390 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:19.162390 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:19.162390 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:19.162390 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:19.162390 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:19.162390 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:19.162390 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:19.162390 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:19.162390 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:19.162390 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:19.163278 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:19.163278 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:19.163278 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:19.163278 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:19.163278 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 358/727] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:36:19.171499 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c88e8cb-2026-430b-a91b-896ff5e882d0 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:19.186553 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:19.271499 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f2c8e-bd45-46a2-b580-1b0f8de3b237 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:19.286426 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c88e8cb-2026-430b-a91b-896ff5e882d0 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:19.299122 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:19.315113 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd893a0-e4aa-4e29-aa68-51d0ae2aa62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:19.316199 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd893a0-e4aa-4e29-aa68-51d0ae2aa62f None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:19.317025 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd893a0-e4aa-4e29-aa68-51d0ae2aa62f None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:19.317692 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd893a0-e4aa-4e29-aa68-51d0ae2aa62f None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:19.318602 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd893a0-e4aa-4e29-aa68-51d0ae2aa62f None admin] RBAC: Adding query filter params (name=service) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:19.319047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd893a0-e4aa-4e29-aa68-51d0ae2aa62f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:19.320575 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd893a0-e4aa-4e29-aa68-51d0ae2aa62f None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:19.321225 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d9633-066a-4408-a29b-0d4f8730a427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:19.321926 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d9633-066a-4408-a29b-0d4f8730a427 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:19.322206 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d9633-066a-4408-a29b-0d4f8730a427 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:19.322529 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d9633-066a-4408-a29b-0d4f8730a427 None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:19.323206 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d9633-066a-4408-a29b-0d4f8730a427 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:19.323513 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d9633-066a-4408-a29b-0d4f8730a427 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:19.324934 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d9633-066a-4408-a29b-0d4f8730a427 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:19.332247 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 370/728] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 5 20:36:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:36:19.334263 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43332bef-2f9c-4c7d-bb20-c339722087ee None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:19.335402 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43332bef-2f9c-4c7d-bb20-c339722087ee None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:19.335686 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43332bef-2f9c-4c7d-bb20-c339722087ee None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:19.340929 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 371/729] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:19.340929 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43332bef-2f9c-4c7d-bb20-c339722087ee None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:19.343474 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 359/730] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:19.345288 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f38238-e26f-4afd-8901-ac9957c06226 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:19.345288 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f38238-e26f-4afd-8901-ac9957c06226 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:19.345288 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f38238-e26f-4afd-8901-ac9957c06226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:19.361872 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-24f38238-e26f-4afd-8901-ac9957c06226 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:19.363394 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-24f38238-e26f-4afd-8901-ac9957c06226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:19.427457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:19.441137 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 360/731] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:36:19.441137 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f38238-e26f-4afd-8901-ac9957c06226 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:19.479891 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43332bef-2f9c-4c7d-bb20-c339722087ee None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:19.516120 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42ad6e-00b7-4a32-a457-e0c3ad49d1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:19.516933 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42ad6e-00b7-4a32-a457-e0c3ad49d1b6 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:19.517213 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42ad6e-00b7-4a32-a457-e0c3ad49d1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:19.517487 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42ad6e-00b7-4a32-a457-e0c3ad49d1b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:19.528993 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e42ad6e-00b7-4a32-a457-e0c3ad49d1b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:19.530625 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e42ad6e-00b7-4a32-a457-e0c3ad49d1b6 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:19.548267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-5e42ad6e-00b7-4a32-a457-e0c3ad49d1b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:19.548267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:19.548267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:19.548267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:19.548267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:19.548267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:19.548267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:19.548267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:19.548267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:19.548267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:19.548267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:19.548267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:19.548267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:19.548267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:19.548267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:19.549233 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:19.549233 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:19.549233 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:19.549233 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:19.549233 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:19.549233 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:19.549233 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:19.549233 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:19.549233 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:19.549233 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:19.549233 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:19.549233 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:19.549233 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:19.549233 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:19.549233 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:19.549233 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:19.549233 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:19.551135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:19.551135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:19.551135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:19.551135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:19.551135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 372/732] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:19.551135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42ad6e-00b7-4a32-a457-e0c3ad49d1b6 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:19.574862 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f38238-e26f-4afd-8901-ac9957c06226 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:19.589039 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:19.619056 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624de78d-7a56-4dae-b261-c79fc64216a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:19.620717 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624de78d-7a56-4dae-b261-c79fc64216a6 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:19.621174 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624de78d-7a56-4dae-b261-c79fc64216a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:19.621656 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624de78d-7a56-4dae-b261-c79fc64216a6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:19.631336 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624de78d-7a56-4dae-b261-c79fc64216a6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:19.633058 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624de78d-7a56-4dae-b261-c79fc64216a6 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:19.655675 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-624de78d-7a56-4dae-b261-c79fc64216a6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 20:36:19.655675 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:19.655675 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:19.655675 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:19.655675 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:19.655675 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:19.655675 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:19.655675 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:19.655675 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:19.655675 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:19.655675 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:19.655675 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:19.655675 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:36:19.655675 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:36:19.655675 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:36:19.655675 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:36:19.656668 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:19.656668 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:19.656668 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:36:19.656668 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:19.656668 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:36:19.656668 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:19.656668 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:19.656668 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:19.656668 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:19.656668 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:19.656668 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:19.656668 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:19.656668 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:19.656668 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:19.656668 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:19.656668 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:19.656668 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:19.656668 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:19.657605 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:19.657605 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:19.657605 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:36:19.657605 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:36:19.657605 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:36:19.657605 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:36:19.657605 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:36:19.657605 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:36:19.657605 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 20:36:19.657605 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:19.663855 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 361/733] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 5 20:36:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:19.663855 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624de78d-7a56-4dae-b261-c79fc64216a6 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:19.670060 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42ad6e-00b7-4a32-a457-e0c3ad49d1b6 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:19.706704 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a527e5-e66b-4843-9ead-15e8c4f63c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:19.707429 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a527e5-e66b-4843-9ead-15e8c4f63c2a None admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:19.707711 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a527e5-e66b-4843-9ead-15e8c4f63c2a None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:19.708037 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a527e5-e66b-4843-9ead-15e8c4f63c2a None admin] PATH_INFO: `/v3/services` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:19.708772 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a527e5-e66b-4843-9ead-15e8c4f63c2a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:19.710807 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a527e5-e66b-4843-9ead-15e8c4f63c2a None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:19.733881 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 373/734] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Jul 5 20:36:19 2022] POST /identity/v3/services => generated 251 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:36:19.733881 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a527e5-e66b-4843-9ead-15e8c4f63c2a None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:19.752363 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:19.832776 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624de78d-7a56-4dae-b261-c79fc64216a6 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:19.882385 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:19.892138 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af7a7a-6e38-44bc-ab59-2b5f6253f82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:19.893208 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af7a7a-6e38-44bc-ab59-2b5f6253f82e None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:19.893681 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af7a7a-6e38-44bc-ab59-2b5f6253f82e None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:19.894184 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af7a7a-6e38-44bc-ab59-2b5f6253f82e None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:19.895190 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af7a7a-6e38-44bc-ab59-2b5f6253f82e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:19.895668 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af7a7a-6e38-44bc-ab59-2b5f6253f82e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:19.897353 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af7a7a-6e38-44bc-ab59-2b5f6253f82e None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:19.898670 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a527e5-e66b-4843-9ead-15e8c4f63c2a None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:19.917291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 362/735] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:19.919220 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af7a7a-6e38-44bc-ab59-2b5f6253f82e None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:19.938396 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c662b-2233-40b6-99f9-ddc2dbf54600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:19.939100 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c662b-2233-40b6-99f9-ddc2dbf54600 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:19.939429 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c662b-2233-40b6-99f9-ddc2dbf54600 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:19.939710 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c662b-2233-40b6-99f9-ddc2dbf54600 None admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:19.940592 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c662b-2233-40b6-99f9-ddc2dbf54600 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:19.940905 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c662b-2233-40b6-99f9-ddc2dbf54600 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:19.942507 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c662b-2233-40b6-99f9-ddc2dbf54600 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:19.968657 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 374/736] 10.222.0.27 () {56 vars in 1135 bytes} [Tue Jul 5 20:36:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:19.989928 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c662b-2233-40b6-99f9-ddc2dbf54600 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:20.041658 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af7a7a-6e38-44bc-ab59-2b5f6253f82e None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:20.058270 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:20.081938 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db874152-eaec-4bea-b9a2-6f0fb10a537d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:20.083171 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db874152-eaec-4bea-b9a2-6f0fb10a537d None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:20.083783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db874152-eaec-4bea-b9a2-6f0fb10a537d None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:20.084245 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db874152-eaec-4bea-b9a2-6f0fb10a537d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:20.092948 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db874152-eaec-4bea-b9a2-6f0fb10a537d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:20.094891 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db874152-eaec-4bea-b9a2-6f0fb10a537d None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:20.102062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c662b-2233-40b6-99f9-ddc2dbf54600 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:20.112100 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-db874152-eaec-4bea-b9a2-6f0fb10a537d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 20:36:20.112100 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:20.112100 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:20.112100 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:20.112100 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:20.112100 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:20.112100 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:20.112100 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:20.112100 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:20.112100 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:20.112100 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:20.112100 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:20.112100 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:36:20.112100 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:36:20.112100 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:36:20.112100 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:36:20.113068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:20.113068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:20.113068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:36:20.113068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:20.113068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:36:20.113068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:20.113068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:20.113068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:20.113068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:20.113068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:20.113068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:20.113068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:20.113068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:20.113068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:20.113068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:20.113068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:20.113068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:20.113068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:20.114054 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:20.114054 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:20.114054 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:36:20.114054 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:36:20.114054 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:36:20.114054 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:36:20.114054 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:36:20.114054 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:36:20.114054 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 20:36:20.114054 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:20.115998 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 363/737] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Jul 5 20:36:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:36:20.117436 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a410c23-379a-46b5-aa60-52c1824f9d52 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:20.117720 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a410c23-379a-46b5-aa60-52c1824f9d52 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:20.118022 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a410c23-379a-46b5-aa60-52c1824f9d52 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:20.121923 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 364/738] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:20.123139 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b53fa-260e-4f57-91fb-5f4275185b64 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:20.123422 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b53fa-260e-4f57-91fb-5f4275185b64 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:20.123692 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b53fa-260e-4f57-91fb-5f4275185b64 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:20.129079 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 365/739] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:20.129927 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b53fa-260e-4f57-91fb-5f4275185b64 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:20.144598 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e01c3-9003-406d-af8f-d662f19fab37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:20.145263 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e01c3-9003-406d-af8f-d662f19fab37 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:20.145542 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e01c3-9003-406d-af8f-d662f19fab37 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:20.145814 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e01c3-9003-406d-af8f-d662f19fab37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:20.172894 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:20.223531 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237e01c3-9003-406d-af8f-d662f19fab37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:20.225010 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237e01c3-9003-406d-af8f-d662f19fab37 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:20.241956 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b53fa-260e-4f57-91fb-5f4275185b64 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:20.282833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07cb3f-459b-4e4d-9575-4c197822b0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:20.283504 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07cb3f-459b-4e4d-9575-4c197822b0cd None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:20.283785 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07cb3f-459b-4e4d-9575-4c197822b0cd None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:20.284055 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07cb3f-459b-4e4d-9575-4c197822b0cd None admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:20.284900 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b07cb3f-459b-4e4d-9575-4c197822b0cd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:20.285225 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b07cb3f-459b-4e4d-9575-4c197822b0cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:20.286677 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b07cb3f-459b-4e4d-9575-4c197822b0cd None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:20.306103 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 366/740] 10.222.0.27 () {56 vars in 1149 bytes} [Tue Jul 5 20:36:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:20.307387 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172da551-d9b6-4796-9310-ff5a12edd5ad None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:20.307672 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172da551-d9b6-4796-9310-ff5a12edd5ad None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:20.307949 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172da551-d9b6-4796-9310-ff5a12edd5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:20.323986 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-172da551-d9b6-4796-9310-ff5a12edd5ad None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:20.325306 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-172da551-d9b6-4796-9310-ff5a12edd5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:20.338283 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 375/741] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:36:19 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:36:20.340074 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ccf2f-e5fc-4612-a792-594d34c63363 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:20.340387 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ccf2f-e5fc-4612-a792-594d34c63363 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:20.340657 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ccf2f-e5fc-4612-a792-594d34c63363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:20.355703 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:20.357419 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-7c1ccf2f-e5fc-4612-a792-594d34c63363 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:20.358844 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-7c1ccf2f-e5fc-4612-a792-594d34c63363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:20.398247 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 367/742] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:20 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:36:20.398916 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172da551-d9b6-4796-9310-ff5a12edd5ad None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:20.420490 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:20.439684 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 376/743] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:20 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 05 20:36:20.440674 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ccf2f-e5fc-4612-a792-594d34c63363 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:20.519875 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172da551-d9b6-4796-9310-ff5a12edd5ad None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:20.547371 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ccf2f-e5fc-4612-a792-594d34c63363 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:20.555556 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba064159-1ef5-41f2-808e-c55a7e216577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:20.556214 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba064159-1ef5-41f2-808e-c55a7e216577 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:20.556497 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba064159-1ef5-41f2-808e-c55a7e216577 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:20.556772 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba064159-1ef5-41f2-808e-c55a7e216577 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:20.583858 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55dbd2-5119-479e-a9f3-18ffef7bd130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:20.584637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55dbd2-5119-479e-a9f3-18ffef7bd130 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:20.584960 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55dbd2-5119-479e-a9f3-18ffef7bd130 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:20.585242 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55dbd2-5119-479e-a9f3-18ffef7bd130 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:20.590299 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:20.597342 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55dbd2-5119-479e-a9f3-18ffef7bd130 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:20.598849 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55dbd2-5119-479e-a9f3-18ffef7bd130 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:20.618637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-fd55dbd2-5119-479e-a9f3-18ffef7bd130 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:20.618637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:20.618637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:20.618637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:20.618637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:20.618637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:20.618637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:20.618637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:20.618637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:20.618637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:20.618637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:20.618637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:20.618637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:20.618637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:20.618637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:20.619892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:20.619892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:20.619892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:20.619892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:20.619892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:20.619892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:20.619892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:20.619892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:20.619892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:20.619892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:20.619892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:20.619892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:20.619892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:20.619892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:20.619892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:20.619892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:20.619892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:20.620787 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:20.620787 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:20.620787 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:20.620787 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:20.624689 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 377/744] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:20.625294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55dbd2-5119-479e-a9f3-18ffef7bd130 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:20.631919 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba064159-1ef5-41f2-808e-c55a7e216577 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:20.633401 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba064159-1ef5-41f2-808e-c55a7e216577 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:20.661997 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:20.731182 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55dbd2-5119-479e-a9f3-18ffef7bd130 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:20.740310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 368/745] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:36:20 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 05 20:36:20.740310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba064159-1ef5-41f2-808e-c55a7e216577 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:20.771629 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466a4ee-23e6-408f-af0c-393067764a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:20.772297 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466a4ee-23e6-408f-af0c-393067764a57 None admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:20.772574 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466a4ee-23e6-408f-af0c-393067764a57 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:20.772850 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466a4ee-23e6-408f-af0c-393067764a57 None admin] PATH_INFO: `/v3/services` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:20.773568 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9466a4ee-23e6-408f-af0c-393067764a57 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:20.774985 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9466a4ee-23e6-408f-af0c-393067764a57 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:20.797871 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 378/746] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Jul 5 20:36:20 2022] POST /identity/v3/services => generated 240 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:36:20.797871 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466a4ee-23e6-408f-af0c-393067764a57 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:20.801432 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:20.846688 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba064159-1ef5-41f2-808e-c55a7e216577 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:20.900502 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cdfbed-24cf-4f56-ab15-8063361937e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:20.901475 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdfbed-24cf-4f56-ab15-8063361937e8 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:20.901792 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdfbed-24cf-4f56-ab15-8063361937e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:20.902098 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cdfbed-24cf-4f56-ab15-8063361937e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:20.915297 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cdfbed-24cf-4f56-ab15-8063361937e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:36:20.923310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-f1cdfbed-24cf-4f56-ab15-8063361937e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:36:20.923310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:20.923310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:20.923310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:20.923310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:20.923310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:20.923310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:20.923310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:20.923310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:20.923310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:20.923310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:20.923310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:20.923310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:36:20.923310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:36:20.923310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:36:20.923310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:36:20.924561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:36:20.924561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:36:20.924561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:36:20.924561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:36:20.924561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:20.924561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:20.924561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:20.924561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:20.924561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:20.924561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:20.924561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:20.924561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:20.924561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:20.924561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:20.924561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:20.924561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:20.925879 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:20.925879 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:20.925879 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:20.925879 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:20.925879 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:36:20.925879 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:36:20.925879 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:36:20.925879 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:36:20.925879 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:36:20.925879 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:36:20.925879 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:36:20.925879 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:20.930100 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 369/747] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 5 20:36:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:20.931383 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cdfbed-24cf-4f56-ab15-8063361937e8 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:20.940021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:20.950826 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466a4ee-23e6-408f-af0c-393067764a57 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:20.996732 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817d2ac-40c6-42ec-aedd-fd6305a017d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:20.997402 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817d2ac-40c6-42ec-aedd-fd6305a017d0 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:20.997681 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817d2ac-40c6-42ec-aedd-fd6305a017d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:20.997998 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817d2ac-40c6-42ec-aedd-fd6305a017d0 None admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:20.998810 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a817d2ac-40c6-42ec-aedd-fd6305a017d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:20.999024 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a817d2ac-40c6-42ec-aedd-fd6305a017d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:21.000410 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a817d2ac-40c6-42ec-aedd-fd6305a017d0 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:21.014715 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 379/748] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:21.015574 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817d2ac-40c6-42ec-aedd-fd6305a017d0 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:21.046470 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cdfbed-24cf-4f56-ab15-8063361937e8 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:21.065419 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:21.091362 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e3965-a729-4279-b5df-91b5f17f6e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:21.092170 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e3965-a729-4279-b5df-91b5f17f6e33 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:21.092449 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e3965-a729-4279-b5df-91b5f17f6e33 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:21.092723 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e3965-a729-4279-b5df-91b5f17f6e33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:21.103904 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e3965-a729-4279-b5df-91b5f17f6e33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:21.105290 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e3965-a729-4279-b5df-91b5f17f6e33 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:21.127243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-298e3965-a729-4279-b5df-91b5f17f6e33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:21.127243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:21.127243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:21.127243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:21.127243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:21.127243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:21.127243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:21.127243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:21.127243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:21.127243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:21.127243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:21.127243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:21.127243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:21.127243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:21.127243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:21.128222 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:21.128222 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:21.128222 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:21.128222 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:21.128222 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:21.128222 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:21.128222 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:21.128222 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:21.128222 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:21.128222 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:21.128222 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:21.128222 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:21.128222 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:21.128222 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:21.128222 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:21.128222 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:21.128222 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:21.129135 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:21.129135 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:21.129135 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:21.129135 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:21.129135 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 370/749] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:21.129943 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e3965-a729-4279-b5df-91b5f17f6e33 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:21.141064 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a817d2ac-40c6-42ec-aedd-fd6305a017d0 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:21.180699 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec8664-7275-4f29-8264-bde884f0f71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:21.181788 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec8664-7275-4f29-8264-bde884f0f71f None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:21.182334 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec8664-7275-4f29-8264-bde884f0f71f None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:21.182813 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec8664-7275-4f29-8264-bde884f0f71f None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:21.183846 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec8664-7275-4f29-8264-bde884f0f71f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:21.184396 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec8664-7275-4f29-8264-bde884f0f71f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:21.186089 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec8664-7275-4f29-8264-bde884f0f71f None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:21.201332 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 380/750] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:36:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:21.203189 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec8664-7275-4f29-8264-bde884f0f71f None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:21.228669 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:21.251512 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e3965-a729-4279-b5df-91b5f17f6e33 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:21.293041 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeeacb3-9076-4ff3-9ee0-43155ccabdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:21.293999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeeacb3-9076-4ff3-9ee0-43155ccabdf3 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:21.294305 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeeacb3-9076-4ff3-9ee0-43155ccabdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:21.294583 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeeacb3-9076-4ff3-9ee0-43155ccabdf3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:21.303318 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeeacb3-9076-4ff3-9ee0-43155ccabdf3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:21.305451 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeeacb3-9076-4ff3-9ee0-43155ccabdf3 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:21.316606 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec8664-7275-4f29-8264-bde884f0f71f None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:21.323728 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-feeeacb3-9076-4ff3-9ee0-43155ccabdf3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:21.323728 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:21.323728 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:21.323728 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:21.323728 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:21.323728 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:21.323728 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:21.323728 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:21.323728 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:21.323728 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:21.323728 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:21.323728 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:21.323728 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:36:21.323728 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:36:21.323728 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:36:21.325072 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:36:21.325072 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:21.325072 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:21.325072 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:21.325072 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:21.325072 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:21.325072 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:21.325072 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:21.325072 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:21.325072 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:21.325072 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:21.325072 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:21.325072 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:21.325072 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:21.325072 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:21.325072 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:21.325072 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:21.326008 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:36:21.326008 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:36:21.326008 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:36:21.326008 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:36:21.326008 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:36:21.326008 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:36:21.326008 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:21.326008 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:21.327471 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 371/751] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:36:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:21.328084 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeeacb3-9076-4ff3-9ee0-43155ccabdf3 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:21.357442 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca165b-e049-44fc-9c12-4a65cc3dabcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:21.358102 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca165b-e049-44fc-9c12-4a65cc3dabcc None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:21.358405 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca165b-e049-44fc-9c12-4a65cc3dabcc None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:21.358724 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca165b-e049-44fc-9c12-4a65cc3dabcc None admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:21.359446 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca165b-e049-44fc-9c12-4a65cc3dabcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:21.359751 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca165b-e049-44fc-9c12-4a65cc3dabcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:21.361230 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca165b-e049-44fc-9c12-4a65cc3dabcc None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:21.367611 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:21.376108 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 381/752] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:21.376961 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca165b-e049-44fc-9c12-4a65cc3dabcc None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:21.453717 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeeacb3-9076-4ff3-9ee0-43155ccabdf3 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:21.463661 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:21.489075 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca165b-e049-44fc-9c12-4a65cc3dabcc None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:21.490112 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb299015-f3c9-416b-9dfd-735d54813d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:21.491139 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb299015-f3c9-416b-9dfd-735d54813d50 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:21.491630 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb299015-f3c9-416b-9dfd-735d54813d50 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:21.492104 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb299015-f3c9-416b-9dfd-735d54813d50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:21.503105 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb299015-f3c9-416b-9dfd-735d54813d50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:21.504872 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb299015-f3c9-416b-9dfd-735d54813d50 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:21.523302 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-fb299015-f3c9-416b-9dfd-735d54813d50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:21.523302 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:21.523302 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:21.523302 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:21.523302 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:21.523302 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:21.523302 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:21.523302 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:21.523302 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:21.523302 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:21.523302 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:21.523302 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:21.523302 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:21.523302 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:21.523302 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:21.524236 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:21.524236 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:21.524236 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:21.524236 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:21.524236 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:21.524236 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:21.524236 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:21.524236 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:21.524236 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:21.524236 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:21.524236 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:21.524236 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:21.524236 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:21.524236 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:21.524236 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:21.524236 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:21.524236 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:21.525141 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:21.525141 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:21.525141 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:21.525141 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:21.526492 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc9808-268d-45dd-8aec-12107cddc730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:21.527146 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc9808-268d-45dd-8aec-12107cddc730 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:21.527425 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc9808-268d-45dd-8aec-12107cddc730 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:21.527843 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc9808-268d-45dd-8aec-12107cddc730 None admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:21.528310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 372/753] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:21.528541 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc9808-268d-45dd-8aec-12107cddc730 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:21.528846 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc9808-268d-45dd-8aec-12107cddc730 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:21.529660 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb299015-f3c9-416b-9dfd-735d54813d50 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:21.534906 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc9808-268d-45dd-8aec-12107cddc730 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:21.548389 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 382/754] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 5 20:36:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:21.549317 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc9808-268d-45dd-8aec-12107cddc730 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:21.618952 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:21.638354 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb299015-f3c9-416b-9dfd-735d54813d50 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:21.657445 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc9808-268d-45dd-8aec-12107cddc730 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:21.673675 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e23ce1-550d-4723-9b61-6246188605f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:21.674849 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e23ce1-550d-4723-9b61-6246188605f4 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:21.675712 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e23ce1-550d-4723-9b61-6246188605f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:21.676176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e23ce1-550d-4723-9b61-6246188605f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:21.683521 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e23ce1-550d-4723-9b61-6246188605f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:21.685252 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e23ce1-550d-4723-9b61-6246188605f4 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:21.692870 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f5fbd-e94c-44b9-96d6-cafc2d0237f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:21.693581 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f5fbd-e94c-44b9-96d6-cafc2d0237f9 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:21.693879 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f5fbd-e94c-44b9-96d6-cafc2d0237f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:21.694158 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f5fbd-e94c-44b9-96d6-cafc2d0237f9 None admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:21.694886 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f5fbd-e94c-44b9-96d6-cafc2d0237f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:21.695232 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f5fbd-e94c-44b9-96d6-cafc2d0237f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:21.696611 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f5fbd-e94c-44b9-96d6-cafc2d0237f9 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:21.702615 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-c4e23ce1-550d-4723-9b61-6246188605f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:21.702615 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:21.702615 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:21.702615 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:21.702615 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:21.702615 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:21.702615 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:21.702615 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:21.702615 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:21.702615 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:21.702615 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:21.702615 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:21.702615 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:36:21.702615 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:36:21.702615 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:36:21.703492 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:36:21.703492 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:21.703492 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:21.703492 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:21.703492 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:21.703492 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:21.703492 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:21.703492 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:21.703492 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:21.703492 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:21.703492 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:21.703492 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:21.703492 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:21.703492 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:21.703492 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:21.703492 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:21.703492 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:21.704383 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:36:21.704383 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:36:21.704383 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:36:21.704383 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:36:21.704383 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:36:21.704383 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:36:21.704383 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:21.704383 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:21.704898 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:21.707832 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 373/755] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:36:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:21.709215 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e23ce1-550d-4723-9b61-6246188605f4 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:21.716062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 383/756] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:21.716944 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f5fbd-e94c-44b9-96d6-cafc2d0237f9 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:21.819761 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f5fbd-e94c-44b9-96d6-cafc2d0237f9 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:21.827479 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e23ce1-550d-4723-9b61-6246188605f4 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:21.855275 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b61dd-6332-4299-a89d-32d78dcfccd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:21.855754 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b61dd-6332-4299-a89d-32d78dcfccd2 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:21.856066 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b61dd-6332-4299-a89d-32d78dcfccd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:21.856339 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b61dd-6332-4299-a89d-32d78dcfccd2 None admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:21.857132 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b61dd-6332-4299-a89d-32d78dcfccd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:21.857460 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b61dd-6332-4299-a89d-32d78dcfccd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:21.858897 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b61dd-6332-4299-a89d-32d78dcfccd2 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:21.864585 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ca3aa-62e5-45be-a0e7-9f2d156abb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:21.865508 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ca3aa-62e5-45be-a0e7-9f2d156abb4c None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:21.866021 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ca3aa-62e5-45be-a0e7-9f2d156abb4c None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:21.866504 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ca3aa-62e5-45be-a0e7-9f2d156abb4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:21.867537 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ca3aa-62e5-45be-a0e7-9f2d156abb4c None admin] RBAC: Adding query filter params (role.id=37ba4a62052348d4811b560c19a07e02, scope.project.id=b321588ec1f14bcb94a184310cf72856, user.id=90aa580a2e10467a93c2d79d1906bd8a) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:21.868052 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ca3aa-62e5-45be-a0e7-9f2d156abb4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:21.869718 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ca3aa-62e5-45be-a0e7-9f2d156abb4c None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:21.871524 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 384/757] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 5 20:36:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:21.872351 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b61dd-6332-4299-a89d-32d78dcfccd2 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:21.876756 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 374/758] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:36:21 2022] GET /identity/v3/role_assignments?user.id=90aa580a2e10467a93c2d79d1906bd8a&scope.project.id=b321588ec1f14bcb94a184310cf72856&role.id=37ba4a62052348d4811b560c19a07e02 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:21.877913 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ca3aa-62e5-45be-a0e7-9f2d156abb4c None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:21.888026 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:21.940694 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:21.988237 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b61dd-6332-4299-a89d-32d78dcfccd2 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:21.990281 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ca3aa-62e5-45be-a0e7-9f2d156abb4c None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:22.029673 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af67a5-344e-4326-b0b3-eb17d5b70574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:22.030863 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af67a5-344e-4326-b0b3-eb17d5b70574 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:22.031511 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af67a5-344e-4326-b0b3-eb17d5b70574 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:22.032043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af67a5-344e-4326-b0b3-eb17d5b70574 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:22.032165 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8874e7-1d5b-493b-81f9-e6c9b510312d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:22.032956 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8874e7-1d5b-493b-81f9-e6c9b510312d None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:22.033234 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8874e7-1d5b-493b-81f9-e6c9b510312d None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:22.033503 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8874e7-1d5b-493b-81f9-e6c9b510312d None admin] PATH_INFO: `/v3/users/nova` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:22.034026 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af67a5-344e-4326-b0b3-eb17d5b70574 None admin] RBAC: Adding query filter params (role.id=4f5057900b094e6fb792884693177cd3, scope.project.id=b321588ec1f14bcb94a184310cf72856, user.id=c9647d15389e49e6b7c43ea1b1538a13) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:22.034719 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af67a5-344e-4326-b0b3-eb17d5b70574 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:22.036608 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af67a5-344e-4326-b0b3-eb17d5b70574 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:22.043713 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 375/759] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:36:21 2022] GET /identity/v3/role_assignments?user.id=c9647d15389e49e6b7c43ea1b1538a13&scope.project.id=b321588ec1f14bcb94a184310cf72856&role.id=4f5057900b094e6fb792884693177cd3 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:22.044330 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8874e7-1d5b-493b-81f9-e6c9b510312d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:22.045815 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80029916-4c98-40b0-98bb-3f150e7af402 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:22.045993 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8874e7-1d5b-493b-81f9-e6c9b510312d None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:22.046663 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80029916-4c98-40b0-98bb-3f150e7af402 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:22.047153 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80029916-4c98-40b0-98bb-3f150e7af402 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:22.049066 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 376/760] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:22.054581 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c12ac8-ea59-4b6c-85eb-717bb017d627 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:22.055124 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c12ac8-ea59-4b6c-85eb-717bb017d627 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:22.055587 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c12ac8-ea59-4b6c-85eb-717bb017d627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:22.063939 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-ef8874e7-1d5b-493b-81f9-e6c9b510312d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 20:36:22.063939 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:22.063939 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:22.063939 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:22.063939 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:22.063939 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:22.063939 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:22.063939 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:22.063939 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:22.063939 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:22.063939 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:22.063939 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:22.063939 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:36:22.063939 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:36:22.063939 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:36:22.063939 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:36:22.064949 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:22.064949 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:22.064949 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:36:22.064949 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:22.064949 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:36:22.064949 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:22.064949 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:22.064949 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:22.064949 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:22.064949 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:22.064949 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:22.064949 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:22.064949 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:22.064949 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:22.064949 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:22.064949 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:22.064949 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:22.064949 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:22.066385 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:22.066385 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:22.066385 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:36:22.066385 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:36:22.066385 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:36:22.066385 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:36:22.066385 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:36:22.066385 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:36:22.066385 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 20:36:22.066385 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:22.066385 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 385/761] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Jul 5 20:36:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:22.071350 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8874e7-1d5b-493b-81f9-e6c9b510312d None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:22.078828 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-70c12ac8-ea59-4b6c-85eb-717bb017d627 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:22.080429 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-70c12ac8-ea59-4b6c-85eb-717bb017d627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:22.158318 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:22.172613 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 377/762] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 20:36:22.203775 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c12ac8-ea59-4b6c-85eb-717bb017d627 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:22.227729 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8874e7-1d5b-493b-81f9-e6c9b510312d None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:22.269204 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:22.295126 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc618cf-611b-4b10-8b99-ecdc8cfc0f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:22.296987 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc618cf-611b-4b10-8b99-ecdc8cfc0f73 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:22.297546 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc618cf-611b-4b10-8b99-ecdc8cfc0f73 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:22.298178 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc618cf-611b-4b10-8b99-ecdc8cfc0f73 None admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:22.299205 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc618cf-611b-4b10-8b99-ecdc8cfc0f73 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:22.299607 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc618cf-611b-4b10-8b99-ecdc8cfc0f73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:22.301642 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc618cf-611b-4b10-8b99-ecdc8cfc0f73 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:22.328777 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 386/763] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Jul 5 20:36:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:36:22.336067 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc618cf-611b-4b10-8b99-ecdc8cfc0f73 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:22.355640 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c12ac8-ea59-4b6c-85eb-717bb017d627 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:22.416059 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d191cfd6-0991-4846-8518-196bf37895ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:22.417148 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191cfd6-0991-4846-8518-196bf37895ed None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:22.417574 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191cfd6-0991-4846-8518-196bf37895ed None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:22.418029 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191cfd6-0991-4846-8518-196bf37895ed None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:22.419277 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d191cfd6-0991-4846-8518-196bf37895ed None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:22.420884 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d191cfd6-0991-4846-8518-196bf37895ed None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:22.445115 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-d191cfd6-0991-4846-8518-196bf37895ed None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 20:36:22.445115 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:22.445115 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:36:22.445115 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:36:22.445115 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:36:22.445115 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:36:22.445115 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:36:22.445115 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:22.445115 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 20:36:22.445115 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:22.445115 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:36:22.445115 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:22.445115 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:22.445115 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:22.445115 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:22.445115 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:22.446344 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:22.446344 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:22.446344 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:22.446344 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:22.446344 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:22.446344 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:22.446344 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:22.446344 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:36:22.446344 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:36:22.446344 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:36:22.446344 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:36:22.446344 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:22.446344 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:22.446344 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:22.446344 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:22.446344 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:22.447385 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:22.447385 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:22.447385 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:22.447385 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:22.447385 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:22.447385 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:22.447385 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:22.447385 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:22.447385 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:22.447385 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:22.447385 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:22.447385 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:36:22.447385 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:22.447385 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 20:36:22.447385 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:22.455234 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 378/764] 10.222.0.27 () {56 vars in 1129 bytes} [Tue Jul 5 20:36:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:36:22.462871 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d191cfd6-0991-4846-8518-196bf37895ed None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:22.466617 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc618cf-611b-4b10-8b99-ecdc8cfc0f73 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:22.501506 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966792e-4258-4aca-81ae-49cb56d80913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:22.502340 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966792e-4258-4aca-81ae-49cb56d80913 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:22.502615 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966792e-4258-4aca-81ae-49cb56d80913 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:22.502888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966792e-4258-4aca-81ae-49cb56d80913 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:22.522893 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966792e-4258-4aca-81ae-49cb56d80913 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:22.525699 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966792e-4258-4aca-81ae-49cb56d80913 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:22.563378 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-9966792e-4258-4aca-81ae-49cb56d80913 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:22.563378 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:22.563378 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:22.563378 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:22.563378 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:22.563378 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:22.563378 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:22.563378 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:22.563378 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:22.563378 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:22.563378 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:22.563378 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:22.563378 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:22.563378 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:22.563378 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:22.564327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:22.564327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:22.564327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:22.564327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:22.564327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:22.564327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:22.564327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:22.564327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:22.564327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:22.564327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:22.564327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:22.564327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:22.564327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:22.564327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:22.564327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:22.564327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:22.564327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:22.565245 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:22.565245 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:22.565245 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:22.565245 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:22.568529 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 387/765] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:22.578873 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966792e-4258-4aca-81ae-49cb56d80913 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:22.590311 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:22.629689 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:22.639013 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d191cfd6-0991-4846-8518-196bf37895ed None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:22.706638 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ef0db-f6f1-44ad-9426-c68de9ed8cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:22.707580 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ef0db-f6f1-44ad-9426-c68de9ed8cc0 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:22.708005 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ef0db-f6f1-44ad-9426-c68de9ed8cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:22.710713 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ef0db-f6f1-44ad-9426-c68de9ed8cc0 None admin] PATH_INFO: `/v3/services` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:22.711584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ef0db-f6f1-44ad-9426-c68de9ed8cc0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:22.712037 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ef0db-f6f1-44ad-9426-c68de9ed8cc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:22.713599 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77ef0db-f6f1-44ad-9426-c68de9ed8cc0 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:22.723882 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 379/766] 10.222.0.27 () {56 vars in 1124 bytes} [Tue Jul 5 20:36:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:22.730226 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ef0db-f6f1-44ad-9426-c68de9ed8cc0 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:22.763900 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966792e-4258-4aca-81ae-49cb56d80913 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:22.827688 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1ec43-4ab0-4a9b-bcb9-726f6b4c1df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:22.828610 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1ec43-4ab0-4a9b-bcb9-726f6b4c1df5 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:22.829069 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1ec43-4ab0-4a9b-bcb9-726f6b4c1df5 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:22.829512 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1ec43-4ab0-4a9b-bcb9-726f6b4c1df5 None admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:22.830440 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1ec43-4ab0-4a9b-bcb9-726f6b4c1df5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:22.831578 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1ec43-4ab0-4a9b-bcb9-726f6b4c1df5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:22.833796 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1ec43-4ab0-4a9b-bcb9-726f6b4c1df5 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:22.857062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 388/767] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:22.864715 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1ec43-4ab0-4a9b-bcb9-726f6b4c1df5 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:22.910069 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77ef0db-f6f1-44ad-9426-c68de9ed8cc0 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:22.966296 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:22.972765 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604edf0-bbac-494f-bbc1-3856cf5d771b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:22.973768 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604edf0-bbac-494f-bbc1-3856cf5d771b None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:22.974929 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604edf0-bbac-494f-bbc1-3856cf5d771b None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:22.975382 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604edf0-bbac-494f-bbc1-3856cf5d771b None admin] PATH_INFO: `/v3/services` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:22.976412 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e604edf0-bbac-494f-bbc1-3856cf5d771b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:22.980939 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e604edf0-bbac-494f-bbc1-3856cf5d771b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:22.982597 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e604edf0-bbac-494f-bbc1-3856cf5d771b None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:22.992501 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 380/768] 10.222.0.27 () {56 vars in 1124 bytes} [Tue Jul 5 20:36:22 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:23.001592 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604edf0-bbac-494f-bbc1-3856cf5d771b None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:23.025905 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:23.048228 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1ec43-4ab0-4a9b-bcb9-726f6b4c1df5 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:23.103883 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bfbe86-ff53-492c-99ca-981809d372bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:23.104787 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfbe86-ff53-492c-99ca-981809d372bf None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:23.105068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfbe86-ff53-492c-99ca-981809d372bf None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:23.105340 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfbe86-ff53-492c-99ca-981809d372bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:23.112560 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bfbe86-ff53-492c-99ca-981809d372bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:23.114153 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bfbe86-ff53-492c-99ca-981809d372bf None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:23.129323 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-16bfbe86-ff53-492c-99ca-981809d372bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:23.129323 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:23.129323 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:23.129323 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:23.129323 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:23.129323 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:23.129323 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:23.129323 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:23.129323 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:23.129323 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:23.129323 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:23.129323 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:23.129323 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:36:23.129323 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:36:23.129323 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:36:23.130287 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:36:23.130287 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:23.130287 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:23.130287 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:23.130287 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:23.130287 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:23.130287 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:23.130287 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:23.130287 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:23.130287 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:23.130287 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:23.130287 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:23.130287 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:23.130287 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:23.130287 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:23.130287 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:23.130287 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:23.131220 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:36:23.131220 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:36:23.131220 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:36:23.131220 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:36:23.131220 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:36:23.131220 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:36:23.131220 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:23.131220 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:23.131220 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 389/769] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:36:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:36:23.137564 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bfbe86-ff53-492c-99ca-981809d372bf None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:23.164814 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604edf0-bbac-494f-bbc1-3856cf5d771b None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:23.205887 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3016a-bc19-4a81-a569-79d3b4b03850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:23.206561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3016a-bc19-4a81-a569-79d3b4b03850 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:23.207000 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3016a-bc19-4a81-a569-79d3b4b03850 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:23.207280 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3016a-bc19-4a81-a569-79d3b4b03850 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:23.208455 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad3016a-bc19-4a81-a569-79d3b4b03850 None admin] RBAC: Adding query filter params (interface=public, service_id=94b332a48eb947508fb2ccb2e52c93c0, region_id=RegionOne) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:23.209028 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad3016a-bc19-4a81-a569-79d3b4b03850 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:23.210609 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad3016a-bc19-4a81-a569-79d3b4b03850 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:23.225135 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 381/770] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Jul 5 20:36:23 2022] GET /identity/v3/endpoints?service_id=94b332a48eb947508fb2ccb2e52c93c0&interface=public®ion_id=RegionOne => generated 194 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:23.227162 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39ac9c-826c-4882-8f76-df05c13367d6 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:23.227448 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39ac9c-826c-4882-8f76-df05c13367d6 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:23.227868 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39ac9c-826c-4882-8f76-df05c13367d6 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:23.229955 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 382/771] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:23.230694 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39ac9c-826c-4882-8f76-df05c13367d6 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:23.278179 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bfbe86-ff53-492c-99ca-981809d372bf None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:23.301140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:23.323783 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe736f-0382-4bce-a7e0-cece67e58a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:23.324599 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe736f-0382-4bce-a7e0-cece67e58a85 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:23.324797 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe736f-0382-4bce-a7e0-cece67e58a85 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:23.325072 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe736f-0382-4bce-a7e0-cece67e58a85 None admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:23.326028 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe736f-0382-4bce-a7e0-cece67e58a85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:23.326336 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe736f-0382-4bce-a7e0-cece67e58a85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:23.327797 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe736f-0382-4bce-a7e0-cece67e58a85 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:23.349265 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 390/772] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 5 20:36:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:23.351009 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82c4ef-d2e3-45b9-b053-9b7b1baa704d None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:23.351293 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82c4ef-d2e3-45b9-b053-9b7b1baa704d None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:23.351566 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82c4ef-d2e3-45b9-b053-9b7b1baa704d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:23.360981 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39ac9c-826c-4882-8f76-df05c13367d6 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:23.372086 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-5c82c4ef-d2e3-45b9-b053-9b7b1baa704d None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:23.373319 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-5c82c4ef-d2e3-45b9-b053-9b7b1baa704d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:23.375928 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:23.412817 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b343846-c4d4-4a9f-a44d-0bf9fe0e1504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:23.413762 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b343846-c4d4-4a9f-a44d-0bf9fe0e1504 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:23.414214 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b343846-c4d4-4a9f-a44d-0bf9fe0e1504 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:23.414671 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b343846-c4d4-4a9f-a44d-0bf9fe0e1504 None admin] PATH_INFO: `/v3/services` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:23.415757 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b343846-c4d4-4a9f-a44d-0bf9fe0e1504 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:23.418129 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b343846-c4d4-4a9f-a44d-0bf9fe0e1504 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:23.430368 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 383/773] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Jul 5 20:36:23 2022] GET /identity/v3/services => generated 772 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:23.430368 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b343846-c4d4-4a9f-a44d-0bf9fe0e1504 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:23.477209 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 391/774] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:36:23.543395 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82c4ef-d2e3-45b9-b053-9b7b1baa704d None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:23.587628 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b343846-c4d4-4a9f-a44d-0bf9fe0e1504 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:23.629469 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:23.650728 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a67b70-9a2e-4d63-8086-baace2dce67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:23.651900 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a67b70-9a2e-4d63-8086-baace2dce67f None admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:23.652181 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a67b70-9a2e-4d63-8086-baace2dce67f None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:23.652458 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a67b70-9a2e-4d63-8086-baace2dce67f None admin] PATH_INFO: `/v3/projects/b321588ec1f14bcb94a184310cf72856/users/814b675b98b844a2a12a39890ee69d2b/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:23.655424 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a67b70-9a2e-4d63-8086-baace2dce67f None admin] RBAC: Authorizing `identity:create_grant(project_id=b321588ec1f14bcb94a184310cf72856, user_id=814b675b98b844a2a12a39890ee69d2b, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:23.657044 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a67b70-9a2e-4d63-8086-baace2dce67f None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:23.681998 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 384/775] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 5 20:36:23 2022] PUT /identity/v3/projects/b321588ec1f14bcb94a184310cf72856/users/814b675b98b844a2a12a39890ee69d2b/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:36:23.715791 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82c4ef-d2e3-45b9-b053-9b7b1baa704d None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:23.758538 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc6827-0f60-4756-baf0-5ff8d6ecb5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:23.759815 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc6827-0f60-4756-baf0-5ff8d6ecb5bb None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:23.760372 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc6827-0f60-4756-baf0-5ff8d6ecb5bb None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:23.760866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc6827-0f60-4756-baf0-5ff8d6ecb5bb None admin] PATH_INFO: `/v3/services/network` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:23.761768 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc6827-0f60-4756-baf0-5ff8d6ecb5bb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:23.763621 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc6827-0f60-4756-baf0-5ff8d6ecb5bb None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:23.777007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-74dc6827-0f60-4756-baf0-5ff8d6ecb5bb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 20:36:23.777007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:23.777007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:36:23.777007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:36:23.777007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:36:23.777007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:36:23.777007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:36:23.777007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:23.777007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 20:36:23.777007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:23.777007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:36:23.777007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:23.777007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:23.777007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:23.777007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:23.777007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:23.777007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:23.778241 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:23.778241 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:23.778241 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:23.778241 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:23.778241 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:23.778241 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:23.778241 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:36:23.778241 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:36:23.778241 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:36:23.778241 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:36:23.778241 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:23.778241 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:23.778241 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:23.778241 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:23.778241 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:23.778241 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:23.779076 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:23.779076 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:23.779076 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:23.779076 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:23.779076 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:23.779076 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:23.779076 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:23.779076 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:23.779076 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:23.779076 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:23.779076 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:36:23.779076 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:23.779076 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 20:36:23.779076 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:23.782177 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 392/776] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:36:23 2022] GET /identity/v3/services/network => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:36:23.788742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a67b70-9a2e-4d63-8086-baace2dce67f None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:24.040161 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a67b70-9a2e-4d63-8086-baace2dce67f None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:24.078964 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2bffae-c9f5-48e1-b318-0468810a51e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:24.080037 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bffae-c9f5-48e1-b318-0468810a51e5 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:24.080518 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bffae-c9f5-48e1-b318-0468810a51e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:24.080992 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bffae-c9f5-48e1-b318-0468810a51e5 None admin] PATH_INFO: `/v3/services` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:24.081931 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2bffae-c9f5-48e1-b318-0468810a51e5 None admin] RBAC: Adding query filter params (name=network) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:24.082439 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2bffae-c9f5-48e1-b318-0468810a51e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:24.084187 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2bffae-c9f5-48e1-b318-0468810a51e5 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:24.090060 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 385/777] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Jul 5 20:36:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:24.103246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc6827-0f60-4756-baf0-5ff8d6ecb5bb None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:24.106799 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:24.218997 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc6827-0f60-4756-baf0-5ff8d6ecb5bb None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:24.264747 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1d105-2585-48a0-8a30-4f3ce332e9a0 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:24.265190 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1d105-2585-48a0-8a30-4f3ce332e9a0 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:24.265472 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1d105-2585-48a0-8a30-4f3ce332e9a0 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:24.267056 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 386/778] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:36:24.270838 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84db38-f030-4bfb-938c-49210025629a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:24.271518 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84db38-f030-4bfb-938c-49210025629a None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:24.271800 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84db38-f030-4bfb-938c-49210025629a None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:24.272076 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84db38-f030-4bfb-938c-49210025629a None admin] PATH_INFO: `/v3/services` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:24.272866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84db38-f030-4bfb-938c-49210025629a None admin] RBAC: Adding query filter params (type=network) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:24.273173 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84db38-f030-4bfb-938c-49210025629a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:24.273519 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041388e-1c3f-48fb-bef4-6452e89670f3 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:24.273971 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041388e-1c3f-48fb-bef4-6452e89670f3 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:24.274380 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041388e-1c3f-48fb-bef4-6452e89670f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:24.274638 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84db38-f030-4bfb-938c-49210025629a None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:24.281800 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 393/779] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Jul 5 20:36:24 2022] GET /identity/v3/services?type=network => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:24.291412 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84db38-f030-4bfb-938c-49210025629a None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:24.301734 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-8041388e-1c3f-48fb-bef4-6452e89670f3 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:24.303086 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-8041388e-1c3f-48fb-bef4-6452e89670f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:24.355747 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:24.371484 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:24.396009 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 387/780] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:36:24.397966 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c81a4-ec53-44f9-a361-7d2a592c4834 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:24.398917 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c81a4-ec53-44f9-a361-7d2a592c4834 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:24.399343 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c81a4-ec53-44f9-a361-7d2a592c4834 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:24.405913 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 388/781] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:24.407645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a72a5-f363-45b0-839b-ad77b4678481 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:24.408348 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a72a5-f363-45b0-839b-ad77b4678481 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:24.408789 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a72a5-f363-45b0-839b-ad77b4678481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:24.415674 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84db38-f030-4bfb-938c-49210025629a None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:24.430431 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-949a72a5-f363-45b0-839b-ad77b4678481 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:24.431644 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-949a72a5-f363-45b0-839b-ad77b4678481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:24.473550 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73fa1a7-5e5a-438d-aa27-5c174cb79b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:24.474318 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fa1a7-5e5a-438d-aa27-5c174cb79b71 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:24.474603 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fa1a7-5e5a-438d-aa27-5c174cb79b71 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:24.474880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fa1a7-5e5a-438d-aa27-5c174cb79b71 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:24.475981 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73fa1a7-5e5a-438d-aa27-5c174cb79b71 None admin] RBAC: Adding query filter params (interface=public, service_id=969ec933467d45e8929f98222a6dc1bb, region_id=RegionOne) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:24.476298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73fa1a7-5e5a-438d-aa27-5c174cb79b71 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:24.478713 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73fa1a7-5e5a-438d-aa27-5c174cb79b71 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:24.490843 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 394/782] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Jul 5 20:36:24 2022] GET /identity/v3/endpoints?service_id=969ec933467d45e8929f98222a6dc1bb&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:24.492026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73fa1a7-5e5a-438d-aa27-5c174cb79b71 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:24.517863 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 389/783] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:36:24.519019 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a72a5-f363-45b0-839b-ad77b4678481 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:24.629617 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73fa1a7-5e5a-438d-aa27-5c174cb79b71 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:24.638520 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a72a5-f363-45b0-839b-ad77b4678481 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:24.641816 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:24.671372 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:24.679211 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da276207-687f-4591-9f04-df893978438c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:24.679427 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4359e-c1fa-497c-99bd-dff7fe01c1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:24.680192 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4359e-c1fa-497c-99bd-dff7fe01c1fa None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:24.680393 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da276207-687f-4591-9f04-df893978438c None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:24.680509 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4359e-c1fa-497c-99bd-dff7fe01c1fa None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:24.680740 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4359e-c1fa-497c-99bd-dff7fe01c1fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:24.681058 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da276207-687f-4591-9f04-df893978438c None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:24.681478 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da276207-687f-4591-9f04-df893978438c None admin] PATH_INFO: `/v3/services` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:24.682350 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da276207-687f-4591-9f04-df893978438c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:24.683926 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da276207-687f-4591-9f04-df893978438c None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:24.690157 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 390/784] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Jul 5 20:36:24 2022] GET /identity/v3/services => generated 772 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:24.691216 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da276207-687f-4591-9f04-df893978438c None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:24.693799 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b4359e-c1fa-497c-99bd-dff7fe01c1fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:36:24.704609 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-e4b4359e-c1fa-497c-99bd-dff7fe01c1fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:36:24.704609 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:24.704609 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:24.704609 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:24.704609 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:24.704609 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:24.704609 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:24.704609 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:24.704609 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:24.704609 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:24.704609 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:24.704609 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:24.704609 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:36:24.704609 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:36:24.704609 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:36:24.704609 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:36:24.705866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:36:24.705866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:36:24.705866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:36:24.705866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:36:24.705866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:24.705866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:24.705866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:24.705866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:24.705866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:24.705866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:24.705866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:24.705866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:24.705866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:24.705866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:24.705866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:24.705866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:24.706769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:24.706769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:24.706769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:24.706769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:24.706769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:36:24.706769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:36:24.706769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:36:24.706769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:36:24.706769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:36:24.706769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:36:24.706769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:36:24.706769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:24.706769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 395/785] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 5 20:36:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:24.712298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4359e-c1fa-497c-99bd-dff7fe01c1fa None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:24.895270 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da276207-687f-4591-9f04-df893978438c None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:24.904573 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4359e-c1fa-497c-99bd-dff7fe01c1fa None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:24.934468 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ab63f-3f52-44a4-a92d-20f225582974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:24.935280 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ab63f-3f52-44a4-a92d-20f225582974 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:24.935558 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ab63f-3f52-44a4-a92d-20f225582974 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:24.935888 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ab63f-3f52-44a4-a92d-20f225582974 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:24.949058 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ab63f-3f52-44a4-a92d-20f225582974 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:36:24.951798 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a6cf9-3f59-42aa-95be-5d8719e60cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:24.952754 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a6cf9-3f59-42aa-95be-5d8719e60cbb None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:24.953245 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a6cf9-3f59-42aa-95be-5d8719e60cbb None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:24.953723 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a6cf9-3f59-42aa-95be-5d8719e60cbb None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:24.954717 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a6cf9-3f59-42aa-95be-5d8719e60cbb None admin] RBAC: Adding query filter params (name=admin) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:24.955231 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a6cf9-3f59-42aa-95be-5d8719e60cbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:24.956876 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a6cf9-3f59-42aa-95be-5d8719e60cbb None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:24.957154 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-7e2ab63f-3f52-44a4-a92d-20f225582974 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:36:24.957154 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:24.957154 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:24.957154 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:24.957154 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:24.957154 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:24.957154 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:24.957154 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:24.957154 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:24.957154 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:24.957154 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:24.957154 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:24.957154 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:36:24.957154 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:36:24.957154 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:36:24.957154 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:36:24.958106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:36:24.958106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:36:24.958106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:36:24.958106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:36:24.958106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:24.958106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:24.958106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:24.958106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:24.958106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:24.958106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:24.958106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:24.958106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:24.958106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:24.958106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:24.958106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:24.958106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:24.958975 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:24.958975 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:24.958975 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:24.958975 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:24.958975 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:36:24.958975 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:36:24.958975 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:36:24.958975 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:36:24.958975 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:36:24.958975 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:36:24.958975 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:36:24.958975 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:24.958975 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 391/786] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 5 20:36:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:24.964907 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ab63f-3f52-44a4-a92d-20f225582974 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:24.974026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 396/787] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:36:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:36:24.981779 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a6cf9-3f59-42aa-95be-5d8719e60cbb None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:25.006207 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:25.069331 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:25.150975 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ab63f-3f52-44a4-a92d-20f225582974 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:25.161889 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a6cf9-3f59-42aa-95be-5d8719e60cbb None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:25.211465 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d91eb-cfa8-4693-91ff-18ccbe289384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:25.212147 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d91eb-cfa8-4693-91ff-18ccbe289384 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:25.212428 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d91eb-cfa8-4693-91ff-18ccbe289384 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:25.212703 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d91eb-cfa8-4693-91ff-18ccbe289384 None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:25.213474 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d91eb-cfa8-4693-91ff-18ccbe289384 None admin] RBAC: Adding query filter params (name=service) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:25.213780 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d91eb-cfa8-4693-91ff-18ccbe289384 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:25.215840 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d91eb-cfa8-4693-91ff-18ccbe289384 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:25.220428 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21845ba-bfdf-4128-be6d-968a2ced2167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:25.221239 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21845ba-bfdf-4128-be6d-968a2ced2167 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:25.221520 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21845ba-bfdf-4128-be6d-968a2ced2167 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:25.221794 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21845ba-bfdf-4128-be6d-968a2ced2167 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:25.236763 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 392/788] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 5 20:36:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:36:25.243062 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d91eb-cfa8-4693-91ff-18ccbe289384 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:25.244225 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21845ba-bfdf-4128-be6d-968a2ced2167 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:25.245763 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21845ba-bfdf-4128-be6d-968a2ced2167 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:25.264983 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-c21845ba-bfdf-4128-be6d-968a2ced2167 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:25.264983 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:25.264983 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:25.264983 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:25.264983 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:25.264983 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:25.264983 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:25.264983 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:25.264983 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:25.264983 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:25.264983 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:25.264983 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:25.264983 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:25.264983 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:25.264983 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:25.265916 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:25.265916 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:25.265916 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:25.265916 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:25.265916 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:25.265916 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:25.265916 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:25.265916 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:25.265916 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:25.265916 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:25.265916 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:25.265916 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:25.265916 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:25.265916 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:25.265916 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:25.265916 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:25.265916 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:25.266831 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:25.266831 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:25.266831 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:25.266831 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:25.270364 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 397/789] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:25.272550 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21845ba-bfdf-4128-be6d-968a2ced2167 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:25.377916 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21845ba-bfdf-4128-be6d-968a2ced2167 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:25.382264 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:25.437601 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7c6c2-5137-4be9-8e7d-e0c0e2ae1819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:25.438213 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7c6c2-5137-4be9-8e7d-e0c0e2ae1819 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:25.438495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7c6c2-5137-4be9-8e7d-e0c0e2ae1819 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:25.438769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7c6c2-5137-4be9-8e7d-e0c0e2ae1819 None admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:25.439498 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7c6c2-5137-4be9-8e7d-e0c0e2ae1819 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:25.439804 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7c6c2-5137-4be9-8e7d-e0c0e2ae1819 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:25.441205 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7c6c2-5137-4be9-8e7d-e0c0e2ae1819 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:25.466713 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 398/790] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:36:25.472551 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7c6c2-5137-4be9-8e7d-e0c0e2ae1819 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:25.477292 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:25.495367 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d91eb-cfa8-4693-91ff-18ccbe289384 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:25.549122 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e53ff5d-9c16-4291-be2f-945e5b08eb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:25.550335 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53ff5d-9c16-4291-be2f-945e5b08eb1a None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:25.550619 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53ff5d-9c16-4291-be2f-945e5b08eb1a None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:25.550901 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53ff5d-9c16-4291-be2f-945e5b08eb1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:25.562537 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e53ff5d-9c16-4291-be2f-945e5b08eb1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:25.563734 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e53ff5d-9c16-4291-be2f-945e5b08eb1a None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:25.582025 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-0e53ff5d-9c16-4291-be2f-945e5b08eb1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:25.582025 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:25.582025 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:25.582025 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:25.582025 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:25.582025 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:25.582025 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:25.582025 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:25.582025 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:25.582025 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:25.582025 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:25.582025 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:25.582025 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:25.582025 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:25.582025 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:25.582999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:25.582999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:25.582999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:25.582999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:25.582999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:25.582999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:25.582999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:25.582999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:25.582999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:25.582999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:25.582999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:25.582999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:25.582999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:25.582999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:25.582999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:25.582999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:25.582999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:25.583882 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:25.583882 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:25.583882 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:25.583882 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:25.583882 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 393/791] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:36:25.589001 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e53ff5d-9c16-4291-be2f-945e5b08eb1a None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:25.715954 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7c6c2-5137-4be9-8e7d-e0c0e2ae1819 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:25.733309 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e53ff5d-9c16-4291-be2f-945e5b08eb1a None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:25.770878 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cbcbcf-8e05-4ae3-a522-8cd85317052d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:25.771927 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbcbcf-8e05-4ae3-a522-8cd85317052d None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:25.772215 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbcbcf-8e05-4ae3-a522-8cd85317052d None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:25.772489 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbcbcf-8e05-4ae3-a522-8cd85317052d None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:25.773223 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cbcbcf-8e05-4ae3-a522-8cd85317052d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:25.773530 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cbcbcf-8e05-4ae3-a522-8cd85317052d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:25.774964 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cbcbcf-8e05-4ae3-a522-8cd85317052d None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:25.788811 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 394/792] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:25.794107 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cbcbcf-8e05-4ae3-a522-8cd85317052d None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:25.798131 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:25.842568 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1841013-6ebe-4468-8cc4-fa2818b6f717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:25.843393 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1841013-6ebe-4468-8cc4-fa2818b6f717 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:25.843675 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1841013-6ebe-4468-8cc4-fa2818b6f717 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:25.843948 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1841013-6ebe-4468-8cc4-fa2818b6f717 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:25.866708 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1841013-6ebe-4468-8cc4-fa2818b6f717 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:25.868183 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1841013-6ebe-4468-8cc4-fa2818b6f717 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:25.897871 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-a1841013-6ebe-4468-8cc4-fa2818b6f717 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 20:36:25.897871 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:25.897871 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:25.897871 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:25.897871 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:25.897871 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:25.897871 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:25.897871 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:25.897871 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:25.897871 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:25.897871 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:25.897871 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:25.897871 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:36:25.897871 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:36:25.897871 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:36:25.897871 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:36:25.900558 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:25.900558 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:25.900558 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:36:25.900558 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:25.900558 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:36:25.900558 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:25.900558 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:25.900558 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:25.900558 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:25.900558 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:25.900558 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:25.900558 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:25.900558 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:25.900558 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:25.900558 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:25.900558 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:25.900558 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:25.900558 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:25.903208 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:25.903208 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:25.903208 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:36:25.903208 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:36:25.903208 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:36:25.903208 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:36:25.903208 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:36:25.903208 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:36:25.903208 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 20:36:25.903208 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:25.903208 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 399/793] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 5 20:36:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:36:25.904575 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cbcbcf-8e05-4ae3-a522-8cd85317052d None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:25.906809 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1841013-6ebe-4468-8cc4-fa2818b6f717 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:25.943348 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0a85f-7c25-450c-bc63-fca29ecee858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:25.944177 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0a85f-7c25-450c-bc63-fca29ecee858 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:25.944457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0a85f-7c25-450c-bc63-fca29ecee858 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:25.944728 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0a85f-7c25-450c-bc63-fca29ecee858 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:25.962086 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de0a85f-7c25-450c-bc63-fca29ecee858 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:25.963559 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de0a85f-7c25-450c-bc63-fca29ecee858 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:25.965262 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:25.993590 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-3de0a85f-7c25-450c-bc63-fca29ecee858 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 20:36:25.993590 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:25.993590 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:25.993590 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:25.993590 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:25.993590 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:25.993590 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:25.993590 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:25.993590 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:25.993590 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:25.993590 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:25.993590 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:25.993590 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:36:25.993590 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:36:25.993590 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:36:25.993590 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:36:25.995812 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:25.995812 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:25.995812 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:36:25.995812 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:25.995812 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:36:25.995812 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:25.995812 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:25.995812 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:25.995812 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:25.995812 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:25.995812 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:25.995812 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:25.995812 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:25.995812 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:25.995812 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:25.995812 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:25.995812 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:25.995812 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:25.998193 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:25.998193 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:25.998193 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:36:25.998193 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:36:25.998193 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:36:25.998193 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:36:25.998193 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:36:25.998193 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:36:25.998193 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 20:36:25.998193 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:26.006767 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 395/794] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Jul 5 20:36:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:26.007705 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0a85f-7c25-450c-bc63-fca29ecee858 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:26.071294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1841013-6ebe-4468-8cc4-fa2818b6f717 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:26.091041 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:26.111813 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2efd80-5047-484e-a9d3-7ee27b6d3085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:26.112510 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2efd80-5047-484e-a9d3-7ee27b6d3085 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:26.112852 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2efd80-5047-484e-a9d3-7ee27b6d3085 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:26.113124 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2efd80-5047-484e-a9d3-7ee27b6d3085 None admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:26.113992 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2efd80-5047-484e-a9d3-7ee27b6d3085 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:26.114291 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2efd80-5047-484e-a9d3-7ee27b6d3085 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:26.115833 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2efd80-5047-484e-a9d3-7ee27b6d3085 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:26.137677 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0a85f-7c25-450c-bc63-fca29ecee858 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:26.143081 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 400/795] 10.222.0.27 () {56 vars in 1135 bytes} [Tue Jul 5 20:36:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:26.143081 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd5aa1-b0fe-46eb-8ab8-f138af2e2fb7 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:26.143081 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd5aa1-b0fe-46eb-8ab8-f138af2e2fb7 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:26.143081 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd5aa1-b0fe-46eb-8ab8-f138af2e2fb7 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:26.153143 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 401/796] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:26.153143 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd5aa1-b0fe-46eb-8ab8-f138af2e2fb7 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:26.178603 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac7e146-c64b-4d6d-b661-cf40e6ac903f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:26.179723 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7e146-c64b-4d6d-b661-cf40e6ac903f None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:26.180123 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7e146-c64b-4d6d-b661-cf40e6ac903f None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:26.180408 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7e146-c64b-4d6d-b661-cf40e6ac903f None admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:26.181418 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac7e146-c64b-4d6d-b661-cf40e6ac903f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:26.182051 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac7e146-c64b-4d6d-b661-cf40e6ac903f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:26.184008 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac7e146-c64b-4d6d-b661-cf40e6ac903f None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:26.205021 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 396/797] 10.222.0.27 () {56 vars in 1149 bytes} [Tue Jul 5 20:36:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:26.206602 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecffd86-40c7-410e-861c-8aa3ef0b62de None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:26.206948 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecffd86-40c7-410e-861c-8aa3ef0b62de None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:26.207289 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecffd86-40c7-410e-861c-8aa3ef0b62de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:26.223449 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-4ecffd86-40c7-410e-861c-8aa3ef0b62de None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:26.224617 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-4ecffd86-40c7-410e-861c-8aa3ef0b62de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:26.240880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:26.260319 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd5aa1-b0fe-46eb-8ab8-f138af2e2fb7 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:26.295872 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a455f64-99fb-4321-b5ff-b4d06ed86e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:26.296692 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 397/798] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:36:26.297248 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a455f64-99fb-4321-b5ff-b4d06ed86e23 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:26.297729 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a455f64-99fb-4321-b5ff-b4d06ed86e23 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:26.298124 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789e404-c47e-4f3d-b753-af9c2f24824d None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:26.298405 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789e404-c47e-4f3d-b753-af9c2f24824d None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:26.298615 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a455f64-99fb-4321-b5ff-b4d06ed86e23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:26.298744 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789e404-c47e-4f3d-b753-af9c2f24824d None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:26.300536 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 398/799] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:26.301223 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789e404-c47e-4f3d-b753-af9c2f24824d None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:26.320184 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a455f64-99fb-4321-b5ff-b4d06ed86e23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:26.322276 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a455f64-99fb-4321-b5ff-b4d06ed86e23 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:26.340504 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-6a455f64-99fb-4321-b5ff-b4d06ed86e23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:26.340504 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:26.340504 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:26.340504 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:26.340504 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:26.340504 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:26.340504 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:26.340504 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:26.340504 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:26.340504 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:26.340504 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:26.340504 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:26.340504 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:26.340504 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:26.340504 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:26.341410 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:26.341410 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:26.341410 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:26.341410 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:26.341410 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:26.341410 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:26.341410 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:26.341410 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:26.341410 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:26.341410 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:26.341410 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:26.341410 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:26.341410 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:26.341410 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:26.341410 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:26.341410 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:26.341410 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:26.342371 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:26.342371 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:26.342371 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:26.342371 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:26.342371 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 402/800] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:26.343182 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009c5d8-7a82-44b9-a41b-0fda46575556 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:26.343459 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009c5d8-7a82-44b9-a41b-0fda46575556 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:26.343731 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009c5d8-7a82-44b9-a41b-0fda46575556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:26.359739 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:26.359882 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-7009c5d8-7a82-44b9-a41b-0fda46575556 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:26.361012 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-7009c5d8-7a82-44b9-a41b-0fda46575556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:26.416174 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789e404-c47e-4f3d-b753-af9c2f24824d None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:26.441972 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 403/801] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:36:26.441972 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009c5d8-7a82-44b9-a41b-0fda46575556 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:26.474429 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc9453-a133-4f91-ac9f-474efe8678ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:26.475228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc9453-a133-4f91-ac9f-474efe8678ff None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:26.475502 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc9453-a133-4f91-ac9f-474efe8678ff None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:26.477562 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc9453-a133-4f91-ac9f-474efe8678ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:26.491028 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc9453-a133-4f91-ac9f-474efe8678ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:26.492582 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc9453-a133-4f91-ac9f-474efe8678ff None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:26.510285 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-44bc9453-a133-4f91-ac9f-474efe8678ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:26.510285 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:26.510285 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:26.510285 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:26.510285 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:26.510285 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:26.510285 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:26.510285 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:26.510285 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:26.510285 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:26.510285 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:26.510285 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:26.510285 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:26.510285 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:26.510285 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:26.511264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:26.511264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:26.511264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:26.511264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:26.511264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:26.511264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:26.511264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:26.511264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:26.511264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:26.511264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:26.511264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:26.511264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:26.511264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:26.511264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:26.511264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:26.511264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:26.511264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:26.512228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:26.512228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:26.512228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:26.512228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:26.512228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 399/802] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:26.512525 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc9453-a133-4f91-ac9f-474efe8678ff None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:26.522408 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:26.562843 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009c5d8-7a82-44b9-a41b-0fda46575556 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:26.617712 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc9453-a133-4f91-ac9f-474efe8678ff None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:26.619634 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:26.658673 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d633e-6c50-497f-850e-bd4fb17646c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:26.659395 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d633e-6c50-497f-850e-bd4fb17646c2 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:26.659676 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d633e-6c50-497f-850e-bd4fb17646c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:26.659942 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d633e-6c50-497f-850e-bd4fb17646c2 None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:26.660681 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d633e-6c50-497f-850e-bd4fb17646c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:26.660984 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d633e-6c50-497f-850e-bd4fb17646c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:26.662436 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d633e-6c50-497f-850e-bd4fb17646c2 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:26.680184 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 400/803] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:26.680184 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d633e-6c50-497f-850e-bd4fb17646c2 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:26.716464 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253839c-aa2e-41c1-bf67-00a486728e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:26.717279 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253839c-aa2e-41c1-bf67-00a486728e7a None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:26.717558 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253839c-aa2e-41c1-bf67-00a486728e7a None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:26.717873 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253839c-aa2e-41c1-bf67-00a486728e7a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:26.718501 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253839c-aa2e-41c1-bf67-00a486728e7a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:26.719896 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253839c-aa2e-41c1-bf67-00a486728e7a None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:26.732141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-4253839c-aa2e-41c1-bf67-00a486728e7a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 20:36:26.732141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:26.732141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:36:26.732141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:36:26.732141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:36:26.732141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:36:26.732141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:36:26.732141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:26.732141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 20:36:26.732141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:26.732141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:36:26.732141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:26.732141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:26.732141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:26.732141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:26.732141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:26.733397 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:26.733397 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:26.733397 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:26.733397 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:26.733397 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:26.733397 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:26.733397 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:26.733397 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:36:26.733397 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:36:26.733397 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:36:26.733397 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:36:26.733397 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:26.733397 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:26.733397 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:26.733397 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:26.733397 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:26.734354 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:26.734354 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:26.734354 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:26.734354 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:26.734354 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:26.734354 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:26.734354 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:26.734354 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:26.734354 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:26.734354 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:26.734354 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:26.734354 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:36:26.734354 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:26.734354 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 05 20:36:26.734354 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:26.734354 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 404/804] 10.222.0.27 () {56 vars in 1129 bytes} [Tue Jul 5 20:36:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:26.735919 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253839c-aa2e-41c1-bf67-00a486728e7a None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:26.790898 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d633e-6c50-497f-850e-bd4fb17646c2 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:26.828681 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b9aaf-92e6-4d40-95e6-5cab81c26bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:26.829481 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b9aaf-92e6-4d40-95e6-5cab81c26bfa None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:26.829756 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b9aaf-92e6-4d40-95e6-5cab81c26bfa None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:26.830049 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b9aaf-92e6-4d40-95e6-5cab81c26bfa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:26.838749 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253839c-aa2e-41c1-bf67-00a486728e7a None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:26.840359 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b9aaf-92e6-4d40-95e6-5cab81c26bfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:36:26.847984 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-094b9aaf-92e6-4d40-95e6-5cab81c26bfa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:36:26.847984 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:26.847984 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:26.847984 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:26.847984 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:26.847984 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:26.847984 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:26.847984 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:26.847984 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:26.847984 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:26.847984 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:26.847984 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:26.847984 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:36:26.847984 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:36:26.847984 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:36:26.847984 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:36:26.848927 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:36:26.848927 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:36:26.848927 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:36:26.848927 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:36:26.848927 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:26.848927 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:26.848927 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:26.848927 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:26.848927 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:26.848927 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:26.848927 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:26.848927 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:26.848927 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:26.848927 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:26.848927 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:26.848927 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:26.849932 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:26.849932 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:26.849932 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:26.849932 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:26.849932 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:36:26.849932 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:36:26.849932 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:36:26.849932 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:36:26.849932 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:36:26.849932 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:36:26.849932 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:36:26.849932 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:26.849932 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 401/805] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 5 20:36:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:26.850690 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b9aaf-92e6-4d40-95e6-5cab81c26bfa None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:26.871556 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:26.880868 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:26.881001 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86192aca-dc41-4433-a15f-a8ab8c826cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:26.881642 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86192aca-dc41-4433-a15f-a8ab8c826cbd None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:26.881981 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86192aca-dc41-4433-a15f-a8ab8c826cbd None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:26.882555 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86192aca-dc41-4433-a15f-a8ab8c826cbd None admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:26.883379 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86192aca-dc41-4433-a15f-a8ab8c826cbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:26.883829 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86192aca-dc41-4433-a15f-a8ab8c826cbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:26.885272 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86192aca-dc41-4433-a15f-a8ab8c826cbd None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:26.898799 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 405/806] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:26.899738 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86192aca-dc41-4433-a15f-a8ab8c826cbd None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:26.967304 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b9aaf-92e6-4d40-95e6-5cab81c26bfa None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:27.001257 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d578b6-8689-4903-9fef-49461f12e5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:27.002092 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d578b6-8689-4903-9fef-49461f12e5e9 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:27.002367 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d578b6-8689-4903-9fef-49461f12e5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:27.002637 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d578b6-8689-4903-9fef-49461f12e5e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:27.007286 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86192aca-dc41-4433-a15f-a8ab8c826cbd None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:27.009198 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d578b6-8689-4903-9fef-49461f12e5e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:27.010672 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d578b6-8689-4903-9fef-49461f12e5e9 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:27.024433 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-48d578b6-8689-4903-9fef-49461f12e5e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:27.024433 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:27.024433 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:27.024433 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:27.024433 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:27.024433 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:27.024433 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:27.024433 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:27.024433 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:27.024433 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:27.024433 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:27.024433 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:27.024433 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:36:27.024433 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:36:27.024433 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:36:27.025310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:36:27.025310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:27.025310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:27.025310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:27.025310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:27.025310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:27.025310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:27.025310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:27.025310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:27.025310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:27.025310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:27.025310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:27.025310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:27.025310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:27.025310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:27.025310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:27.025310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:27.026242 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:36:27.026242 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:36:27.026242 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:36:27.026242 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:36:27.026242 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:36:27.026242 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:36:27.026242 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:27.026242 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:27.026242 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 402/807] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:36:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:27.026737 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d578b6-8689-4903-9fef-49461f12e5e9 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:27.041057 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c92860-dae7-40a0-8c3a-4222646a422a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:27.041649 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c92860-dae7-40a0-8c3a-4222646a422a None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:27.041951 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c92860-dae7-40a0-8c3a-4222646a422a None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:27.042225 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c92860-dae7-40a0-8c3a-4222646a422a None admin] PATH_INFO: `/v3/services` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:27.042922 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c92860-dae7-40a0-8c3a-4222646a422a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:27.043280 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c92860-dae7-40a0-8c3a-4222646a422a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:27.044642 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c92860-dae7-40a0-8c3a-4222646a422a None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:27.049308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 406/808] 10.222.0.27 () {56 vars in 1124 bytes} [Tue Jul 5 20:36:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:27.050445 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c92860-dae7-40a0-8c3a-4222646a422a None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:27.102112 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:27.110662 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:27.128619 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d578b6-8689-4903-9fef-49461f12e5e9 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:27.150437 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c92860-dae7-40a0-8c3a-4222646a422a None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:27.162673 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab710c7-851c-4b9c-8bc7-6750648bac0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:27.163349 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab710c7-851c-4b9c-8bc7-6750648bac0f None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:27.163629 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab710c7-851c-4b9c-8bc7-6750648bac0f None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:27.163897 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab710c7-851c-4b9c-8bc7-6750648bac0f None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:27.164642 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab710c7-851c-4b9c-8bc7-6750648bac0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:27.164945 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab710c7-851c-4b9c-8bc7-6750648bac0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:27.166351 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab710c7-851c-4b9c-8bc7-6750648bac0f None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:27.174355 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 403/809] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:36:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:27.175909 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073591d7-9a5a-443d-b8a0-79e8f0d4ac4a None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:27.176193 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073591d7-9a5a-443d-b8a0-79e8f0d4ac4a None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:27.176464 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073591d7-9a5a-443d-b8a0-79e8f0d4ac4a None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:27.177824 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 404/810] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:27.182262 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073591d7-9a5a-443d-b8a0-79e8f0d4ac4a None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:27.185130 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905924b-4c6c-45e7-b319-812c7ba56f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:27.185961 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905924b-4c6c-45e7-b319-812c7ba56f80 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:27.186240 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905924b-4c6c-45e7-b319-812c7ba56f80 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:27.186514 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905924b-4c6c-45e7-b319-812c7ba56f80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:27.193126 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d905924b-4c6c-45e7-b319-812c7ba56f80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:27.194596 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d905924b-4c6c-45e7-b319-812c7ba56f80 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:27.208213 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-d905924b-4c6c-45e7-b319-812c7ba56f80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:27.208213 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:27.208213 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:27.208213 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:27.208213 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:27.208213 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:27.208213 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:27.208213 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:27.208213 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:27.208213 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:27.208213 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:27.208213 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:27.208213 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:36:27.208213 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:36:27.208213 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:36:27.209087 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:36:27.209087 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:27.209087 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:27.209087 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:27.209087 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:27.209087 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:27.209087 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:27.209087 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:27.209087 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:27.209087 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:27.209087 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:27.209087 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:27.209087 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:27.209087 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:27.209087 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:27.209087 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:27.209087 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:27.210016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:36:27.210016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:36:27.210016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:36:27.210016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:36:27.210016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:36:27.210016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:36:27.210016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:27.210016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:27.210016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 407/811] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:36:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:27.210767 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905924b-4c6c-45e7-b319-812c7ba56f80 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:27.294885 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073591d7-9a5a-443d-b8a0-79e8f0d4ac4a None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:27.313125 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905924b-4c6c-45e7-b319-812c7ba56f80 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:27.326186 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:27.329514 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9370c6-7438-4e6a-b52d-a0acebd0bdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:27.330279 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9370c6-7438-4e6a-b52d-a0acebd0bdbe None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:27.330496 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9370c6-7438-4e6a-b52d-a0acebd0bdbe None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:27.330770 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9370c6-7438-4e6a-b52d-a0acebd0bdbe None admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:27.331595 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9370c6-7438-4e6a-b52d-a0acebd0bdbe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:27.331901 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9370c6-7438-4e6a-b52d-a0acebd0bdbe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:27.333350 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9370c6-7438-4e6a-b52d-a0acebd0bdbe None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:27.345128 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 405/812] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 5 20:36:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:27.346170 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9370c6-7438-4e6a-b52d-a0acebd0bdbe None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:27.347934 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eee629-c9ba-4701-8658-565e8a4d9bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:27.348690 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eee629-c9ba-4701-8658-565e8a4d9bfa None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:27.349139 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eee629-c9ba-4701-8658-565e8a4d9bfa None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:27.349416 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eee629-c9ba-4701-8658-565e8a4d9bfa None admin] PATH_INFO: `/v3/services` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:27.349917 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:27.350933 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eee629-c9ba-4701-8658-565e8a4d9bfa None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:27.351243 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eee629-c9ba-4701-8658-565e8a4d9bfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:27.352802 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eee629-c9ba-4701-8658-565e8a4d9bfa None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:27.357878 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 408/813] 10.222.0.27 () {56 vars in 1124 bytes} [Tue Jul 5 20:36:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:27.362617 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860378cd-8eaa-4c21-b5b6-746316c0ef32 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:27.362617 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860378cd-8eaa-4c21-b5b6-746316c0ef32 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:27.362617 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860378cd-8eaa-4c21-b5b6-746316c0ef32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:27.375660 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-860378cd-8eaa-4c21-b5b6-746316c0ef32 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:27.376858 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-860378cd-8eaa-4c21-b5b6-746316c0ef32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:27.443808 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9370c6-7438-4e6a-b52d-a0acebd0bdbe None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:27.444405 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 409/814] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:36:27.445223 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860378cd-8eaa-4c21-b5b6-746316c0ef32 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:27.485406 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b91dd6-663c-4ace-8a7b-100d5a1a4a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:27.486234 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b91dd6-663c-4ace-8a7b-100d5a1a4a34 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:27.486519 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b91dd6-663c-4ace-8a7b-100d5a1a4a34 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:27.486796 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b91dd6-663c-4ace-8a7b-100d5a1a4a34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:27.497285 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b91dd6-663c-4ace-8a7b-100d5a1a4a34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:27.498809 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b91dd6-663c-4ace-8a7b-100d5a1a4a34 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:27.516261 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-94b91dd6-663c-4ace-8a7b-100d5a1a4a34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:27.516261 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:27.516261 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:27.516261 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:27.516261 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:27.516261 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:27.516261 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:27.516261 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:27.516261 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:27.516261 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:27.516261 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:27.516261 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:27.516261 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:27.516261 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:27.516261 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:27.517141 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:27.517141 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:27.517141 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:27.517141 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:27.517141 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:27.517141 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:27.517141 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:27.517141 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:27.517141 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:27.517141 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:27.517141 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:27.517141 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:27.517141 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:27.517141 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:27.517141 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:27.517141 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:27.517141 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:27.518076 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:27.518076 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:27.518076 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:27.518076 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:27.518076 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 406/815] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:27.518366 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b91dd6-663c-4ace-8a7b-100d5a1a4a34 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:27.544613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860378cd-8eaa-4c21-b5b6-746316c0ef32 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:27.552095 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:27.574855 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:27.579493 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd2a5b-5198-43f6-a56d-ae4dbf84593b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:27.580145 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd2a5b-5198-43f6-a56d-ae4dbf84593b None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:27.580446 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd2a5b-5198-43f6-a56d-ae4dbf84593b None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:27.580684 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd2a5b-5198-43f6-a56d-ae4dbf84593b None admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:27.581459 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd2a5b-5198-43f6-a56d-ae4dbf84593b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:27.581758 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd2a5b-5198-43f6-a56d-ae4dbf84593b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:27.583212 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd2a5b-5198-43f6-a56d-ae4dbf84593b None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:27.594851 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 410/816] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 5 20:36:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:27.595610 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd2a5b-5198-43f6-a56d-ae4dbf84593b None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:27.619190 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b91dd6-663c-4ace-8a7b-100d5a1a4a34 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:27.656013 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0873a1b9-88be-4d8a-8ba2-870a89c033d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:27.656951 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873a1b9-88be-4d8a-8ba2-870a89c033d2 None admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:27.657229 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873a1b9-88be-4d8a-8ba2-870a89c033d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:27.657495 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873a1b9-88be-4d8a-8ba2-870a89c033d2 None admin] PATH_INFO: `/v3/projects/b321588ec1f14bcb94a184310cf72856/users/90aa580a2e10467a93c2d79d1906bd8a/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:27.659514 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0873a1b9-88be-4d8a-8ba2-870a89c033d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=b321588ec1f14bcb94a184310cf72856, user_id=90aa580a2e10467a93c2d79d1906bd8a, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:27.660952 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0873a1b9-88be-4d8a-8ba2-870a89c033d2 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:27.674355 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 407/817] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 5 20:36:27 2022] PUT /identity/v3/projects/b321588ec1f14bcb94a184310cf72856/users/90aa580a2e10467a93c2d79d1906bd8a/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:36:27.675502 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0873a1b9-88be-4d8a-8ba2-870a89c033d2 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:27.699758 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd2a5b-5198-43f6-a56d-ae4dbf84593b None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:27.737930 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817f0c2-8005-48ef-9aee-8f6773fb3680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:27.738600 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817f0c2-8005-48ef-9aee-8f6773fb3680 None admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:27.738889 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817f0c2-8005-48ef-9aee-8f6773fb3680 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:27.739161 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817f0c2-8005-48ef-9aee-8f6773fb3680 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:27.739920 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817f0c2-8005-48ef-9aee-8f6773fb3680 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:27.741327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817f0c2-8005-48ef-9aee-8f6773fb3680 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:27.765032 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 411/818] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Jul 5 20:36:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:36:27.766335 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817f0c2-8005-48ef-9aee-8f6773fb3680 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:27.808644 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0873a1b9-88be-4d8a-8ba2-870a89c033d2 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:27.818290 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:27.841390 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:27.882693 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f64bd-b3aa-4c24-a3e0-30d02411e226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:27.883710 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f64bd-b3aa-4c24-a3e0-30d02411e226 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:27.883848 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f64bd-b3aa-4c24-a3e0-30d02411e226 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:27.884086 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f64bd-b3aa-4c24-a3e0-30d02411e226 None admin] PATH_INFO: `/v3/services/network` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:27.884781 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f64bd-b3aa-4c24-a3e0-30d02411e226 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:27.886687 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f64bd-b3aa-4c24-a3e0-30d02411e226 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:27.900478 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-da6f64bd-b3aa-4c24-a3e0-30d02411e226 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 20:36:27.900478 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:27.900478 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:36:27.900478 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:36:27.900478 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:36:27.900478 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:36:27.900478 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:36:27.900478 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:27.900478 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 20:36:27.900478 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:27.900478 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:36:27.900478 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:27.900478 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:27.900478 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:27.900478 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:27.900478 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:27.900478 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:27.901566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:27.901566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:27.901566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:27.901566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:27.901566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:27.901566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:27.901566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:36:27.901566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:36:27.901566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:36:27.901566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:36:27.901566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:27.901566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:27.901566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:27.901566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:27.901566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:27.901566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:27.902525 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:27.902525 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:27.902525 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:27.902525 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:27.902525 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:27.902525 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:27.902525 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:27.902525 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:27.902525 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:27.902525 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:27.902525 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:36:27.902525 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:27.902525 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 05 20:36:27.902525 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:27.902525 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 408/819] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:36:27 2022] GET /identity/v3/services/network => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:27.903331 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f64bd-b3aa-4c24-a3e0-30d02411e226 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:27.938114 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817f0c2-8005-48ef-9aee-8f6773fb3680 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:27.986748 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1decf2-25ee-4326-b392-1465f41a8eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:27.987417 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1decf2-25ee-4326-b392-1465f41a8eff None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:27.987694 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1decf2-25ee-4326-b392-1465f41a8eff None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:27.987960 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1decf2-25ee-4326-b392-1465f41a8eff None admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:27.988682 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1decf2-25ee-4326-b392-1465f41a8eff None admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:27.988980 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1decf2-25ee-4326-b392-1465f41a8eff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:27.991447 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1decf2-25ee-4326-b392-1465f41a8eff None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:28.012754 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 412/820] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:28.013959 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1decf2-25ee-4326-b392-1465f41a8eff None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:28.025259 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f64bd-b3aa-4c24-a3e0-30d02411e226 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:28.061391 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263baeb8-12a4-4677-a406-c41f5462f48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:28.062255 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263baeb8-12a4-4677-a406-c41f5462f48c None admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:28.062538 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263baeb8-12a4-4677-a406-c41f5462f48c None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:28.062819 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263baeb8-12a4-4677-a406-c41f5462f48c None admin] PATH_INFO: `/v3/projects/b321588ec1f14bcb94a184310cf72856/users/c9647d15389e49e6b7c43ea1b1538a13/roles/4f5057900b094e6fb792884693177cd3` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:28.079147 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263baeb8-12a4-4677-a406-c41f5462f48c None admin] RBAC: Authorizing `identity:create_grant(project_id=b321588ec1f14bcb94a184310cf72856, user_id=c9647d15389e49e6b7c43ea1b1538a13, role_id=4f5057900b094e6fb792884693177cd3)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:28.080618 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263baeb8-12a4-4677-a406-c41f5462f48c None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:28.098291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 409/821] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 5 20:36:27 2022] PUT /identity/v3/projects/b321588ec1f14bcb94a184310cf72856/users/c9647d15389e49e6b7c43ea1b1538a13/roles/4f5057900b094e6fb792884693177cd3 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:36:28.099224 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263baeb8-12a4-4677-a406-c41f5462f48c None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:28.125622 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:28.146873 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:28.165647 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1decf2-25ee-4326-b392-1465f41a8eff None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:28.222649 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d4cc5-9476-49f9-9565-03e1e3e75e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:28.223348 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d4cc5-9476-49f9-9565-03e1e3e75e0b None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:28.223626 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d4cc5-9476-49f9-9565-03e1e3e75e0b None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:28.223897 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d4cc5-9476-49f9-9565-03e1e3e75e0b None admin] PATH_INFO: `/v3/services` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:28.224635 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d4cc5-9476-49f9-9565-03e1e3e75e0b None admin] RBAC: Adding query filter params (name=network) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:28.224940 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d4cc5-9476-49f9-9565-03e1e3e75e0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:28.226403 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d4cc5-9476-49f9-9565-03e1e3e75e0b None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:28.244272 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 413/822] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Jul 5 20:36:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:28.248155 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d4cc5-9476-49f9-9565-03e1e3e75e0b None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:28.264208 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263baeb8-12a4-4677-a406-c41f5462f48c None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:28.322837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187f3c6-1186-4259-b2c0-75f99844e3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:28.323671 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187f3c6-1186-4259-b2c0-75f99844e3dd None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:28.323953 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187f3c6-1186-4259-b2c0-75f99844e3dd None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:28.324406 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187f3c6-1186-4259-b2c0-75f99844e3dd None admin] PATH_INFO: `/v3/users/nova` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:28.334480 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2187f3c6-1186-4259-b2c0-75f99844e3dd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:28.335971 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2187f3c6-1186-4259-b2c0-75f99844e3dd None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:28.351796 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-2187f3c6-1186-4259-b2c0-75f99844e3dd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 20:36:28.351796 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:28.351796 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:28.351796 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:28.351796 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:28.351796 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:28.351796 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:28.351796 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:28.351796 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:28.351796 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:28.351796 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:28.351796 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:28.351796 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:36:28.351796 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:36:28.351796 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:36:28.351796 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:36:28.352783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:28.352783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:28.352783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:36:28.352783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:28.352783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:36:28.352783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:28.352783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:28.352783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:28.352783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:28.352783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:28.352783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:28.352783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:28.352783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:28.352783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:28.352783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:28.352783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:28.352783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:28.352783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:28.354083 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:28.354083 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:28.354083 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:36:28.354083 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:36:28.354083 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:36:28.354083 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:36:28.354083 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:36:28.354083 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:36:28.354083 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 20:36:28.354083 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:28.354083 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 410/823] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Jul 5 20:36:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:28.362656 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187f3c6-1186-4259-b2c0-75f99844e3dd None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:28.394047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d4cc5-9476-49f9-9565-03e1e3e75e0b None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:28.466245 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:28.485531 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187f3c6-1186-4259-b2c0-75f99844e3dd None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:28.518591 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72b639-960f-4098-811f-2cb7777de68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:28.519291 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72b639-960f-4098-811f-2cb7777de68d None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:28.519575 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72b639-960f-4098-811f-2cb7777de68d None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:28.519847 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72b639-960f-4098-811f-2cb7777de68d None admin] PATH_INFO: `/v3/services` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:28.520573 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72b639-960f-4098-811f-2cb7777de68d None admin] RBAC: Adding query filter params (type=network) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:28.520881 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72b639-960f-4098-811f-2cb7777de68d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:28.521587 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339fc026-847e-4250-8fb2-4d94efdb4cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:28.522298 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fc026-847e-4250-8fb2-4d94efdb4cae None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:28.522408 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72b639-960f-4098-811f-2cb7777de68d None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:28.522582 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fc026-847e-4250-8fb2-4d94efdb4cae None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:28.522916 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fc026-847e-4250-8fb2-4d94efdb4cae None admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:28.524029 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339fc026-847e-4250-8fb2-4d94efdb4cae None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:28.524347 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339fc026-847e-4250-8fb2-4d94efdb4cae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:28.525824 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339fc026-847e-4250-8fb2-4d94efdb4cae None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:28.544278 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 414/824] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Jul 5 20:36:28 2022] GET /identity/v3/services?type=network => generated 350 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:28.544951 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 411/825] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Jul 5 20:36:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:28.549435 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72b639-960f-4098-811f-2cb7777de68d None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:28.551229 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339fc026-847e-4250-8fb2-4d94efdb4cae None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:28.574321 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:28.681431 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339fc026-847e-4250-8fb2-4d94efdb4cae None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:28.735324 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72b639-960f-4098-811f-2cb7777de68d None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:28.758289 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d29f1-516c-4b7f-bd26-a2e48d82eba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:28.758944 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d29f1-516c-4b7f-bd26-a2e48d82eba9 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:28.759220 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d29f1-516c-4b7f-bd26-a2e48d82eba9 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:28.759492 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d29f1-516c-4b7f-bd26-a2e48d82eba9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:28.784876 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:28.797124 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a32752-0667-4f35-8dc0-d6f2be348929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:28.797787 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a32752-0667-4f35-8dc0-d6f2be348929 None admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:28.798093 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a32752-0667-4f35-8dc0-d6f2be348929 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:28.798363 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a32752-0667-4f35-8dc0-d6f2be348929 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:28.799097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a32752-0667-4f35-8dc0-d6f2be348929 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:28.800830 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a32752-0667-4f35-8dc0-d6f2be348929 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:28.833561 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 415/826] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Jul 5 20:36:28 2022] POST /identity/v3/endpoints => generated 327 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:36:28.863043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d29f1-516c-4b7f-bd26-a2e48d82eba9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:28.864542 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d29f1-516c-4b7f-bd26-a2e48d82eba9 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:28.974445 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 412/827] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:36:28 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 05 20:36:28.976729 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a32752-0667-4f35-8dc0-d6f2be348929 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:29.071107 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:29.133093 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a32752-0667-4f35-8dc0-d6f2be348929 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:29.184437 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd88f92-7df9-43b3-99ee-733619ee9308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:29.185156 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd88f92-7df9-43b3-99ee-733619ee9308 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:29.185437 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd88f92-7df9-43b3-99ee-733619ee9308 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:29.185714 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd88f92-7df9-43b3-99ee-733619ee9308 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:29.195983 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd88f92-7df9-43b3-99ee-733619ee9308 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:29.197443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd88f92-7df9-43b3-99ee-733619ee9308 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:29.217892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-8dd88f92-7df9-43b3-99ee-733619ee9308 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:29.217892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:29.217892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:29.217892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:29.217892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:29.217892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:29.217892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:29.217892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:29.217892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:29.217892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:29.217892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:29.217892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:29.217892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:29.217892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:29.217892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:29.218832 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:29.218832 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:29.218832 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:29.218832 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:29.218832 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:29.218832 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:29.218832 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:29.218832 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:29.218832 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:29.218832 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:29.218832 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:29.218832 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:29.218832 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:29.218832 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:29.218832 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:29.218832 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:29.218832 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:29.219733 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:29.219733 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:29.219733 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:29.219733 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:29.223555 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 416/828] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:29.225184 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d29f1-516c-4b7f-bd26-a2e48d82eba9 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:29.276030 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:29.335932 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d29f1-516c-4b7f-bd26-a2e48d82eba9 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:29.374228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad8f62-4dd5-41dd-940d-893bac09c163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:29.374895 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad8f62-4dd5-41dd-940d-893bac09c163 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:29.375172 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad8f62-4dd5-41dd-940d-893bac09c163 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:29.375439 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad8f62-4dd5-41dd-940d-893bac09c163 None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:29.376157 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad8f62-4dd5-41dd-940d-893bac09c163 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:29.376457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad8f62-4dd5-41dd-940d-893bac09c163 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:29.377834 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad8f62-4dd5-41dd-940d-893bac09c163 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:29.395723 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 413/829] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:29.397062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd88f92-7df9-43b3-99ee-733619ee9308 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:29.495166 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd88f92-7df9-43b3-99ee-733619ee9308 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:29.519931 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:29.536520 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01609899-622e-4804-8b7d-e5958a6390a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:29.537387 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01609899-622e-4804-8b7d-e5958a6390a7 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:29.537669 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01609899-622e-4804-8b7d-e5958a6390a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:29.538020 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01609899-622e-4804-8b7d-e5958a6390a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:29.545349 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01609899-622e-4804-8b7d-e5958a6390a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:29.546831 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01609899-622e-4804-8b7d-e5958a6390a7 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:29.561676 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-01609899-622e-4804-8b7d-e5958a6390a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:29.561676 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:29.561676 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:29.561676 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:29.561676 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:29.561676 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:29.561676 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:29.561676 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:29.561676 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:29.561676 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:29.561676 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:29.561676 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:29.561676 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:36:29.561676 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:36:29.561676 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:36:29.562667 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:36:29.562667 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:29.562667 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:29.562667 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:29.562667 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:29.562667 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:29.562667 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:29.562667 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:29.562667 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:29.562667 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:29.562667 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:29.562667 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:29.562667 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:29.562667 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:29.562667 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:29.562667 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:29.562667 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:29.563639 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:36:29.563639 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:36:29.563639 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:36:29.563639 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:36:29.563639 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:36:29.563639 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:36:29.563639 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:29.563639 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:29.563639 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 417/830] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:36:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:29.569083 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad8f62-4dd5-41dd-940d-893bac09c163 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:29.668225 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad8f62-4dd5-41dd-940d-893bac09c163 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:29.670626 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:29.707834 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583ca71-2c0e-4fbb-841a-0121b452e3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:29.708754 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583ca71-2c0e-4fbb-841a-0121b452e3a9 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:29.709174 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583ca71-2c0e-4fbb-841a-0121b452e3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:29.709617 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583ca71-2c0e-4fbb-841a-0121b452e3a9 None admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:29.710580 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583ca71-2c0e-4fbb-841a-0121b452e3a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:29.711030 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583ca71-2c0e-4fbb-841a-0121b452e3a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:29.712602 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583ca71-2c0e-4fbb-841a-0121b452e3a9 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:29.725128 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 414/831] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 5 20:36:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:29.734972 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01609899-622e-4804-8b7d-e5958a6390a7 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:29.832638 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01609899-622e-4804-8b7d-e5958a6390a7 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:29.870294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f646539-0dfb-4386-941d-eca44501d874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:29.871349 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f646539-0dfb-4386-941d-eca44501d874 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:29.871824 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f646539-0dfb-4386-941d-eca44501d874 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:29.872314 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f646539-0dfb-4386-941d-eca44501d874 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:29.873370 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f646539-0dfb-4386-941d-eca44501d874 None admin] RBAC: Adding query filter params (role.id=37ba4a62052348d4811b560c19a07e02, scope.project.id=b321588ec1f14bcb94a184310cf72856, user.id=814b675b98b844a2a12a39890ee69d2b) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:29.873891 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f646539-0dfb-4386-941d-eca44501d874 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:29.875720 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f646539-0dfb-4386-941d-eca44501d874 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:29.882577 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 418/832] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:36:29 2022] GET /identity/v3/role_assignments?user.id=814b675b98b844a2a12a39890ee69d2b&scope.project.id=b321588ec1f14bcb94a184310cf72856&role.id=37ba4a62052348d4811b560c19a07e02 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:30.002277 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5096b8-911e-429b-8c80-d0ef38914692 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:30.002473 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5096b8-911e-429b-8c80-d0ef38914692 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:30.002741 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5096b8-911e-429b-8c80-d0ef38914692 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:30.004446 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 415/833] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:30.010208 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1075d-0c87-4a6a-ae30-f5d13f07b847 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:30.010524 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1075d-0c87-4a6a-ae30-f5d13f07b847 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:30.010774 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1075d-0c87-4a6a-ae30-f5d13f07b847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:30.028792 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-45e1075d-0c87-4a6a-ae30-f5d13f07b847 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:30.030046 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-45e1075d-0c87-4a6a-ae30-f5d13f07b847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:30.064694 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:30.106399 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 419/834] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:36:30.128182 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5096b8-911e-429b-8c80-d0ef38914692 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:30.192472 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936f950-10dd-4722-9078-ba27e1e6b582 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:30.192773 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936f950-10dd-4722-9078-ba27e1e6b582 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:30.193040 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936f950-10dd-4722-9078-ba27e1e6b582 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:30.195604 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 420/835] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:36:30.199612 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb3037-70ce-44ce-a8d6-c506187a0831 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:30.199899 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb3037-70ce-44ce-a8d6-c506187a0831 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:30.200162 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb3037-70ce-44ce-a8d6-c506187a0831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:30.219255 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-c7eb3037-70ce-44ce-a8d6-c506187a0831 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:30.220700 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-c7eb3037-70ce-44ce-a8d6-c506187a0831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:30.238699 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5096b8-911e-429b-8c80-d0ef38914692 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:30.278226 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cee39b-f2d8-4403-b6ac-980433374396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:30.279340 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cee39b-f2d8-4403-b6ac-980433374396 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:30.279794 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cee39b-f2d8-4403-b6ac-980433374396 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:30.280256 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cee39b-f2d8-4403-b6ac-980433374396 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:30.281113 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cee39b-f2d8-4403-b6ac-980433374396 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:30.282730 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cee39b-f2d8-4403-b6ac-980433374396 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:30.295435 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-a3cee39b-f2d8-4403-b6ac-980433374396 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 20:36:30.295435 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:30.295435 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:36:30.295435 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:36:30.295435 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:36:30.295435 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:36:30.295435 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:36:30.295435 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:30.295435 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 20:36:30.295435 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:30.295435 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:36:30.295435 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:30.295435 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:30.295435 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:30.295435 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:30.295435 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:30.295435 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:30.296450 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:30.296450 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:30.296450 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:30.296450 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:30.296450 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:30.296450 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:30.296450 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:36:30.296450 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:36:30.296450 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:36:30.296450 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:36:30.296450 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:30.296450 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:30.296450 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:30.296450 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:30.296450 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:30.296450 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:30.297319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:30.297319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:30.297319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:30.297319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:30.297319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:30.297319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:30.297319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:30.297319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:30.297319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:30.297319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:30.297319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:36:30.297319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:30.297319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 20:36:30.297319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:30.299309 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 416/836] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 5 20:36:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:30.304624 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 421/837] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:36:30.306960 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cee39b-f2d8-4403-b6ac-980433374396 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:30.327885 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb3037-70ce-44ce-a8d6-c506187a0831 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:30.342292 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:30.418326 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cee39b-f2d8-4403-b6ac-980433374396 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:30.438255 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:30.447328 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb3037-70ce-44ce-a8d6-c506187a0831 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:30.468913 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adbf3fb-f80d-4bec-9931-9e8fb6d51254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:30.470410 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbf3fb-f80d-4bec-9931-9e8fb6d51254 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:30.471164 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbf3fb-f80d-4bec-9931-9e8fb6d51254 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:30.471638 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbf3fb-f80d-4bec-9931-9e8fb6d51254 None admin] PATH_INFO: `/v3/services` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:30.472715 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adbf3fb-f80d-4bec-9931-9e8fb6d51254 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:30.473562 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adbf3fb-f80d-4bec-9931-9e8fb6d51254 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:30.475519 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adbf3fb-f80d-4bec-9931-9e8fb6d51254 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:30.480753 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 417/838] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 5 20:36:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:36:30.482578 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca984e9-de93-4008-87eb-83b9780af760 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:30.483092 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca984e9-de93-4008-87eb-83b9780af760 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:30.483729 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca984e9-de93-4008-87eb-83b9780af760 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:30.484836 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5dcd2-486c-4444-b0c5-e5551b7f4d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:30.485447 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 418/839] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:30.486167 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5dcd2-486c-4444-b0c5-e5551b7f4d4b None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:30.486509 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca984e9-de93-4008-87eb-83b9780af760 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:30.486614 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5dcd2-486c-4444-b0c5-e5551b7f4d4b None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:30.487052 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5dcd2-486c-4444-b0c5-e5551b7f4d4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:30.498033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5dcd2-486c-4444-b0c5-e5551b7f4d4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:36:30.505663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-b5f5dcd2-486c-4444-b0c5-e5551b7f4d4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:36:30.505663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:30.505663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:30.505663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:30.505663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:30.505663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:30.505663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:30.505663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:30.505663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:30.505663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:30.505663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:30.505663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:30.505663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:36:30.505663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:36:30.505663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:36:30.505663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:36:30.506713 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:36:30.506713 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:36:30.506713 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:36:30.506713 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:36:30.506713 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:30.506713 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:30.506713 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:30.506713 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:30.506713 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:30.506713 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:30.506713 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:30.506713 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:30.506713 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:30.506713 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:30.506713 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:30.506713 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:30.507542 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:30.507542 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:30.507542 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:30.507542 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:30.507542 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:36:30.507542 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:36:30.507542 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:36:30.507542 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:36:30.507542 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:36:30.507542 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:36:30.507542 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:36:30.507542 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:30.507542 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 422/840] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 5 20:36:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:36:30.508234 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee117b3f-a19e-4bad-ae4d-7d57d1ff47f8 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:30.509005 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee117b3f-a19e-4bad-ae4d-7d57d1ff47f8 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:30.509343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee117b3f-a19e-4bad-ae4d-7d57d1ff47f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:30.527817 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-ee117b3f-a19e-4bad-ae4d-7d57d1ff47f8 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:30.529345 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-ee117b3f-a19e-4bad-ae4d-7d57d1ff47f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:30.592334 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:30.600553 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 423/841] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:36:30.602718 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee117b3f-a19e-4bad-ae4d-7d57d1ff47f8 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:30.602829 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca984e9-de93-4008-87eb-83b9780af760 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:30.638499 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28982bdd-ef8a-41fc-a793-eb9d7e7677b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:30.639251 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28982bdd-ef8a-41fc-a793-eb9d7e7677b0 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:30.639454 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28982bdd-ef8a-41fc-a793-eb9d7e7677b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:30.639729 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28982bdd-ef8a-41fc-a793-eb9d7e7677b0 None admin] PATH_INFO: `/v3/services` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:30.640445 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28982bdd-ef8a-41fc-a793-eb9d7e7677b0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:30.640749 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28982bdd-ef8a-41fc-a793-eb9d7e7677b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:30.642157 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28982bdd-ef8a-41fc-a793-eb9d7e7677b0 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:30.646595 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 419/842] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 5 20:36:30 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:30.647368 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28982bdd-ef8a-41fc-a793-eb9d7e7677b0 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:30.718126 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:30.740117 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee117b3f-a19e-4bad-ae4d-7d57d1ff47f8 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:30.786583 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28982bdd-ef8a-41fc-a793-eb9d7e7677b0 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:30.787010 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1604de5-d075-49b0-855b-7acf7c4dfdcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:30.787768 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1604de5-d075-49b0-855b-7acf7c4dfdcc None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:30.788116 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1604de5-d075-49b0-855b-7acf7c4dfdcc None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:30.788456 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1604de5-d075-49b0-855b-7acf7c4dfdcc None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:30.789289 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1604de5-d075-49b0-855b-7acf7c4dfdcc None admin] RBAC: Adding query filter params (name=admin) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:30.789663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1604de5-d075-49b0-855b-7acf7c4dfdcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:30.791215 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1604de5-d075-49b0-855b-7acf7c4dfdcc None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:30.810962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 424/843] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:36:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:30.812133 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1604de5-d075-49b0-855b-7acf7c4dfdcc None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:30.843551 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e97e4-f26e-443f-a125-7eefb545c6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:30.844375 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e97e4-f26e-443f-a125-7eefb545c6f0 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:30.844658 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e97e4-f26e-443f-a125-7eefb545c6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:30.844935 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e97e4-f26e-443f-a125-7eefb545c6f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:30.861583 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e97e4-f26e-443f-a125-7eefb545c6f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:36:30.872163 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-231e97e4-f26e-443f-a125-7eefb545c6f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:36:30.872163 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:30.872163 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:30.872163 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:30.872163 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:30.872163 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:30.872163 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:30.872163 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:30.872163 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:30.872163 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:30.872163 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:30.872163 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:30.872163 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:36:30.872163 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:36:30.872163 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:36:30.872163 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:36:30.873211 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:36:30.873211 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:36:30.873211 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:36:30.873211 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:36:30.873211 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:30.873211 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:30.873211 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:30.873211 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:30.873211 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:30.873211 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:30.873211 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:30.873211 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:30.873211 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:30.873211 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:30.873211 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:30.873211 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:30.874119 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:30.874119 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:30.874119 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:30.874119 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:30.874119 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:36:30.874119 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:36:30.874119 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:36:30.874119 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:36:30.874119 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:36:30.874119 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:36:30.874119 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:36:30.874119 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:30.875602 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 420/844] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 5 20:36:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:30.886800 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e97e4-f26e-443f-a125-7eefb545c6f0 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:30.910598 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:30.943889 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1604de5-d075-49b0-855b-7acf7c4dfdcc None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:30.984685 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11a958-6514-4e7a-928d-87bd4a7a60bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:30.985495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11a958-6514-4e7a-928d-87bd4a7a60bc None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:30.985775 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11a958-6514-4e7a-928d-87bd4a7a60bc None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:30.986074 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11a958-6514-4e7a-928d-87bd4a7a60bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:30.997510 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee11a958-6514-4e7a-928d-87bd4a7a60bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:30.998989 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee11a958-6514-4e7a-928d-87bd4a7a60bc None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:31.016543 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-ee11a958-6514-4e7a-928d-87bd4a7a60bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:31.016543 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:31.016543 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:31.016543 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:31.016543 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:31.016543 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:31.016543 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:31.016543 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:31.016543 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:31.016543 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:31.016543 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:31.016543 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:31.016543 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:31.016543 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:31.016543 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:31.017499 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:31.017499 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:31.017499 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:31.017499 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:31.017499 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:31.017499 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:31.017499 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:31.017499 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:31.017499 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:31.017499 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:31.017499 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:31.017499 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:31.017499 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:31.017499 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:31.017499 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:31.017499 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:31.017499 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:31.018995 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:31.018995 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:31.018995 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:31.018995 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:31.018995 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 425/845] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:31.021040 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e97e4-f26e-443f-a125-7eefb545c6f0 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:31.025761 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11a958-6514-4e7a-928d-87bd4a7a60bc None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:31.028705 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:31.064077 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e85330-c33d-49ad-b082-1157a25f85dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:31.064665 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e85330-c33d-49ad-b082-1157a25f85dc None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:31.064944 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e85330-c33d-49ad-b082-1157a25f85dc None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:31.065220 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e85330-c33d-49ad-b082-1157a25f85dc None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:31.066175 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e85330-c33d-49ad-b082-1157a25f85dc None admin] RBAC: Adding query filter params (name=service) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:31.066488 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e85330-c33d-49ad-b082-1157a25f85dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:31.068865 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e85330-c33d-49ad-b082-1157a25f85dc None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:31.081942 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 421/846] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 5 20:36:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:31.086111 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e85330-c33d-49ad-b082-1157a25f85dc None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:31.159845 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11a958-6514-4e7a-928d-87bd4a7a60bc None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:31.181664 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:31.205169 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e85330-c33d-49ad-b082-1157a25f85dc None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:31.205546 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a6888-224a-4bb5-a224-3cb8ba06ce1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:31.206254 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a6888-224a-4bb5-a224-3cb8ba06ce1c None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:31.206540 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a6888-224a-4bb5-a224-3cb8ba06ce1c None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:31.206989 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a6888-224a-4bb5-a224-3cb8ba06ce1c None admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:31.208539 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a6888-224a-4bb5-a224-3cb8ba06ce1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:31.208854 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a6888-224a-4bb5-a224-3cb8ba06ce1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:31.210274 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a6888-224a-4bb5-a224-3cb8ba06ce1c None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:31.225609 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 426/847] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:31.231359 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a6888-224a-4bb5-a224-3cb8ba06ce1c None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:31.240652 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d98f59d-f6fe-49f0-9b74-a9238168f864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:31.241463 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98f59d-f6fe-49f0-9b74-a9238168f864 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:31.241740 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98f59d-f6fe-49f0-9b74-a9238168f864 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:31.242036 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98f59d-f6fe-49f0-9b74-a9238168f864 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:31.253384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d98f59d-f6fe-49f0-9b74-a9238168f864 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:31.254963 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d98f59d-f6fe-49f0-9b74-a9238168f864 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:31.272324 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-0d98f59d-f6fe-49f0-9b74-a9238168f864 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:31.272324 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:31.272324 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:31.272324 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:31.272324 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:31.272324 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:31.272324 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:31.272324 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:31.272324 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:31.272324 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:31.272324 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:31.272324 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:31.272324 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:31.272324 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:31.272324 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:31.273199 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:31.273199 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:31.273199 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:31.273199 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:31.273199 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:31.273199 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:31.273199 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:31.273199 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:31.273199 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:31.273199 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:31.273199 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:31.273199 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:31.273199 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:31.273199 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:31.273199 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:31.273199 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:31.273199 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:31.274151 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:31.274151 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:31.274151 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:31.274151 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:31.278665 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 422/848] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:36:31.280608 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d98f59d-f6fe-49f0-9b74-a9238168f864 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:31.312161 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:31.365962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a6888-224a-4bb5-a224-3cb8ba06ce1c None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:31.393476 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d98f59d-f6fe-49f0-9b74-a9238168f864 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:31.413027 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab8bac-8b3f-4079-927f-e8feb62c1809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:31.413858 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab8bac-8b3f-4079-927f-e8feb62c1809 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:31.414143 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab8bac-8b3f-4079-927f-e8feb62c1809 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:31.414442 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab8bac-8b3f-4079-927f-e8feb62c1809 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:31.423824 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:31.427296 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab8bac-8b3f-4079-927f-e8feb62c1809 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:31.430086 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab8bac-8b3f-4079-927f-e8feb62c1809 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:31.431059 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057dd263-1c62-40ba-a96a-601a2c4b8cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:31.431738 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057dd263-1c62-40ba-a96a-601a2c4b8cfa None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:31.432020 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057dd263-1c62-40ba-a96a-601a2c4b8cfa None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:31.432294 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057dd263-1c62-40ba-a96a-601a2c4b8cfa None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:31.433028 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057dd263-1c62-40ba-a96a-601a2c4b8cfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:31.433331 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057dd263-1c62-40ba-a96a-601a2c4b8cfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:31.434769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057dd263-1c62-40ba-a96a-601a2c4b8cfa None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:31.448016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-e2ab8bac-8b3f-4079-927f-e8feb62c1809 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 05 20:36:31.448016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:31.448016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:31.448016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:31.448016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:31.448016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:31.448016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:31.448016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:31.448016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:31.448016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:31.448016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:31.448016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:31.448016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:36:31.448016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:36:31.448016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:36:31.448016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:36:31.450022 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:31.450022 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:31.450022 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:36:31.450022 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:31.450022 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:36:31.450022 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:31.450022 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:31.450022 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:31.450022 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:31.450022 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:31.450022 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:31.450022 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:31.450022 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:31.450022 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:31.450022 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:31.450022 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:31.450022 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:31.450022 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:31.451005 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:31.451005 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:31.451005 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:36:31.451005 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:36:31.451005 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:36:31.451005 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:36:31.451005 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:36:31.451005 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:36:31.451005 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 05 20:36:31.451005 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:31.451005 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 427/850] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 5 20:36:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:31.455737 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 423/850] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:31.455924 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab8bac-8b3f-4079-927f-e8feb62c1809 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:31.456064 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057dd263-1c62-40ba-a96a-601a2c4b8cfa None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:31.563581 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab8bac-8b3f-4079-927f-e8feb62c1809 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:31.591493 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:31.593565 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057dd263-1c62-40ba-a96a-601a2c4b8cfa None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:31.605644 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ab96d-5c77-42d1-a340-78b397be4bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:31.606588 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ab96d-5c77-42d1-a340-78b397be4bc2 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:31.607265 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ab96d-5c77-42d1-a340-78b397be4bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:31.607626 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ab96d-5c77-42d1-a340-78b397be4bc2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:31.617115 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ab96d-5c77-42d1-a340-78b397be4bc2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:31.618628 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ab96d-5c77-42d1-a340-78b397be4bc2 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:31.635944 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a00dd1-9fbb-4240-aa6e-d38bb8875ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:31.636977 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a00dd1-9fbb-4240-aa6e-d38bb8875ac5 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:31.637258 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-795ab96d-5c77-42d1-a340-78b397be4bc2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 20:36:31.637258 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:31.637258 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:31.637258 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:31.637258 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:31.637258 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:31.637258 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:31.637258 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:31.637258 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:31.637258 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:31.637258 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:31.637258 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:31.637258 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:36:31.637258 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:36:31.637258 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:36:31.637258 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:36:31.638340 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:31.638340 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:31.638340 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:36:31.638340 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:31.638340 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:36:31.638340 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:31.638340 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:31.638340 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:31.638340 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:31.638340 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:31.638340 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:31.638340 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:31.638340 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:31.638340 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:31.638340 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:31.638340 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:31.638340 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:31.638340 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:31.639287 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:31.639287 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:31.639287 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:36:31.639287 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:36:31.639287 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:36:31.639287 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:36:31.639287 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:36:31.639287 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:36:31.639287 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 20:36:31.639287 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:31.640572 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a00dd1-9fbb-4240-aa6e-d38bb8875ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:31.641058 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a00dd1-9fbb-4240-aa6e-d38bb8875ac5 None admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:31.642181 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a00dd1-9fbb-4240-aa6e-d38bb8875ac5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:31.642691 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a00dd1-9fbb-4240-aa6e-d38bb8875ac5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:31.643358 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 428/851] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Jul 5 20:36:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:31.644605 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ab96d-5c77-42d1-a340-78b397be4bc2 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:31.644919 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a00dd1-9fbb-4240-aa6e-d38bb8875ac5 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:31.675556 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 424/852] 10.222.0.27 () {56 vars in 1135 bytes} [Tue Jul 5 20:36:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:31.676221 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a00dd1-9fbb-4240-aa6e-d38bb8875ac5 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:31.744001 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:31.763032 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ab96d-5c77-42d1-a340-78b397be4bc2 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:31.802557 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ba8a1-161a-4ea8-ad3c-a4dfc9854410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:31.803241 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ba8a1-161a-4ea8-ad3c-a4dfc9854410 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:31.803527 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ba8a1-161a-4ea8-ad3c-a4dfc9854410 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:31.803793 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ba8a1-161a-4ea8-ad3c-a4dfc9854410 None admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:31.804645 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ba8a1-161a-4ea8-ad3c-a4dfc9854410 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:31.804949 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ba8a1-161a-4ea8-ad3c-a4dfc9854410 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:31.806434 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ba8a1-161a-4ea8-ad3c-a4dfc9854410 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:31.819931 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a00dd1-9fbb-4240-aa6e-d38bb8875ac5 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:31.830840 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 429/853] 10.222.0.27 () {56 vars in 1149 bytes} [Tue Jul 5 20:36:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:31.836535 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ba8a1-161a-4ea8-ad3c-a4dfc9854410 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:31.864192 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c083067-e711-446d-a092-233ac6ca6d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:31.865252 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c083067-e711-446d-a092-233ac6ca6d3a None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:31.865779 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c083067-e711-446d-a092-233ac6ca6d3a None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:31.866295 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c083067-e711-446d-a092-233ac6ca6d3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:31.897000 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:31.945651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c083067-e711-446d-a092-233ac6ca6d3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:31.947603 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c083067-e711-446d-a092-233ac6ca6d3a None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:31.968299 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ba8a1-161a-4ea8-ad3c-a4dfc9854410 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:32.001415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:32.003376 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ee99e-3401-4426-953f-4c94e1e699e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:32.003971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ee99e-3401-4426-953f-4c94e1e699e3 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:32.004226 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ee99e-3401-4426-953f-4c94e1e699e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:32.004502 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ee99e-3401-4426-953f-4c94e1e699e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:32.058010 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 425/854] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:36:31 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 20:36:32.058010 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36268a-5016-4d64-88ab-6cc9e9a77124 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:32.058010 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36268a-5016-4d64-88ab-6cc9e9a77124 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:32.058010 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36268a-5016-4d64-88ab-6cc9e9a77124 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:32.058848 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 426/855] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:32.063803 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ef39f-44e0-4b06-b473-5090f3b47937 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:32.064195 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ef39f-44e0-4b06-b473-5090f3b47937 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:32.064442 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ef39f-44e0-4b06-b473-5090f3b47937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:32.079190 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ee99e-3401-4426-953f-4c94e1e699e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:32.080657 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ee99e-3401-4426-953f-4c94e1e699e3 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:32.081977 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-4a1ef39f-44e0-4b06-b473-5090f3b47937 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:32.083198 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-4a1ef39f-44e0-4b06-b473-5090f3b47937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:32.123561 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:32.157977 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 427/856] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 20:36:32.166737 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ef39f-44e0-4b06-b473-5090f3b47937 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:32.197290 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 430/857] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:36:31 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 20:36:32.197290 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ee99e-3401-4426-953f-4c94e1e699e3 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:32.254482 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:32.276767 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ef39f-44e0-4b06-b473-5090f3b47937 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:32.300807 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ee99e-3401-4426-953f-4c94e1e699e3 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:32.312937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a92cd-a8d2-4404-b8fd-44c10f33f52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:32.313747 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a92cd-a8d2-4404-b8fd-44c10f33f52b None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:32.314054 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a92cd-a8d2-4404-b8fd-44c10f33f52b None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:32.314333 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a92cd-a8d2-4404-b8fd-44c10f33f52b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:32.324497 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a92cd-a8d2-4404-b8fd-44c10f33f52b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:32.326020 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a92cd-a8d2-4404-b8fd-44c10f33f52b None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:32.336554 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de287c-4cf3-4c27-87d7-b55c00b08d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:32.337608 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de287c-4cf3-4c27-87d7-b55c00b08d79 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:32.338109 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de287c-4cf3-4c27-87d7-b55c00b08d79 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:32.338547 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de287c-4cf3-4c27-87d7-b55c00b08d79 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:32.339362 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de287c-4cf3-4c27-87d7-b55c00b08d79 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:32.340975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de287c-4cf3-4c27-87d7-b55c00b08d79 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:32.343494 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-049a92cd-a8d2-4404-b8fd-44c10f33f52b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:32.343494 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:32.343494 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:32.343494 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:32.343494 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:32.343494 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:32.343494 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:32.343494 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:32.343494 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:32.343494 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:32.343494 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:32.343494 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:32.343494 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:32.343494 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:32.343494 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:32.344357 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:32.344357 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:32.344357 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:32.344357 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:32.344357 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:32.344357 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:32.344357 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:32.344357 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:32.344357 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:32.344357 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:32.344357 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:32.344357 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:32.344357 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:32.344357 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:32.344357 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:32.344357 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:32.344357 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:32.345246 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:32.345246 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:32.345246 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:32.345246 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:32.345246 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 428/858] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:32.345788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a92cd-a8d2-4404-b8fd-44c10f33f52b None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:32.355971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-08de287c-4cf3-4c27-87d7-b55c00b08d79 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 20:36:32.355971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:32.355971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:36:32.355971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:36:32.355971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:36:32.355971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:36:32.355971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:36:32.355971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:32.355971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 20:36:32.355971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:32.355971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:36:32.355971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:32.355971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:32.355971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:32.355971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:32.355971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:32.356914 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:32.356914 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:32.356914 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:32.356914 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:32.356914 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:32.356914 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:32.356914 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:32.356914 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:36:32.356914 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:36:32.356914 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:36:32.356914 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:36:32.356914 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:32.356914 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:32.356914 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:32.356914 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:32.356914 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:32.357752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:32.357752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:32.357752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:32.357752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:32.357752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:32.357752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:32.357752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:32.357752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:32.357752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:32.357752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:32.357752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:32.357752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:36:32.357752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:32.357752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 20:36:32.357752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:32.364868 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 431/859] 10.222.0.27 () {56 vars in 1132 bytes} [Tue Jul 5 20:36:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:32.364868 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de287c-4cf3-4c27-87d7-b55c00b08d79 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:32.368633 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:32.462770 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a92cd-a8d2-4404-b8fd-44c10f33f52b None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:32.474007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de287c-4cf3-4c27-87d7-b55c00b08d79 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:32.491662 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:32.499265 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42fbbc3-69d2-45e4-b70d-48599a396f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:32.500066 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fbbc3-69d2-45e4-b70d-48599a396f64 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:32.500343 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fbbc3-69d2-45e4-b70d-48599a396f64 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:32.500612 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fbbc3-69d2-45e4-b70d-48599a396f64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:32.510776 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b099db-fc00-441e-974e-b19b560b7150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:32.511664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b099db-fc00-441e-974e-b19b560b7150 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:32.511789 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42fbbc3-69d2-45e4-b70d-48599a396f64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:32.511977 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b099db-fc00-441e-974e-b19b560b7150 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:32.512216 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b099db-fc00-441e-974e-b19b560b7150 None admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:32.512934 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b099db-fc00-441e-974e-b19b560b7150 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:32.513230 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42fbbc3-69d2-45e4-b70d-48599a396f64 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:32.513336 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b099db-fc00-441e-974e-b19b560b7150 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:32.514613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b099db-fc00-441e-974e-b19b560b7150 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:32.530894 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 432/860] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:32.530894 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b099db-fc00-441e-974e-b19b560b7150 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:32.532925 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-e42fbbc3-69d2-45e4-b70d-48599a396f64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:32.532925 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:32.532925 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:32.532925 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:32.532925 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:32.532925 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:32.532925 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:32.532925 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:32.532925 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:32.532925 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:32.532925 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:32.532925 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:32.532925 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:32.532925 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:32.532925 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:32.533814 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:32.533814 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:32.533814 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:32.533814 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:32.533814 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:32.533814 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:32.533814 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:32.533814 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:32.533814 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:32.533814 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:32.533814 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:32.533814 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:32.533814 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:32.533814 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:32.533814 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:32.533814 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:32.533814 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:32.534861 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:32.534861 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:32.534861 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:32.534861 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:32.535511 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 429/861] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:32.536217 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42fbbc3-69d2-45e4-b70d-48599a396f64 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:32.602168 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:32.640401 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42fbbc3-69d2-45e4-b70d-48599a396f64 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:32.643234 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b099db-fc00-441e-974e-b19b560b7150 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:32.676619 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da8bdc-1a5d-4f14-ab63-5269cbd6d774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:32.677435 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da8bdc-1a5d-4f14-ab63-5269cbd6d774 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:32.677717 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da8bdc-1a5d-4f14-ab63-5269cbd6d774 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:32.678026 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da8bdc-1a5d-4f14-ab63-5269cbd6d774 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:32.680413 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257face0-82f0-47e7-97b7-179801c78911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:32.681385 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257face0-82f0-47e7-97b7-179801c78911 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:32.681915 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257face0-82f0-47e7-97b7-179801c78911 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:32.682364 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257face0-82f0-47e7-97b7-179801c78911 None admin] PATH_INFO: `/v3/services` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:32.683303 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257face0-82f0-47e7-97b7-179801c78911 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:32.684052 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257face0-82f0-47e7-97b7-179801c78911 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:32.684986 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da8bdc-1a5d-4f14-ab63-5269cbd6d774 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:32.685813 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257face0-82f0-47e7-97b7-179801c78911 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:32.686472 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da8bdc-1a5d-4f14-ab63-5269cbd6d774 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:32.691294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 433/862] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Jul 5 20:36:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:32.692334 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257face0-82f0-47e7-97b7-179801c78911 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:32.704411 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-f7da8bdc-1a5d-4f14-ab63-5269cbd6d774 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:32.704411 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:32.704411 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:32.704411 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:32.704411 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:32.704411 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:32.704411 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:32.704411 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:32.704411 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:32.704411 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:32.704411 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:32.704411 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:32.704411 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:36:32.704411 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:36:32.704411 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:36:32.705330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:36:32.705330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:32.705330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:32.705330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:32.705330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:32.705330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:32.705330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:32.705330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:32.705330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:32.705330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:32.705330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:32.705330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:32.705330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:32.705330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:32.705330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:32.705330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:32.705330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:32.706253 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:36:32.706253 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:36:32.706253 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:36:32.706253 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:36:32.706253 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:36:32.706253 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:36:32.706253 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:32.706253 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:32.710131 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 430/863] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:36:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:32.711426 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da8bdc-1a5d-4f14-ab63-5269cbd6d774 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:32.756150 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:32.794970 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257face0-82f0-47e7-97b7-179801c78911 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:32.812461 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da8bdc-1a5d-4f14-ab63-5269cbd6d774 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:32.821238 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:32.829769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff93a25-4b32-4751-b4e5-5864509044e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:32.830458 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff93a25-4b32-4751-b4e5-5864509044e6 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:32.830740 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff93a25-4b32-4751-b4e5-5864509044e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:32.831014 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff93a25-4b32-4751-b4e5-5864509044e6 None admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:32.831737 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff93a25-4b32-4751-b4e5-5864509044e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:32.832041 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff93a25-4b32-4751-b4e5-5864509044e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:32.833417 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff93a25-4b32-4751-b4e5-5864509044e6 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:32.845613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 434/864] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:32.846424 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff93a25-4b32-4751-b4e5-5864509044e6 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:32.851869 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3fac6-c945-4746-b218-e048d6a0cee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:32.852623 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3fac6-c945-4746-b218-e048d6a0cee4 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:32.852902 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3fac6-c945-4746-b218-e048d6a0cee4 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:32.853173 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3fac6-c945-4746-b218-e048d6a0cee4 None admin] PATH_INFO: `/v3/services` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:32.853909 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced3fac6-c945-4746-b218-e048d6a0cee4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:32.854221 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced3fac6-c945-4746-b218-e048d6a0cee4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:32.855663 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced3fac6-c945-4746-b218-e048d6a0cee4 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:32.860252 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 431/865] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Jul 5 20:36:32 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:32.861454 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbaef83-a561-4222-87e0-5fed08f0090c None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:32.861729 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbaef83-a561-4222-87e0-5fed08f0090c None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:32.862026 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbaef83-a561-4222-87e0-5fed08f0090c None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:32.863243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 432/866] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:32.863936 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbaef83-a561-4222-87e0-5fed08f0090c None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:32.967733 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff93a25-4b32-4751-b4e5-5864509044e6 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:32.993825 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbaef83-a561-4222-87e0-5fed08f0090c None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:33.002617 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:33.008652 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc31b94-e866-4f3c-b2c6-4c00e3a0525d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:33.009354 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc31b94-e866-4f3c-b2c6-4c00e3a0525d None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:33.009596 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc31b94-e866-4f3c-b2c6-4c00e3a0525d None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:33.009813 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc31b94-e866-4f3c-b2c6-4c00e3a0525d None admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:33.010772 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc31b94-e866-4f3c-b2c6-4c00e3a0525d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:33.011092 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc31b94-e866-4f3c-b2c6-4c00e3a0525d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:33.012703 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc31b94-e866-4f3c-b2c6-4c00e3a0525d None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:33.025817 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 435/867] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 5 20:36:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:33.027096 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d545ac-436b-405e-89f4-4bf0c8767325 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:33.027449 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d545ac-436b-405e-89f4-4bf0c8767325 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:33.028238 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d545ac-436b-405e-89f4-4bf0c8767325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:33.039602 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b1579-8227-496c-955d-8039305ed000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:33.040449 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b1579-8227-496c-955d-8039305ed000 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:33.040714 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b1579-8227-496c-955d-8039305ed000 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:33.040974 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b1579-8227-496c-955d-8039305ed000 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:33.047574 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-75d545ac-436b-405e-89f4-4bf0c8767325 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:33.048255 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b1579-8227-496c-955d-8039305ed000 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:33.048752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-75d545ac-436b-405e-89f4-4bf0c8767325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:33.050069 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b1579-8227-496c-955d-8039305ed000 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:33.064017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-a93b1579-8227-496c-955d-8039305ed000 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:33.064017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:33.064017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:33.064017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:33.064017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:33.064017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:33.064017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:33.064017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:33.064017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:33.064017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:33.064017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:33.064017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:33.064017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:36:33.064017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:36:33.064017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:36:33.064940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:36:33.064940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:33.064940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:33.064940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:33.064940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:33.064940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:33.064940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:33.064940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:33.064940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:33.064940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:33.064940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:33.064940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:33.064940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:33.064940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:33.064940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:33.064940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:33.064940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:33.066805 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:36:33.066805 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:36:33.066805 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:36:33.066805 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:36:33.066805 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:36:33.066805 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:36:33.066805 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:33.066805 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:33.066805 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 433/868] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:36:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:33.066805 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b1579-8227-496c-955d-8039305ed000 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:33.102291 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:33.134031 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 436/869] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:36:33.134031 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d545ac-436b-405e-89f4-4bf0c8767325 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:33.178717 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b1579-8227-496c-955d-8039305ed000 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:33.213540 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c2610-7c95-4786-93a4-5c29b12d16cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:33.214239 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c2610-7c95-4786-93a4-5c29b12d16cc None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:33.214524 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c2610-7c95-4786-93a4-5c29b12d16cc None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:33.214856 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c2610-7c95-4786-93a4-5c29b12d16cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:33.215697 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c2610-7c95-4786-93a4-5c29b12d16cc None admin] RBAC: Adding query filter params (role.id=37ba4a62052348d4811b560c19a07e02, scope.project.id=b321588ec1f14bcb94a184310cf72856, user.id=90aa580a2e10467a93c2d79d1906bd8a) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:33.216067 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c2610-7c95-4786-93a4-5c29b12d16cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:33.217581 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c2610-7c95-4786-93a4-5c29b12d16cc None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:33.223614 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 434/870] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:36:33 2022] GET /identity/v3/role_assignments?user.id=90aa580a2e10467a93c2d79d1906bd8a&scope.project.id=b321588ec1f14bcb94a184310cf72856&role.id=37ba4a62052348d4811b560c19a07e02 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:33.224386 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c2610-7c95-4786-93a4-5c29b12d16cc None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:33.264155 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d545ac-436b-405e-89f4-4bf0c8767325 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:33.273211 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:33.313678 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a74bf36-7b60-4054-8d69-c33c503e9d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:33.314384 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74bf36-7b60-4054-8d69-c33c503e9d98 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:33.314668 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74bf36-7b60-4054-8d69-c33c503e9d98 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:33.314982 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74bf36-7b60-4054-8d69-c33c503e9d98 None admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:33.315872 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a74bf36-7b60-4054-8d69-c33c503e9d98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:33.316279 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a74bf36-7b60-4054-8d69-c33c503e9d98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:33.317951 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a74bf36-7b60-4054-8d69-c33c503e9d98 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:33.334229 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 437/871] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 5 20:36:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:33.339822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a74bf36-7b60-4054-8d69-c33c503e9d98 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:33.367992 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c2610-7c95-4786-93a4-5c29b12d16cc None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:33.392394 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:33.417429 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d5dcf-c15d-4624-82e5-186fe77c6229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:33.418178 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d5dcf-c15d-4624-82e5-186fe77c6229 None admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:33.418469 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d5dcf-c15d-4624-82e5-186fe77c6229 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:33.418731 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d5dcf-c15d-4624-82e5-186fe77c6229 None admin] PATH_INFO: `/v3/services` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:33.419475 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d5dcf-c15d-4624-82e5-186fe77c6229 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:33.421648 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d5dcf-c15d-4624-82e5-186fe77c6229 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:33.440202 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 435/872] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Jul 5 20:36:33 2022] POST /identity/v3/services => generated 251 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:36:33.469415 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a74bf36-7b60-4054-8d69-c33c503e9d98 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:33.529432 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c50268-659b-411f-8eea-c535c5d5dd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:33.530064 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c50268-659b-411f-8eea-c535c5d5dd9e None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:33.530348 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c50268-659b-411f-8eea-c535c5d5dd9e None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:33.530621 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c50268-659b-411f-8eea-c535c5d5dd9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:33.531478 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c50268-659b-411f-8eea-c535c5d5dd9e None admin] RBAC: Adding query filter params (role.id=4f5057900b094e6fb792884693177cd3, scope.project.id=b321588ec1f14bcb94a184310cf72856, user.id=c9647d15389e49e6b7c43ea1b1538a13) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:33.531797 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c50268-659b-411f-8eea-c535c5d5dd9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:33.533347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c50268-659b-411f-8eea-c535c5d5dd9e None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:33.541158 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 438/873] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:36:33 2022] GET /identity/v3/role_assignments?user.id=c9647d15389e49e6b7c43ea1b1538a13&scope.project.id=b321588ec1f14bcb94a184310cf72856&role.id=4f5057900b094e6fb792884693177cd3 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:36:34.893105 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa2cca-f808-4478-ba41-f85b34ad643f None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:34.893793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa2cca-f808-4478-ba41-f85b34ad643f None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:34.893793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa2cca-f808-4478-ba41-f85b34ad643f None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:34.895289 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 436/874] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:34.900667 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778de88e-df67-4d36-85c1-1048ac0f2c2b None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:34.901087 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778de88e-df67-4d36-85c1-1048ac0f2c2b None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:34.901320 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778de88e-df67-4d36-85c1-1048ac0f2c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:34.918966 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-778de88e-df67-4d36-85c1-1048ac0f2c2b None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:34.920171 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-778de88e-df67-4d36-85c1-1048ac0f2c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:34.991480 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 439/875] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:34 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:36:35.014357 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa2cca-f808-4478-ba41-f85b34ad643f None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:35.111777 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:35.122668 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa2cca-f808-4478-ba41-f85b34ad643f None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:35.159794 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2eb47b-1d4a-4e6f-89d8-c57df6cab831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:35.160471 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2eb47b-1d4a-4e6f-89d8-c57df6cab831 None admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:35.160749 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2eb47b-1d4a-4e6f-89d8-c57df6cab831 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:35.161016 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2eb47b-1d4a-4e6f-89d8-c57df6cab831 None admin] PATH_INFO: `/v3/services` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:35.161738 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2eb47b-1d4a-4e6f-89d8-c57df6cab831 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:35.163150 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2eb47b-1d4a-4e6f-89d8-c57df6cab831 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:35.179900 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 437/876] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Jul 5 20:36:35 2022] POST /identity/v3/services => generated 269 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:36:35.365812 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e4455-3b79-4718-916f-1aed0d553ec6 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:35.366353 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e4455-3b79-4718-916f-1aed0d553ec6 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:35.366755 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e4455-3b79-4718-916f-1aed0d553ec6 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:35.368543 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 440/877] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:35.374028 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdaf78f-6a15-47a2-a99d-c4a6dd7aaabf None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:35.374428 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdaf78f-6a15-47a2-a99d-c4a6dd7aaabf None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:35.374799 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdaf78f-6a15-47a2-a99d-c4a6dd7aaabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:35.392256 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-3cdaf78f-6a15-47a2-a99d-c4a6dd7aaabf None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:35.393504 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-3cdaf78f-6a15-47a2-a99d-c4a6dd7aaabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:35.466454 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 438/878] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:36:35.488452 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e4455-3b79-4718-916f-1aed0d553ec6 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:35.518715 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:35.529604 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f21ee-b5d8-46b9-8c73-ff2a0456b11c None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:35.529954 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f21ee-b5d8-46b9-8c73-ff2a0456b11c None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:35.530190 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f21ee-b5d8-46b9-8c73-ff2a0456b11c None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:35.531787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 439/879] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:36:35.538243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868b5f6-aeb1-4861-a9d3-add9c8aa234a None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:35.538526 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868b5f6-aeb1-4861-a9d3-add9c8aa234a None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:35.538795 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868b5f6-aeb1-4861-a9d3-add9c8aa234a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:35.556536 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-d868b5f6-aeb1-4861-a9d3-add9c8aa234a None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:35.557956 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-d868b5f6-aeb1-4861-a9d3-add9c8aa234a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:35.606632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e4455-3b79-4718-916f-1aed0d553ec6 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:35.646074 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 440/880] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 20:36:35.650036 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9bc91-c979-4379-bfab-db6c4832b6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:35.650964 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9bc91-c979-4379-bfab-db6c4832b6ea None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:35.651343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9bc91-c979-4379-bfab-db6c4832b6ea None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:35.651752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9bc91-c979-4379-bfab-db6c4832b6ea None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:35.652583 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab9bc91-c979-4379-bfab-db6c4832b6ea None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:35.654146 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab9bc91-c979-4379-bfab-db6c4832b6ea None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:35.660290 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868b5f6-aeb1-4861-a9d3-add9c8aa234a None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:35.666822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-6ab9bc91-c979-4379-bfab-db6c4832b6ea None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 20:36:35.666822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:35.666822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:36:35.666822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:36:35.666822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:36:35.666822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:36:35.666822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:36:35.666822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:35.666822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 20:36:35.666822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:35.666822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:36:35.666822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:35.666822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:35.666822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:35.666822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:35.666822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:35.666822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:35.667880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:35.667880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:35.667880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:35.667880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:35.667880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:35.667880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:35.667880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:36:35.667880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:36:35.667880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:36:35.667880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:36:35.667880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:35.667880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:35.667880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:35.667880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:35.667880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:35.667880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:35.668704 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:35.668704 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:35.668704 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:35.668704 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:35.668704 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:35.668704 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:35.668704 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:35.668704 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:35.668704 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:35.668704 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:35.668704 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:36:35.668704 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:35.668704 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 20:36:35.668704 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:35.668704 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 441/881] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Jul 5 20:36:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:35.669492 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:35.676556 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9bc91-c979-4379-bfab-db6c4832b6ea None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:35.770687 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:35.771199 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868b5f6-aeb1-4861-a9d3-add9c8aa234a None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:35.780232 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9bc91-c979-4379-bfab-db6c4832b6ea None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:35.811628 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f39879-a57e-4bff-9ea3-9988ae864cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:35.812542 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f39879-a57e-4bff-9ea3-9988ae864cb2 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:35.812826 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f39879-a57e-4bff-9ea3-9988ae864cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:35.813085 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f39879-a57e-4bff-9ea3-9988ae864cb2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:35.813781 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f39879-a57e-4bff-9ea3-9988ae864cb2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:35.815213 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f39879-a57e-4bff-9ea3-9988ae864cb2 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:35.817164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e49e8-c4dc-41ba-8aac-359aaee7c3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:35.817821 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e49e8-c4dc-41ba-8aac-359aaee7c3d9 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:35.818133 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e49e8-c4dc-41ba-8aac-359aaee7c3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:35.818406 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e49e8-c4dc-41ba-8aac-359aaee7c3d9 None admin] PATH_INFO: `/v3/services` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:35.819111 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e49e8-c4dc-41ba-8aac-359aaee7c3d9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:35.819421 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e49e8-c4dc-41ba-8aac-359aaee7c3d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:35.820787 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e49e8-c4dc-41ba-8aac-359aaee7c3d9 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:35.825502 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 442/882] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Jul 5 20:36:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:35.826720 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694190a-bcb2-4204-a074-ff00b5a1cecc None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:35.827005 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694190a-bcb2-4204-a074-ff00b5a1cecc None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:35.827278 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694190a-bcb2-4204-a074-ff00b5a1cecc None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:35.828753 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 443/883] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:35.829061 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-24f39879-a57e-4bff-9ea3-9988ae864cb2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 20:36:35.829061 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:35.829061 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:36:35.829061 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:36:35.829061 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:36:35.829061 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:36:35.829061 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:36:35.829061 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:35.829061 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 20:36:35.829061 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:35.829061 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:36:35.829061 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:35.829061 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:35.829061 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:35.829061 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:35.829061 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:35.829061 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:35.830083 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:35.830083 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:35.830083 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:35.830083 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:35.830083 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:35.830083 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:35.830083 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:36:35.830083 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:36:35.830083 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:36:35.830083 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:36:35.830083 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:35.830083 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:35.830083 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:35.830083 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:35.830083 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:35.830083 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:35.830940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:35.830940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:35.830940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:35.830940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:35.830940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:35.830940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:35.830940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:35.830940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:35.830940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:35.830940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:35.830940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:36:35.830940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:35.830940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 20:36:35.830940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:35.832668 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694190a-bcb2-4204-a074-ff00b5a1cecc None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:35.835023 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 441/884] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 5 20:36:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:36:35.836385 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0209036-ab16-4185-9ded-dced1470c88d None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:35.836667 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0209036-ab16-4185-9ded-dced1470c88d None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:35.836941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0209036-ab16-4185-9ded-dced1470c88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:35.854850 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-b0209036-ab16-4185-9ded-dced1470c88d None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:35.856131 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-b0209036-ab16-4185-9ded-dced1470c88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:35.932085 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:35.939245 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 442/885] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:36:35.944055 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694190a-bcb2-4204-a074-ff00b5a1cecc None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:35.951325 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0209036-ab16-4185-9ded-dced1470c88d None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:35.982891 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982aca63-affc-4061-898b-26933dd60472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:35.983900 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982aca63-affc-4061-898b-26933dd60472 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:35.984372 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982aca63-affc-4061-898b-26933dd60472 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:35.984729 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982aca63-affc-4061-898b-26933dd60472 None admin] PATH_INFO: `/v3/services` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:35.985438 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982aca63-affc-4061-898b-26933dd60472 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:35.985748 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982aca63-affc-4061-898b-26933dd60472 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:35.987160 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982aca63-affc-4061-898b-26933dd60472 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:35.991948 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 444/886] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Jul 5 20:36:35 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:35.992728 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982aca63-affc-4061-898b-26933dd60472 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:36.026235 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:36.077660 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0209036-ab16-4185-9ded-dced1470c88d None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:36.117813 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5fc6b1-4430-4c37-99fa-214cb01ff9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:36.118717 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fc6b1-4430-4c37-99fa-214cb01ff9ae None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:36.119095 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fc6b1-4430-4c37-99fa-214cb01ff9ae None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:36.119498 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fc6b1-4430-4c37-99fa-214cb01ff9ae None admin] PATH_INFO: `/v3/services` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:36.120321 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5fc6b1-4430-4c37-99fa-214cb01ff9ae None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:36.120721 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5fc6b1-4430-4c37-99fa-214cb01ff9ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:36.122314 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5fc6b1-4430-4c37-99fa-214cb01ff9ae None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:36.126659 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982aca63-affc-4061-898b-26933dd60472 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:36.128260 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 443/887] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 5 20:36:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:36.134501 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5fc6b1-4430-4c37-99fa-214cb01ff9ae None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:36.177582 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc081db-9dc6-4329-8811-d9f2c705d98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:36.178625 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc081db-9dc6-4329-8811-d9f2c705d98d None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:36.178996 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc081db-9dc6-4329-8811-d9f2c705d98d None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:36.179273 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc081db-9dc6-4329-8811-d9f2c705d98d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:36.195257 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc081db-9dc6-4329-8811-d9f2c705d98d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:36:36.204062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-4dc081db-9dc6-4329-8811-d9f2c705d98d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 20:36:36.204062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:36.204062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:36.204062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:36.204062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:36.204062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:36.204062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:36.204062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:36.204062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:36.204062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:36.204062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:36.204062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:36.204062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:36:36.204062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:36:36.204062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:36:36.204062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:36:36.205703 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:36:36.205703 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:36:36.205703 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:36:36.205703 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:36:36.205703 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:36.205703 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:36.205703 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:36.205703 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:36.205703 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:36.205703 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:36.205703 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:36.205703 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:36.205703 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:36.205703 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:36.205703 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:36.205703 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:36.206792 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:36.206792 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:36.206792 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:36.206792 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:36.206792 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:36:36.206792 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:36:36.206792 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:36:36.206792 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:36:36.206792 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:36:36.206792 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:36:36.206792 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 20:36:36.206792 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:36.206792 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 445/888] 10.222.0.27 () {56 vars in 1120 bytes} [Tue Jul 5 20:36:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:36.212108 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc081db-9dc6-4329-8811-d9f2c705d98d None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:36.221629 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:36.262852 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5fc6b1-4430-4c37-99fa-214cb01ff9ae None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:36.308067 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa732f4-e5f6-4d7c-be85-f63d480214e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:36.308812 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa732f4-e5f6-4d7c-be85-f63d480214e8 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:36.309094 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa732f4-e5f6-4d7c-be85-f63d480214e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:36.309367 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa732f4-e5f6-4d7c-be85-f63d480214e8 None admin] PATH_INFO: `/v3/services` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:36.310116 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa732f4-e5f6-4d7c-be85-f63d480214e8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:36.310425 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa732f4-e5f6-4d7c-be85-f63d480214e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:36.312354 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa732f4-e5f6-4d7c-be85-f63d480214e8 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:36.318888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:36.320661 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 444/889] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 5 20:36:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:36.326873 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa732f4-e5f6-4d7c-be85-f63d480214e8 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:36.352024 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc081db-9dc6-4329-8811-d9f2c705d98d None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:36.388244 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5dce64-7b6d-4e63-a000-64fe89b55ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:36.388943 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5dce64-7b6d-4e63-a000-64fe89b55ca0 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:36.389219 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5dce64-7b6d-4e63-a000-64fe89b55ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:36.389490 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5dce64-7b6d-4e63-a000-64fe89b55ca0 None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:36.390376 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5dce64-7b6d-4e63-a000-64fe89b55ca0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:36.390678 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5dce64-7b6d-4e63-a000-64fe89b55ca0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:36.392052 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5dce64-7b6d-4e63-a000-64fe89b55ca0 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:36.405894 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 446/890] 10.222.0.27 () {56 vars in 1115 bytes} [Tue Jul 5 20:36:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:36:36.407001 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5dce64-7b6d-4e63-a000-64fe89b55ca0 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:36.441005 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa732f4-e5f6-4d7c-be85-f63d480214e8 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:36.472001 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:36.481634 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c5d6a-6b6e-4ed7-ab67-183f644c437a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:36.482677 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c5d6a-6b6e-4ed7-ab67-183f644c437a None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:36.483208 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c5d6a-6b6e-4ed7-ab67-183f644c437a None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:36.483698 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c5d6a-6b6e-4ed7-ab67-183f644c437a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:36.484678 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c5d6a-6b6e-4ed7-ab67-183f644c437a None admin] RBAC: Adding query filter params (interface=public, service_id=4e36510bd07a4f2da0f8ff89bba7c90c, region_id=RegionOne) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:36.485194 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c5d6a-6b6e-4ed7-ab67-183f644c437a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:36.486941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c5d6a-6b6e-4ed7-ab67-183f644c437a None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:36.497599 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 445/891] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Jul 5 20:36:36 2022] GET /identity/v3/endpoints?service_id=4e36510bd07a4f2da0f8ff89bba7c90c&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:36.499162 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c5d6a-6b6e-4ed7-ab67-183f644c437a None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:36.514008 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5dce64-7b6d-4e63-a000-64fe89b55ca0 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:36.549530 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6357eb-28d8-4b61-9927-0100220aaaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:36.550724 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6357eb-28d8-4b61-9927-0100220aaaca None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:36.551000 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6357eb-28d8-4b61-9927-0100220aaaca None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:36.551312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6357eb-28d8-4b61-9927-0100220aaaca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:36.562463 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6357eb-28d8-4b61-9927-0100220aaaca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:36.564094 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6357eb-28d8-4b61-9927-0100220aaaca None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:36.565886 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:36.582312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-3a6357eb-28d8-4b61-9927-0100220aaaca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:36.582312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:36.582312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:36.582312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:36.582312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:36.582312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:36.582312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:36.582312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:36.582312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:36.582312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:36.582312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:36.582312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:36.582312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:36.582312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:36.582312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:36.583256 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:36.583256 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:36.583256 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:36.583256 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:36.583256 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:36.583256 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:36.583256 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:36.583256 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:36.583256 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:36.583256 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:36.583256 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:36.583256 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:36.583256 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:36.583256 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:36.583256 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:36.583256 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:36.583256 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:36.584136 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:36.584136 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:36.584136 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:36.584136 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:36.588227 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 447/892] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:36:36.589337 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6357eb-28d8-4b61-9927-0100220aaaca None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:36.612533 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c5d6a-6b6e-4ed7-ab67-183f644c437a None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:36.648199 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b021a05-dc92-4c8e-b07d-2d6bd34a8a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:36.649195 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b021a05-dc92-4c8e-b07d-2d6bd34a8a1d None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:36.649757 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b021a05-dc92-4c8e-b07d-2d6bd34a8a1d None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:36.650363 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b021a05-dc92-4c8e-b07d-2d6bd34a8a1d None admin] PATH_INFO: `/v3/services` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:36.651238 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b021a05-dc92-4c8e-b07d-2d6bd34a8a1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:36.652960 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b021a05-dc92-4c8e-b07d-2d6bd34a8a1d None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:36.664381 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 446/893] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Jul 5 20:36:36 2022] GET /identity/v3/services => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:36:36.696163 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6357eb-28d8-4b61-9927-0100220aaaca None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:36.734133 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcdf347-becc-4819-8cd4-7217b2c80363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:36.734791 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcdf347-becc-4819-8cd4-7217b2c80363 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:36.735074 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcdf347-becc-4819-8cd4-7217b2c80363 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:36.735344 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcdf347-becc-4819-8cd4-7217b2c80363 None admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:36.736080 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcdf347-becc-4819-8cd4-7217b2c80363 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:36.736380 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcdf347-becc-4819-8cd4-7217b2c80363 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:36.737801 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcdf347-becc-4819-8cd4-7217b2c80363 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:36.751776 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 448/894] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:36.757563 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b021a05-dc92-4c8e-b07d-2d6bd34a8a1d None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:36.821045 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:36.867714 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b021a05-dc92-4c8e-b07d-2d6bd34a8a1d None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:36.902034 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e68df-ae26-431b-86fe-77a8cfc4b619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:36.902895 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e68df-ae26-431b-86fe-77a8cfc4b619 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:36.903169 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e68df-ae26-431b-86fe-77a8cfc4b619 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:36.903439 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e68df-ae26-431b-86fe-77a8cfc4b619 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:36.911474 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e68df-ae26-431b-86fe-77a8cfc4b619 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:36.912932 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e68df-ae26-431b-86fe-77a8cfc4b619 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:36.927837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-075e68df-ae26-431b-86fe-77a8cfc4b619 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 20:36:36.927837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:36.927837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:36.927837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:36.927837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:36.927837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:36.927837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:36.927837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:36.927837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:36.927837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:36.927837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:36.927837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:36.927837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:36:36.927837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:36:36.927837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:36:36.927837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:36:36.928821 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:36.928821 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:36.928821 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:36:36.928821 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:36.928821 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:36:36.928821 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:36.928821 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:36.928821 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:36.928821 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:36.928821 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:36.928821 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:36.928821 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:36.928821 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:36.928821 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:36.928821 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:36.928821 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:36.928821 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:36.928821 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:36.929815 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:36.929815 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:36.929815 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:36:36.929815 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:36:36.929815 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:36:36.929815 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:36:36.929815 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:36:36.929815 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:36:36.929815 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 20:36:36.929815 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:36.929815 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 447/895] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Jul 5 20:36:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:36.936822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcdf347-becc-4819-8cd4-7217b2c80363 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:36.994037 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:37.047361 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcdf347-becc-4819-8cd4-7217b2c80363 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:37.083242 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d01ea-4368-489c-8591-62275367917c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:37.084313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d01ea-4368-489c-8591-62275367917c None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:37.084782 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d01ea-4368-489c-8591-62275367917c None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:37.085240 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d01ea-4368-489c-8591-62275367917c None admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:37.086294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d01ea-4368-489c-8591-62275367917c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:37.086810 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d01ea-4368-489c-8591-62275367917c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:37.088515 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d01ea-4368-489c-8591-62275367917c None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:37.107313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 449/896] 10.222.0.27 () {56 vars in 1149 bytes} [Tue Jul 5 20:36:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:37.113207 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e68df-ae26-431b-86fe-77a8cfc4b619 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:37.225584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e68df-ae26-431b-86fe-77a8cfc4b619 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:37.246111 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:37.264405 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49dc8f6-f623-4653-a7f4-08759529f452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:37.265064 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49dc8f6-f623-4653-a7f4-08759529f452 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:37.265344 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49dc8f6-f623-4653-a7f4-08759529f452 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:37.265616 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49dc8f6-f623-4653-a7f4-08759529f452 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:37.280250 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbc575-9b9e-4e4f-a363-9e9397151144 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:37.280572 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbc575-9b9e-4e4f-a363-9e9397151144 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:37.280802 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbc575-9b9e-4e4f-a363-9e9397151144 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:37.282225 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 450/897] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:36:37.289484 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59661c-b3ec-4766-b41f-b1aeb99440db None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:37.289767 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59661c-b3ec-4766-b41f-b1aeb99440db None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:37.290074 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59661c-b3ec-4766-b41f-b1aeb99440db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:37.306890 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-ba59661c-b3ec-4766-b41f-b1aeb99440db None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:37.308530 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-ba59661c-b3ec-4766-b41f-b1aeb99440db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:37.345449 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49dc8f6-f623-4653-a7f4-08759529f452 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:37.347506 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49dc8f6-f623-4653-a7f4-08759529f452 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:37.395544 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 451/898] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 20:36:37.419323 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59661c-b3ec-4766-b41f-b1aeb99440db None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:37.465088 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:37.469266 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 448/899] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:36:37 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 20:36:37.475586 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49dc8f6-f623-4653-a7f4-08759529f452 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:37.495142 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:37.541025 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59661c-b3ec-4766-b41f-b1aeb99440db None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:37.577324 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49dc8f6-f623-4653-a7f4-08759529f452 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:37.579042 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b2e31-df70-43d0-8549-add14eef2faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:37.580331 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b2e31-df70-43d0-8549-add14eef2faa None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:37.580850 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b2e31-df70-43d0-8549-add14eef2faa None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:37.581323 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b2e31-df70-43d0-8549-add14eef2faa None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:37.582222 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b2e31-df70-43d0-8549-add14eef2faa None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:37.583916 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b2e31-df70-43d0-8549-add14eef2faa None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:37.597298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-db2b2e31-df70-43d0-8549-add14eef2faa None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 20:36:37.597298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:37.597298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:36:37.597298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:36:37.597298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:36:37.597298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:36:37.597298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:36:37.597298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:37.597298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 20:36:37.597298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:37.597298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:36:37.597298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:37.597298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:37.597298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:37.597298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:37.597298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:37.598329 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:37.598329 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:37.598329 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:37.598329 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:37.598329 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:37.598329 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:37.598329 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:37.598329 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:36:37.598329 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:36:37.598329 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:36:37.598329 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:36:37.598329 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:37.598329 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:37.598329 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:37.598329 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:37.598329 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:37.599550 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:37.599550 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:37.599550 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:37.599550 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:37.599550 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:37.599550 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:37.599550 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:37.599550 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:37.599550 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:37.599550 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:37.599550 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:37.599550 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:36:37.599550 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:37.599550 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 20:36:37.599550 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:37.602766 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 452/900] 10.222.0.27 () {56 vars in 1132 bytes} [Tue Jul 5 20:36:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:36:37.608752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b2e31-df70-43d0-8549-add14eef2faa None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:37.619990 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbcdae7-8d9a-4e1a-97b1-1ab39b446366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:37.621670 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcdae7-8d9a-4e1a-97b1-1ab39b446366 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:37.622178 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcdae7-8d9a-4e1a-97b1-1ab39b446366 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:37.623015 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcdae7-8d9a-4e1a-97b1-1ab39b446366 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:37.637515 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbcdae7-8d9a-4e1a-97b1-1ab39b446366 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:37.640198 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbcdae7-8d9a-4e1a-97b1-1ab39b446366 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:37.662464 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-efbcdae7-8d9a-4e1a-97b1-1ab39b446366 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:37.662464 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:37.662464 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:37.662464 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:37.662464 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:37.662464 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:37.662464 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:37.662464 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:37.662464 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:37.662464 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:37.662464 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:37.662464 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:37.662464 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:37.662464 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:37.662464 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:37.663407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:37.663407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:37.663407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:37.663407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:37.663407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:37.663407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:37.663407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:37.663407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:37.663407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:37.663407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:37.663407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:37.663407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:37.663407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:37.663407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:37.663407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:37.663407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:37.663407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:37.664363 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:37.664363 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:37.664363 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:37.664363 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:37.664363 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 449/901] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:36:37.670528 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbcdae7-8d9a-4e1a-97b1-1ab39b446366 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:37.740021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b2e31-df70-43d0-8549-add14eef2faa None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:37.742109 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:37.749717 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:37.779079 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbcdae7-8d9a-4e1a-97b1-1ab39b446366 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:37.785374 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d116532-1355-4bd8-9bb5-f22f0bb364f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:37.786255 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d116532-1355-4bd8-9bb5-f22f0bb364f4 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:37.787102 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d116532-1355-4bd8-9bb5-f22f0bb364f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:37.787545 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d116532-1355-4bd8-9bb5-f22f0bb364f4 None admin] PATH_INFO: `/v3/services` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:37.788394 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d116532-1355-4bd8-9bb5-f22f0bb364f4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:37.789151 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d116532-1355-4bd8-9bb5-f22f0bb364f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:37.791329 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d116532-1355-4bd8-9bb5-f22f0bb364f4 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:37.797929 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 453/902] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Jul 5 20:36:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:37.804967 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d116532-1355-4bd8-9bb5-f22f0bb364f4 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:37.819202 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2cad0-5806-447a-a3f9-432d6d64731d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:37.819905 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2cad0-5806-447a-a3f9-432d6d64731d None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:37.820151 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2cad0-5806-447a-a3f9-432d6d64731d None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:37.820421 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2cad0-5806-447a-a3f9-432d6d64731d None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:37.821161 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2cad0-5806-447a-a3f9-432d6d64731d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:37.821467 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2cad0-5806-447a-a3f9-432d6d64731d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:37.822967 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2cad0-5806-447a-a3f9-432d6d64731d None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:37.837900 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 450/903] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:36:37.842780 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2cad0-5806-447a-a3f9-432d6d64731d None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:37.937002 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d116532-1355-4bd8-9bb5-f22f0bb364f4 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:37.960415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2cad0-5806-447a-a3f9-432d6d64731d None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:37.973540 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb93c3d-1f5a-47a4-afaa-2920626c85d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:37.974468 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb93c3d-1f5a-47a4-afaa-2920626c85d1 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:37.974917 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb93c3d-1f5a-47a4-afaa-2920626c85d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:37.975419 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb93c3d-1f5a-47a4-afaa-2920626c85d1 None admin] PATH_INFO: `/v3/services` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:37.976365 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb93c3d-1f5a-47a4-afaa-2920626c85d1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:37.976810 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb93c3d-1f5a-47a4-afaa-2920626c85d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:37.978417 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb93c3d-1f5a-47a4-afaa-2920626c85d1 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:37.984463 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 454/904] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Jul 5 20:36:37 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:36:37.989808 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb93c3d-1f5a-47a4-afaa-2920626c85d1 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:37.994626 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:38.003050 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec60b0d-1d7c-4770-ad92-ea532cd56897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:38.003738 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec60b0d-1d7c-4770-ad92-ea532cd56897 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:38.004020 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec60b0d-1d7c-4770-ad92-ea532cd56897 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:38.004331 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec60b0d-1d7c-4770-ad92-ea532cd56897 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:38.012147 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec60b0d-1d7c-4770-ad92-ea532cd56897 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:38.013704 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec60b0d-1d7c-4770-ad92-ea532cd56897 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:38.028607 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:38.029101 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-8ec60b0d-1d7c-4770-ad92-ea532cd56897 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:38.029101 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:38.029101 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:38.029101 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:38.029101 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:38.029101 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:38.029101 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:38.029101 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:38.029101 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:38.029101 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:38.029101 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:38.029101 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:38.029101 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:36:38.029101 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:36:38.029101 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:36:38.030158 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:36:38.030158 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:38.030158 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:38.030158 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:38.030158 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:38.030158 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:38.030158 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:38.030158 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:38.030158 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:38.030158 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:38.030158 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:38.030158 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:38.030158 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:38.030158 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:38.030158 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:38.030158 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:38.030158 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:38.031241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:36:38.031241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:36:38.031241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:36:38.031241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:36:38.031241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:36:38.031241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:36:38.031241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:38.031241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:38.034689 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 451/905] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:36:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:38.036317 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec60b0d-1d7c-4770-ad92-ea532cd56897 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:38.104394 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb93c3d-1f5a-47a4-afaa-2920626c85d1 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:38.138196 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec60b0d-1d7c-4770-ad92-ea532cd56897 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:38.147471 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc829e-1342-4ef8-91cc-d23bc3cd44db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:38.150944 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc829e-1342-4ef8-91cc-d23bc3cd44db None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:38.150944 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc829e-1342-4ef8-91cc-d23bc3cd44db None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:38.150944 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc829e-1342-4ef8-91cc-d23bc3cd44db None admin] PATH_INFO: `/v3/endpoints` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:38.150944 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc829e-1342-4ef8-91cc-d23bc3cd44db None admin] RBAC: Adding query filter params (interface=public, service_id=6bab508506144ee9975cfd8f196cf06e, region_id=RegionOne) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:38.150944 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc829e-1342-4ef8-91cc-d23bc3cd44db None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:38.151594 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc829e-1342-4ef8-91cc-d23bc3cd44db None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:38.161795 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 455/906] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Jul 5 20:36:37 2022] GET /identity/v3/endpoints?service_id=6bab508506144ee9975cfd8f196cf06e&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:36:38.161795 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69363b8a-743e-453c-a26c-ec1d483337e1 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:38.161795 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69363b8a-743e-453c-a26c-ec1d483337e1 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:38.161795 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69363b8a-743e-453c-a26c-ec1d483337e1 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:38.161795 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 456/907] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:38.163512 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69363b8a-743e-453c-a26c-ec1d483337e1 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:38.178725 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751fc22-27bc-4f10-a6cd-0983b16fe158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:38.179440 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751fc22-27bc-4f10-a6cd-0983b16fe158 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:38.179824 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751fc22-27bc-4f10-a6cd-0983b16fe158 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:38.180094 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751fc22-27bc-4f10-a6cd-0983b16fe158 None admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:38.180990 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751fc22-27bc-4f10-a6cd-0983b16fe158 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:38.181343 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751fc22-27bc-4f10-a6cd-0983b16fe158 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:38.182970 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751fc22-27bc-4f10-a6cd-0983b16fe158 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:38.197999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 452/908] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 5 20:36:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:36:38.199358 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e902f7-1031-4e6a-be0a-fba10d7224f1 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:38.199641 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e902f7-1031-4e6a-be0a-fba10d7224f1 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:38.199917 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e902f7-1031-4e6a-be0a-fba10d7224f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:38.216161 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-74e902f7-1031-4e6a-be0a-fba10d7224f1 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:38.217334 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-74e902f7-1031-4e6a-be0a-fba10d7224f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:38.264623 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:38.267688 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:38.272968 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69363b8a-743e-453c-a26c-ec1d483337e1 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:38.293389 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 453/909] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:36:38.294351 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e902f7-1031-4e6a-be0a-fba10d7224f1 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:38.312887 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bbdfeb-ee3e-4a5f-8bd6-14d84a8c8c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:38.314102 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbdfeb-ee3e-4a5f-8bd6-14d84a8c8c7f None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:38.314548 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbdfeb-ee3e-4a5f-8bd6-14d84a8c8c7f None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:38.315195 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbdfeb-ee3e-4a5f-8bd6-14d84a8c8c7f None admin] PATH_INFO: `/v3/services` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:38.316407 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bbdfeb-ee3e-4a5f-8bd6-14d84a8c8c7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:38.317959 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bbdfeb-ee3e-4a5f-8bd6-14d84a8c8c7f None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:38.327510 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 457/910] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Jul 5 20:36:38 2022] GET /identity/v3/services => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:36:38.328836 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bbdfeb-ee3e-4a5f-8bd6-14d84a8c8c7f None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:38.434799 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e902f7-1031-4e6a-be0a-fba10d7224f1 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:38.453777 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bbdfeb-ee3e-4a5f-8bd6-14d84a8c8c7f None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:38.482646 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed3ff6-603e-46fe-81bd-0c056576c6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:38.484104 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed3ff6-603e-46fe-81bd-0c056576c6cb None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:38.486196 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed3ff6-603e-46fe-81bd-0c056576c6cb None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:38.486489 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed3ff6-603e-46fe-81bd-0c056576c6cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:38.487490 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed3ff6-603e-46fe-81bd-0c056576c6cb None admin] RBAC: Adding query filter params (role.id=8d9d4dd4ce594ddb9579d0e117ad02e9, scope.project.id=b321588ec1f14bcb94a184310cf72856, user.id=c9647d15389e49e6b7c43ea1b1538a13) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:38.487801 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed3ff6-603e-46fe-81bd-0c056576c6cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:38.489482 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed3ff6-603e-46fe-81bd-0c056576c6cb None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:38.498689 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 454/911] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:36:38 2022] GET /identity/v3/role_assignments?user.id=c9647d15389e49e6b7c43ea1b1538a13&scope.project.id=b321588ec1f14bcb94a184310cf72856&role.id=8d9d4dd4ce594ddb9579d0e117ad02e9 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:38.509177 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e16ee-fa04-4d98-9027-51628d00794b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:38.510429 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e16ee-fa04-4d98-9027-51628d00794b None admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:38.510957 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e16ee-fa04-4d98-9027-51628d00794b None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:38.511459 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e16ee-fa04-4d98-9027-51628d00794b None admin] PATH_INFO: `/v3/services` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:38.512405 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e16ee-fa04-4d98-9027-51628d00794b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:38.514081 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e16ee-fa04-4d98-9027-51628d00794b None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:38.536180 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 458/912] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Jul 5 20:36:38 2022] POST /identity/v3/services => generated 241 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:36:38.781641 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e68660-d5ed-4a4c-b05d-93eb9764692c None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:38.781832 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e68660-d5ed-4a4c-b05d-93eb9764692c None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:38.782124 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e68660-d5ed-4a4c-b05d-93eb9764692c None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:38.783729 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 455/913] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:38.789137 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d40cc-4589-4e7e-bfae-d98f0dc65f97 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:38.789431 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d40cc-4589-4e7e-bfae-d98f0dc65f97 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:38.789699 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d40cc-4589-4e7e-bfae-d98f0dc65f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:38.807333 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-669d40cc-4589-4e7e-bfae-d98f0dc65f97 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:38.808677 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-669d40cc-4589-4e7e-bfae-d98f0dc65f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:38.826198 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:38.887701 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 459/914] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:36:38.911012 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e68660-d5ed-4a4c-b05d-93eb9764692c None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:38.959946 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:39.025211 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e68660-d5ed-4a4c-b05d-93eb9764692c None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:39.060216 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1fc56-ba89-4591-8d4f-b57173fd45aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:39.061003 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1fc56-ba89-4591-8d4f-b57173fd45aa None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:39.061282 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1fc56-ba89-4591-8d4f-b57173fd45aa None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:39.061561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1fc56-ba89-4591-8d4f-b57173fd45aa None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:39.062291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1fc56-ba89-4591-8d4f-b57173fd45aa None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:39.063777 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1fc56-ba89-4591-8d4f-b57173fd45aa None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:39.075763 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-44a1fc56-ba89-4591-8d4f-b57173fd45aa None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 20:36:39.075763 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:39.075763 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:36:39.075763 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:36:39.075763 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:36:39.075763 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:36:39.075763 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:36:39.075763 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:39.075763 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 20:36:39.075763 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:39.075763 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:36:39.075763 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:39.075763 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:39.075763 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:39.075763 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:39.075763 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:39.075763 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:39.076770 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:39.076770 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:39.076770 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:39.076770 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:39.076770 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:39.076770 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:39.076770 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:36:39.076770 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:36:39.076770 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:36:39.076770 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:36:39.076770 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:39.076770 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:39.076770 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:39.076770 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:39.076770 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:39.076770 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:39.077617 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:39.077617 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:39.077617 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:39.077617 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:39.077617 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:39.077617 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:39.077617 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:39.077617 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:39.077617 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:39.077617 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:39.077617 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:36:39.077617 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:39.077617 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 05 20:36:39.077617 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:39.077617 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 456/915] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 5 20:36:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:39.083563 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d40cc-4589-4e7e-bfae-d98f0dc65f97 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:39.186568 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d40cc-4589-4e7e-bfae-d98f0dc65f97 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:39.221434 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea1126-8582-4930-8f15-879d0ee52842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:39.222138 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea1126-8582-4930-8f15-879d0ee52842 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:39.222415 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea1126-8582-4930-8f15-879d0ee52842 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:39.222683 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea1126-8582-4930-8f15-879d0ee52842 None admin] PATH_INFO: `/v3/services` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:39.223391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea1126-8582-4930-8f15-879d0ee52842 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:39.223690 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea1126-8582-4930-8f15-879d0ee52842 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:39.225070 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea1126-8582-4930-8f15-879d0ee52842 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:39.230460 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 460/916] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 5 20:36:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:39.236109 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1fc56-ba89-4591-8d4f-b57173fd45aa None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:39.343130 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1fc56-ba89-4591-8d4f-b57173fd45aa None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:39.351568 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:39.379109 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95417eb-36fd-471d-89dc-d989e8ac5198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:39.379780 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95417eb-36fd-471d-89dc-d989e8ac5198 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:39.380058 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95417eb-36fd-471d-89dc-d989e8ac5198 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:39.380327 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95417eb-36fd-471d-89dc-d989e8ac5198 None admin] PATH_INFO: `/v3/services` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:39.381036 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95417eb-36fd-471d-89dc-d989e8ac5198 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:39.381336 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95417eb-36fd-471d-89dc-d989e8ac5198 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:39.382756 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95417eb-36fd-471d-89dc-d989e8ac5198 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:39.388699 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 457/917] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 5 20:36:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:39.394895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea1126-8582-4930-8f15-879d0ee52842 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:39.410543 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:39.496601 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea1126-8582-4930-8f15-879d0ee52842 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:39.531754 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece7fbe-4bfd-47fb-93bf-f040ebb834ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:39.532446 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece7fbe-4bfd-47fb-93bf-f040ebb834ed None admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:39.532724 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece7fbe-4bfd-47fb-93bf-f040ebb834ed None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:39.532993 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece7fbe-4bfd-47fb-93bf-f040ebb834ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:39.533856 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece7fbe-4bfd-47fb-93bf-f040ebb834ed None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:39.535369 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece7fbe-4bfd-47fb-93bf-f040ebb834ed None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:39.557912 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 461/918] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Jul 5 20:36:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:36:40.464841 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c6115-58f1-47ec-889d-e9e771f31e1e None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:40.465524 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c6115-58f1-47ec-889d-e9e771f31e1e None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:40.465524 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c6115-58f1-47ec-889d-e9e771f31e1e None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:40.467006 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 458/919] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:40.472203 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4c82b-e839-4e84-811f-129b3029ad7c None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:40.472675 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4c82b-e839-4e84-811f-129b3029ad7c None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:40.472850 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4c82b-e839-4e84-811f-129b3029ad7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:40.490149 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-30a4c82b-e839-4e84-811f-129b3029ad7c None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:40.491347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-30a4c82b-e839-4e84-811f-129b3029ad7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:40.555299 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:40.569361 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 462/920] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:36:40.573024 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da2c25-0501-4f82-8be8-01e437a7743f None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:40.573308 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da2c25-0501-4f82-8be8-01e437a7743f None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:40.573586 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da2c25-0501-4f82-8be8-01e437a7743f None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:40.576261 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 459/921] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:40.580501 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338cffa-1820-41e0-a424-5ff418b60d05 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:40.580793 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338cffa-1820-41e0-a424-5ff418b60d05 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:40.581066 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338cffa-1820-41e0-a424-5ff418b60d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:40.593039 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da2c25-0501-4f82-8be8-01e437a7743f None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:40.599093 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-a338cffa-1820-41e0-a424-5ff418b60d05 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:40.600268 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-a338cffa-1820-41e0-a424-5ff418b60d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:40.677833 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 463/922] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:36:40.679656 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf02a8-5d71-4ce0-9a15-a126c0600b0f None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:40.680085 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf02a8-5d71-4ce0-9a15-a126c0600b0f None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:40.680518 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf02a8-5d71-4ce0-9a15-a126c0600b0f None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:40.681778 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 464/923] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:40.687191 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc49b5-42f1-44e0-ba21-5ffac50573e3 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:40.687474 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc49b5-42f1-44e0-ba21-5ffac50573e3 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:40.687746 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc49b5-42f1-44e0-ba21-5ffac50573e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:40.702097 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da2c25-0501-4f82-8be8-01e437a7743f None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:40.705106 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-5fdc49b5-42f1-44e0-ba21-5ffac50573e3 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:40.706340 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-5fdc49b5-42f1-44e0-ba21-5ffac50573e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:40.739686 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a19e8c-730b-43c3-9bb9-fd88344c5fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:40.740451 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a19e8c-730b-43c3-9bb9-fd88344c5fbd None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:40.740699 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a19e8c-730b-43c3-9bb9-fd88344c5fbd None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:40.741025 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a19e8c-730b-43c3-9bb9-fd88344c5fbd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:40.741627 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a19e8c-730b-43c3-9bb9-fd88344c5fbd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:40.743820 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a19e8c-730b-43c3-9bb9-fd88344c5fbd None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:40.755558 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-66a19e8c-730b-43c3-9bb9-fd88344c5fbd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 20:36:40.755558 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:40.755558 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:36:40.755558 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:36:40.755558 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:36:40.755558 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:36:40.755558 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:36:40.755558 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:40.755558 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 20:36:40.755558 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:40.755558 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:36:40.755558 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:40.755558 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:40.755558 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:40.755558 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:40.755558 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:40.756503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:40.756503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:40.756503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:40.756503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:40.756503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:40.756503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:40.756503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:40.756503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:36:40.756503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:36:40.756503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:36:40.756503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:36:40.756503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:40.756503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:40.756503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:40.756503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:40.756503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:40.757342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:40.757342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:40.757342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:40.757342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:40.757342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:40.757342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:40.757342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:40.757342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:40.757342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:40.757342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:40.757342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:40.757342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:36:40.757342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:40.757342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 05 20:36:40.757342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:40.757342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 460/924] 10.222.0.27 () {56 vars in 1132 bytes} [Tue Jul 5 20:36:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:40.759163 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a19e8c-730b-43c3-9bb9-fd88344c5fbd None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:40.783523 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 465/925] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:36:40.784589 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc49b5-42f1-44e0-ba21-5ffac50573e3 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:40.797754 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:40.841597 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:40.869051 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a19e8c-730b-43c3-9bb9-fd88344c5fbd None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:40.886133 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc49b5-42f1-44e0-ba21-5ffac50573e3 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:40.904779 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbaba3c-166c-4876-ba59-6e4791b6ba8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:40.905598 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbaba3c-166c-4876-ba59-6e4791b6ba8e None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:40.905889 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbaba3c-166c-4876-ba59-6e4791b6ba8e None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:40.906438 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbaba3c-166c-4876-ba59-6e4791b6ba8e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:40.916564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbaba3c-166c-4876-ba59-6e4791b6ba8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:36:40.920616 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6de12-dd97-4550-a063-cdd3d8e76143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:40.921280 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6de12-dd97-4550-a063-cdd3d8e76143 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:40.921565 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6de12-dd97-4550-a063-cdd3d8e76143 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:40.921860 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6de12-dd97-4550-a063-cdd3d8e76143 None admin] PATH_INFO: `/v3/services` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:40.922573 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6de12-dd97-4550-a063-cdd3d8e76143 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:40.922880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6de12-dd97-4550-a063-cdd3d8e76143 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:40.924260 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6de12-dd97-4550-a063-cdd3d8e76143 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:40.925320 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-6fbaba3c-166c-4876-ba59-6e4791b6ba8e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 20:36:40.925320 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:40.925320 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:40.925320 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:40.925320 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:40.925320 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:40.925320 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:40.925320 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:40.925320 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:40.925320 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:40.925320 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:40.925320 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:40.925320 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:36:40.925320 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:36:40.925320 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:36:40.925320 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:36:40.926275 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:36:40.926275 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:36:40.926275 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:36:40.926275 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:36:40.926275 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:40.926275 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:40.926275 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:40.926275 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:40.926275 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:40.926275 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:40.926275 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:40.926275 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:40.926275 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:40.926275 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:40.926275 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:40.926275 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:40.927176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:40.927176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:40.927176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:40.927176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:40.927176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:36:40.927176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:36:40.927176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:36:40.927176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:36:40.927176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:36:40.927176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:36:40.927176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 20:36:40.927176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:40.927176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 461/926] 10.222.0.27 () {56 vars in 1120 bytes} [Tue Jul 5 20:36:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:40.928569 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbaba3c-166c-4876-ba59-6e4791b6ba8e None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:40.934233 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 466/927] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Jul 5 20:36:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:40.935419 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6de12-dd97-4550-a063-cdd3d8e76143 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:41.021185 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:41.028328 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbaba3c-166c-4876-ba59-6e4791b6ba8e None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:41.040258 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6de12-dd97-4550-a063-cdd3d8e76143 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:41.061065 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:41.067114 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8bb70-c066-4410-8e55-931fce750d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:41.067971 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8bb70-c066-4410-8e55-931fce750d64 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:41.068214 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8bb70-c066-4410-8e55-931fce750d64 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:41.068481 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8bb70-c066-4410-8e55-931fce750d64 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:41.069436 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b8bb70-c066-4410-8e55-931fce750d64 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:41.070861 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b8bb70-c066-4410-8e55-931fce750d64 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:41.080705 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957eb1e7-a931-49a4-a0cd-9bac3fc41f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:41.081616 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957eb1e7-a931-49a4-a0cd-9bac3fc41f6c None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:41.082092 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957eb1e7-a931-49a4-a0cd-9bac3fc41f6c None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:41.082532 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957eb1e7-a931-49a4-a0cd-9bac3fc41f6c None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:41.083266 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-80b8bb70-c066-4410-8e55-931fce750d64 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 20:36:41.083266 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:41.083266 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:36:41.083266 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:36:41.083266 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:36:41.083266 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:36:41.083266 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:36:41.083266 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:41.083266 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 20:36:41.083266 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:41.083266 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:36:41.083266 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:41.083266 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:41.083266 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:41.083266 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:41.083266 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:41.083266 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:41.084227 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:41.084227 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:41.084227 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:41.084227 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:41.084227 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:41.084227 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:41.084227 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:36:41.084227 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:36:41.084227 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:36:41.084227 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:36:41.084227 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:41.084227 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:41.084227 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:41.084227 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:41.084227 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:41.084227 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:41.085075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:41.085075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:41.085075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:41.085075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:41.085075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:41.085075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:41.085075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:41.085075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:41.085075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:41.085075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:41.085075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:36:41.085075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:41.085075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 20:36:41.085075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:41.085075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 462/928] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Jul 5 20:36:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:41.086289 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8bb70-c066-4410-8e55-931fce750d64 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:41.086649 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957eb1e7-a931-49a4-a0cd-9bac3fc41f6c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:41.087110 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957eb1e7-a931-49a4-a0cd-9bac3fc41f6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:41.088662 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957eb1e7-a931-49a4-a0cd-9bac3fc41f6c None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:41.098675 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 467/929] 10.222.0.27 () {56 vars in 1115 bytes} [Tue Jul 5 20:36:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:41.099490 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957eb1e7-a931-49a4-a0cd-9bac3fc41f6c None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:41.204515 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8bb70-c066-4410-8e55-931fce750d64 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:41.212305 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957eb1e7-a931-49a4-a0cd-9bac3fc41f6c None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:41.238430 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95b5e7-bcfb-4919-99c1-d7eeda5dc530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:41.239190 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95b5e7-bcfb-4919-99c1-d7eeda5dc530 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:41.239539 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95b5e7-bcfb-4919-99c1-d7eeda5dc530 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:41.239880 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95b5e7-bcfb-4919-99c1-d7eeda5dc530 None admin] PATH_INFO: `/v3/services` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:41.240685 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a95b5e7-bcfb-4919-99c1-d7eeda5dc530 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:41.241059 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a95b5e7-bcfb-4919-99c1-d7eeda5dc530 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:41.242539 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a95b5e7-bcfb-4919-99c1-d7eeda5dc530 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:41.247515 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 463/930] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Jul 5 20:36:41 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:41.248288 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95b5e7-bcfb-4919-99c1-d7eeda5dc530 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:41.252937 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22d187-b254-4d7b-bb83-ffb32c116789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:41.253899 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22d187-b254-4d7b-bb83-ffb32c116789 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:41.254326 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22d187-b254-4d7b-bb83-ffb32c116789 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:41.254600 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22d187-b254-4d7b-bb83-ffb32c116789 None admin] PATH_INFO: `/v3/services` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:41.256001 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22d187-b254-4d7b-bb83-ffb32c116789 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:41.256001 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22d187-b254-4d7b-bb83-ffb32c116789 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:41.256978 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22d187-b254-4d7b-bb83-ffb32c116789 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:41.266663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 468/931] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Jul 5 20:36:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:41.266663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22d187-b254-4d7b-bb83-ffb32c116789 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:41.281585 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:41.312975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:41.365196 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95b5e7-bcfb-4919-99c1-d7eeda5dc530 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:41.373513 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22d187-b254-4d7b-bb83-ffb32c116789 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:41.401493 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1edf5-f1f4-4f75-8686-3aff829e77b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:41.402356 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1edf5-f1f4-4f75-8686-3aff829e77b9 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:41.402636 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1edf5-f1f4-4f75-8686-3aff829e77b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:41.402910 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1edf5-f1f4-4f75-8686-3aff829e77b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:41.408817 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4fea2d-4560-4813-aad6-89489b07b225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:41.409471 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fea2d-4560-4813-aad6-89489b07b225 None admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:41.409748 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fea2d-4560-4813-aad6-89489b07b225 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:41.410043 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fea2d-4560-4813-aad6-89489b07b225 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:41.410778 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4fea2d-4560-4813-aad6-89489b07b225 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:41.412190 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4fea2d-4560-4813-aad6-89489b07b225 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:41.414371 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b1edf5-f1f4-4f75-8686-3aff829e77b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:41.415820 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b1edf5-f1f4-4f75-8686-3aff829e77b9 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:41.432762 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 469/932] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Jul 5 20:36:41 2022] POST /identity/v3/endpoints => generated 347 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:36:41.434000 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4fea2d-4560-4813-aad6-89489b07b225 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:41.436033 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-40b1edf5-f1f4-4f75-8686-3aff829e77b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:41.436033 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:41.436033 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:41.436033 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:41.436033 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:41.436033 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:41.436033 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:41.436033 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:41.436033 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:41.436033 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:41.436033 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:41.436033 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:41.436033 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:41.436033 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:41.436033 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:41.436944 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:41.436944 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:41.436944 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:41.436944 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:41.436944 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:41.436944 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:41.436944 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:41.436944 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:41.436944 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:41.436944 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:41.436944 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:41.436944 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:41.436944 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:41.436944 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:41.436944 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:41.436944 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:41.436944 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:41.437886 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:41.437886 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:41.437886 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:41.437886 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:41.442245 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 464/933] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:41.443679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1edf5-f1f4-4f75-8686-3aff829e77b9 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:41.553969 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:41.570807 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:41.585190 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4fea2d-4560-4813-aad6-89489b07b225 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:41.588633 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1edf5-f1f4-4f75-8686-3aff829e77b9 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:41.629075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331b920-1dbb-47a8-9585-8c02811bf013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:41.630204 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331b920-1dbb-47a8-9585-8c02811bf013 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:41.630486 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331b920-1dbb-47a8-9585-8c02811bf013 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:41.631923 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331b920-1dbb-47a8-9585-8c02811bf013 None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:41.632029 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3a2f8-d71a-4a23-b4b7-9475412bbb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:41.632124 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331b920-1dbb-47a8-9585-8c02811bf013 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:41.632124 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331b920-1dbb-47a8-9585-8c02811bf013 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:41.632264 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3a2f8-d71a-4a23-b4b7-9475412bbb6a None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:41.632264 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3a2f8-d71a-4a23-b4b7-9475412bbb6a None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:41.632537 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3a2f8-d71a-4a23-b4b7-9475412bbb6a None admin] PATH_INFO: `/v3/services` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:41.633750 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab3a2f8-d71a-4a23-b4b7-9475412bbb6a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:41.633889 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331b920-1dbb-47a8-9585-8c02811bf013 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:41.634034 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab3a2f8-d71a-4a23-b4b7-9475412bbb6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:41.635122 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab3a2f8-d71a-4a23-b4b7-9475412bbb6a None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:41.641158 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 470/934] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Jul 5 20:36:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:41.648192 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3a2f8-d71a-4a23-b4b7-9475412bbb6a None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:41.650603 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 465/935] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:41.655596 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a15533-61e9-489b-b9b6-9927130962bd None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:41.655596 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a15533-61e9-489b-b9b6-9927130962bd None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:41.655819 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a15533-61e9-489b-b9b6-9927130962bd None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:41.657156 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 466/936] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:36:41.657908 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a15533-61e9-489b-b9b6-9927130962bd None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:41.760838 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a15533-61e9-489b-b9b6-9927130962bd None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:41.761610 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3a2f8-d71a-4a23-b4b7-9475412bbb6a None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:41.794107 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83372fcb-c260-46f2-a0ef-cbcc1b206ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:41.794927 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83372fcb-c260-46f2-a0ef-cbcc1b206ec8 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:41.795201 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83372fcb-c260-46f2-a0ef-cbcc1b206ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:41.795469 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83372fcb-c260-46f2-a0ef-cbcc1b206ec8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:41.797447 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:41.799206 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc856724-1682-4259-a038-7fce7173917b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:41.800243 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc856724-1682-4259-a038-7fce7173917b None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:41.800544 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc856724-1682-4259-a038-7fce7173917b None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:41.800800 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc856724-1682-4259-a038-7fce7173917b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:41.801717 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc856724-1682-4259-a038-7fce7173917b None admin] RBAC: Adding query filter params (interface=public, service_id=abee4d325f3e4953ae3101565cf30327, region_id=RegionOne) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:41.802071 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc856724-1682-4259-a038-7fce7173917b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:41.803429 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc856724-1682-4259-a038-7fce7173917b None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:41.804608 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83372fcb-c260-46f2-a0ef-cbcc1b206ec8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:41.806075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83372fcb-c260-46f2-a0ef-cbcc1b206ec8 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:41.813981 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 471/937] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Jul 5 20:36:41 2022] GET /identity/v3/endpoints?service_id=abee4d325f3e4953ae3101565cf30327&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:36:41.813981 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8800dc-c4fb-43e6-a948-50adf7737598 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:41.813981 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8800dc-c4fb-43e6-a948-50adf7737598 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:41.813981 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8800dc-c4fb-43e6-a948-50adf7737598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:41.828455 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-83372fcb-c260-46f2-a0ef-cbcc1b206ec8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 20:36:41.828455 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:41.828455 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:41.828455 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:41.828455 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:41.828455 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:41.828455 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:41.828455 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:41.828455 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:41.828455 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:41.828455 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:41.828455 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:41.828455 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:36:41.828455 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:36:41.828455 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:36:41.828455 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:36:41.829466 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:41.829466 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:41.829466 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:36:41.829466 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:41.829466 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:36:41.829466 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:41.829466 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:41.829466 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:41.829466 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:41.829466 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:41.829466 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:41.829466 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:41.829466 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:41.829466 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:41.829466 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:41.829466 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:41.829466 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:41.829466 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:41.830451 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:41.830451 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:41.830451 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:36:41.830451 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:36:41.830451 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:36:41.830451 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:36:41.830451 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:36:41.830451 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:36:41.830451 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 20:36:41.830451 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:41.830451 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 467/938] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Jul 5 20:36:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:41.830451 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83372fcb-c260-46f2-a0ef-cbcc1b206ec8 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:41.835088 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-5f8800dc-c4fb-43e6-a948-50adf7737598 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:41.836309 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-5f8800dc-c4fb-43e6-a948-50adf7737598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:41.855051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:41.909006 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 472/939] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:36:41.910248 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8800dc-c4fb-43e6-a948-50adf7737598 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:41.944453 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83372fcb-c260-46f2-a0ef-cbcc1b206ec8 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:41.979147 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bbf11-cffa-4a0e-9889-3deb2757b16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:41.979823 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bbf11-cffa-4a0e-9889-3deb2757b16d None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:41.980219 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bbf11-cffa-4a0e-9889-3deb2757b16d None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:41.980493 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bbf11-cffa-4a0e-9889-3deb2757b16d None admin] PATH_INFO: `/v3/services` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:41.981181 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668bbf11-cffa-4a0e-9889-3deb2757b16d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:41.982604 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668bbf11-cffa-4a0e-9889-3deb2757b16d None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:41.988646 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 468/940] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Jul 5 20:36:41 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:36:41.989399 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bbf11-cffa-4a0e-9889-3deb2757b16d None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:42.018610 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8800dc-c4fb-43e6-a948-50adf7737598 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:42.058220 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabf037-3114-4a9d-bc34-6b1575320deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:42.059221 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabf037-3114-4a9d-bc34-6b1575320deb None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:42.059664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabf037-3114-4a9d-bc34-6b1575320deb None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:42.060111 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabf037-3114-4a9d-bc34-6b1575320deb None admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:42.061135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efabf037-3114-4a9d-bc34-6b1575320deb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:42.061587 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efabf037-3114-4a9d-bc34-6b1575320deb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:42.063221 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efabf037-3114-4a9d-bc34-6b1575320deb None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:42.085030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 473/941] 10.222.0.27 () {56 vars in 1149 bytes} [Tue Jul 5 20:36:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:42.089573 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:42.091210 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabf037-3114-4a9d-bc34-6b1575320deb None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:42.110801 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:42.160164 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bbf11-cffa-4a0e-9889-3deb2757b16d None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:42.212053 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e34a6-520b-47dd-bf98-5faf0300aed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:42.212267 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e34a6-520b-47dd-bf98-5faf0300aed6 None admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:42.212370 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e34a6-520b-47dd-bf98-5faf0300aed6 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:42.212633 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e34a6-520b-47dd-bf98-5faf0300aed6 None admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:42.215396 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246e34a6-520b-47dd-bf98-5faf0300aed6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:42.215396 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246e34a6-520b-47dd-bf98-5faf0300aed6 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:42.216395 dv-cinder-797608-49-smb devstack@keystone.service[87151]: WARNING keystone.server.flask.common [None req-246e34a6-520b-47dd-bf98-5faf0300aed6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 05 20:36:42.231822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabf037-3114-4a9d-bc34-6b1575320deb None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:42.235551 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.sql.core [None req-246e34a6-520b-47dd-bf98-5faf0300aed6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 05 20:36:42.235551 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 05 20:36:42.235551 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [parameters: {'id': 'f0a06780f89142f19a192129a87033d0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 05 20:36:42.235551 dv-cinder-797608-49-smb devstack@keystone.service[87151]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87151) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 05 20:36:42.255329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-246e34a6-520b-47dd-bf98-5faf0300aed6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f0a06780f89142f19a192129a87033d0.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f0a06780f89142f19a192129a87033d0. Jul 05 20:36:42.255329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:42.255329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 20:36:42.255329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 20:36:42.255329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 20:36:42.255329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 20:36:42.255329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 20:36:42.255329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 20:36:42.255329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 20:36:42.255329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application conn.query(q) Jul 05 20:36:42.255329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 20:36:42.255329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 20:36:42.255329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 20:36:42.256213 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application result.read() Jul 05 20:36:42.256213 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 20:36:42.256213 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 20:36:42.256213 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 20:36:42.256213 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 20:36:42.256213 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 20:36:42.256213 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 20:36:42.256213 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 20:36:42.256213 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 20:36:42.256213 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 05 20:36:42.256213 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:42.256213 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 05 20:36:42.256213 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:42.256213 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:42.256213 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 05 20:36:42.256213 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 05 20:36:42.256213 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 05 20:36:42.256213 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 05 20:36:42.257175 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 20:36:42.257175 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application next(self.gen) Jul 05 20:36:42.257175 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 05 20:36:42.257175 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application yield resource Jul 05 20:36:42.257175 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 20:36:42.257175 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application next(self.gen) Jul 05 20:36:42.257175 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 05 20:36:42.257175 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application self.session.rollback() Jul 05 20:36:42.257175 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 05 20:36:42.257175 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application self.force_reraise() Jul 05 20:36:42.257175 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 05 20:36:42.257175 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise self.value Jul 05 20:36:42.257175 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 05 20:36:42.257175 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 05 20:36:42.257175 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 05 20:36:42.257175 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application session.commit() Jul 05 20:36:42.257175 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 05 20:36:42.258122 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 05 20:36:42.258122 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 05 20:36:42.258122 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application self._prepare_impl() Jul 05 20:36:42.258122 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 05 20:36:42.258122 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application self.session.flush() Jul 05 20:36:42.258122 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 05 20:36:42.258122 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application self._flush(objects) Jul 05 20:36:42.258122 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 05 20:36:42.258122 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 05 20:36:42.258122 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 05 20:36:42.258122 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application compat.raise_( Jul 05 20:36:42.258122 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 20:36:42.258122 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception Jul 05 20:36:42.258122 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 05 20:36:42.258122 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application flush_context.execute() Jul 05 20:36:42.258122 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 05 20:36:42.258122 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rec.execute(self) Jul 05 20:36:42.259019 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 05 20:36:42.259019 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 05 20:36:42.259019 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 05 20:36:42.259019 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 05 20:36:42.259019 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 05 20:36:42.259019 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 05 20:36:42.259019 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 05 20:36:42.259019 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 05 20:36:42.259019 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 05 20:36:42.259019 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 05 20:36:42.259019 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 05 20:36:42.259019 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 05 20:36:42.259019 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 05 20:36:42.259019 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 05 20:36:42.259019 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 05 20:36:42.260042 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 05 20:36:42.260042 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 20:36:42.260042 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception Jul 05 20:36:42.260042 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 20:36:42.260042 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 20:36:42.260042 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 20:36:42.260042 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 20:36:42.260042 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 20:36:42.260042 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 20:36:42.260042 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 20:36:42.260042 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application conn.query(q) Jul 05 20:36:42.260042 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 20:36:42.260042 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 20:36:42.260042 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 20:36:42.260042 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application result.read() Jul 05 20:36:42.260042 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 20:36:42.260042 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 20:36:42.260965 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 20:36:42.260965 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 20:36:42.260965 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 20:36:42.260965 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 20:36:42.260965 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 20:36:42.260965 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 20:36:42.260965 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 05 20:36:42.260965 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 05 20:36:42.260965 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [parameters: {'id': 'f0a06780f89142f19a192129a87033d0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 05 20:36:42.260965 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 05 20:36:42.260965 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:42.260965 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:36:42.260965 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:42.260965 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:42.260965 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 05 20:36:42.261941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 05 20:36:42.261941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 05 20:36:42.261941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 05 20:36:42.261941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 05 20:36:42.261941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:42.261941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:36:42.261941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:42.261941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:42.261941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:42.261941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:42.261941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:42.261941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:42.261941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:42.261941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:42.261941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:42.261941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:42.261941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:42.262910 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:42.262910 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 05 20:36:42.262910 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 05 20:36:42.262910 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:42.262910 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:42.262910 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 05 20:36:42.262910 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 05 20:36:42.262910 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f0a06780f89142f19a192129a87033d0. Jul 05 20:36:42.262910 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:42.265121 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 469/942] 10.222.0.27 () {60 vars in 1140 bytes} [Tue Jul 5 20:36:41 2022] POST /identity/v3/projects => generated 262 bytes in 276 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:42.269905 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f7842-cca1-407b-a889-f34081be675f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:42.269905 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f7842-cca1-407b-a889-f34081be675f None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:42.271172 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e34a6-520b-47dd-bf98-5faf0300aed6 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:42.271761 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f7842-cca1-407b-a889-f34081be675f None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:42.272035 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f7842-cca1-407b-a889-f34081be675f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:42.290019 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f7842-cca1-407b-a889-f34081be675f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:42.291269 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f7842-cca1-407b-a889-f34081be675f None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:42.310970 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-ef4f7842-cca1-407b-a889-f34081be675f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:42.310970 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:42.310970 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:42.310970 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:42.310970 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:42.310970 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:42.310970 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:42.310970 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:42.310970 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:42.310970 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:42.310970 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:42.310970 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:42.310970 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:42.310970 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:42.310970 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:42.311962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:42.311962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:42.311962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:42.311962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:42.311962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:42.311962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:42.311962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:42.311962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:42.311962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:42.311962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:42.311962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:42.311962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:42.311962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:42.311962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:42.311962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:42.311962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:42.311962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:42.312987 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:42.312987 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:42.312987 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:42.312987 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:42.312987 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 474/943] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:36:42.317681 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f7842-cca1-407b-a889-f34081be675f None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:42.390684 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e34a6-520b-47dd-bf98-5faf0300aed6 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:42.402889 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:42.407385 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:42.432065 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343ee16-4dc3-4729-a7c9-bd5e8f0a0950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:42.433276 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343ee16-4dc3-4729-a7c9-bd5e8f0a0950 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:42.433759 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343ee16-4dc3-4729-a7c9-bd5e8f0a0950 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:42.434279 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343ee16-4dc3-4729-a7c9-bd5e8f0a0950 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:42.441801 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7343ee16-4dc3-4729-a7c9-bd5e8f0a0950 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:42.443834 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7343ee16-4dc3-4729-a7c9-bd5e8f0a0950 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:42.454424 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f7842-cca1-407b-a889-f34081be675f None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:42.458674 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-7343ee16-4dc3-4729-a7c9-bd5e8f0a0950 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:42.458674 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:42.458674 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:42.458674 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:42.458674 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:42.458674 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:42.458674 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:42.458674 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:42.458674 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:42.458674 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:42.458674 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:42.458674 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:42.458674 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:36:42.458674 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:36:42.458674 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:36:42.459567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:36:42.459567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:42.459567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:42.459567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:42.459567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:42.459567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:42.459567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:42.459567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:42.459567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:42.459567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:42.459567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:42.459567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:42.459567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:42.459567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:42.459567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:42.459567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:42.459567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:42.460465 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:36:42.460465 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:36:42.460465 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:36:42.460465 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:36:42.460465 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:36:42.460465 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:36:42.460465 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:42.460465 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:42.467540 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 470/944] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:36:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:36:42.468680 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343ee16-4dc3-4729-a7c9-bd5e8f0a0950 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:42.492069 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4e649-3f1b-4aa8-b344-d105d557cfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:42.493113 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4e649-3f1b-4aa8-b344-d105d557cfd2 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:42.493601 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4e649-3f1b-4aa8-b344-d105d557cfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:42.494134 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4e649-3f1b-4aa8-b344-d105d557cfd2 None admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:42.495066 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4e649-3f1b-4aa8-b344-d105d557cfd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:42.495699 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4e649-3f1b-4aa8-b344-d105d557cfd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:42.497277 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4e649-3f1b-4aa8-b344-d105d557cfd2 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:42.510333 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 475/945] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:42.517634 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4e649-3f1b-4aa8-b344-d105d557cfd2 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:42.588991 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343ee16-4dc3-4729-a7c9-bd5e8f0a0950 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:42.627013 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f42a43-d0b5-476f-965c-55e801f89462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:42.627773 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f42a43-d0b5-476f-965c-55e801f89462 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:42.628061 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f42a43-d0b5-476f-965c-55e801f89462 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:42.628336 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f42a43-d0b5-476f-965c-55e801f89462 None admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:42.629156 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f42a43-d0b5-476f-965c-55e801f89462 None admin] RBAC: Adding query filter params (name=service) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:42.629595 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f42a43-d0b5-476f-965c-55e801f89462 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:42.631179 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f42a43-d0b5-476f-965c-55e801f89462 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:42.633101 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4e649-3f1b-4aa8-b344-d105d557cfd2 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:42.653023 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 471/946] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Jul 5 20:36:42 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:42.662663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:42.669610 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d42905-5c01-44ef-8ec8-0d9c4195a95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:42.670492 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d42905-5c01-44ef-8ec8-0d9c4195a95c None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:42.670775 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d42905-5c01-44ef-8ec8-0d9c4195a95c None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:42.671049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d42905-5c01-44ef-8ec8-0d9c4195a95c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:42.679564 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d42905-5c01-44ef-8ec8-0d9c4195a95c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:42.681080 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d42905-5c01-44ef-8ec8-0d9c4195a95c None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:42.697050 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-22d42905-5c01-44ef-8ec8-0d9c4195a95c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:42.697050 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:42.697050 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:42.697050 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:42.697050 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:42.697050 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:42.697050 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:42.697050 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:42.697050 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:42.697050 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:42.697050 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:42.697050 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:42.697050 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:36:42.697050 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:36:42.697050 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:36:42.698051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:36:42.698051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:42.698051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:42.698051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:42.698051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:42.698051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:42.698051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:42.698051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:42.698051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:42.698051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:42.698051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:42.698051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:42.698051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:42.698051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:42.698051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:42.698051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:42.698051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:42.699093 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:36:42.699093 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:36:42.699093 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:36:42.699093 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:36:42.699093 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:36:42.699093 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:36:42.699093 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:42.699093 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:42.699093 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 476/947] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:36:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:36:42.704632 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f42a43-d0b5-476f-965c-55e801f89462 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:42.744882 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:42.822194 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f42a43-d0b5-476f-965c-55e801f89462 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:42.857135 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9b8ac-ff5e-4552-bb38-53390e610ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:42.857731 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9b8ac-ff5e-4552-bb38-53390e610ddb None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:42.858080 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9b8ac-ff5e-4552-bb38-53390e610ddb None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:42.858351 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9b8ac-ff5e-4552-bb38-53390e610ddb None admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:42.859208 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9b8ac-ff5e-4552-bb38-53390e610ddb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:42.859521 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9b8ac-ff5e-4552-bb38-53390e610ddb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:42.860961 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9b8ac-ff5e-4552-bb38-53390e610ddb None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:42.873396 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 472/948] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 5 20:36:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:42.879502 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d42905-5c01-44ef-8ec8-0d9c4195a95c None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:42.985612 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d42905-5c01-44ef-8ec8-0d9c4195a95c None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:43.021850 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09e272-e345-40ee-a9a9-5baa9f8ec97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:43.022746 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09e272-e345-40ee-a9a9-5baa9f8ec97e None admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:43.023021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09e272-e345-40ee-a9a9-5baa9f8ec97e None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:43.023288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09e272-e345-40ee-a9a9-5baa9f8ec97e None admin] PATH_INFO: `/v3/projects/b321588ec1f14bcb94a184310cf72856/users/c9647d15389e49e6b7c43ea1b1538a13/roles/8d9d4dd4ce594ddb9579d0e117ad02e9` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:43.025502 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09e272-e345-40ee-a9a9-5baa9f8ec97e None admin] RBAC: Authorizing `identity:create_grant(project_id=b321588ec1f14bcb94a184310cf72856, user_id=c9647d15389e49e6b7c43ea1b1538a13, role_id=8d9d4dd4ce594ddb9579d0e117ad02e9)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:43.027064 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09e272-e345-40ee-a9a9-5baa9f8ec97e None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:43.044680 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 477/949] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 5 20:36:42 2022] PUT /identity/v3/projects/b321588ec1f14bcb94a184310cf72856/users/c9647d15389e49e6b7c43ea1b1538a13/roles/8d9d4dd4ce594ddb9579d0e117ad02e9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:36:43.546705 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3689f-421f-4ad2-9cad-43dc6f020573 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:43.546900 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3689f-421f-4ad2-9cad-43dc6f020573 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:43.547259 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3689f-421f-4ad2-9cad-43dc6f020573 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:43.548935 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 473/950] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:43.554434 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554385c-e005-4e29-8e2c-1047f8b6b96d None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:43.554723 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554385c-e005-4e29-8e2c-1047f8b6b96d None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:43.555000 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554385c-e005-4e29-8e2c-1047f8b6b96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:43.571963 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-c554385c-e005-4e29-8e2c-1047f8b6b96d None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:43.573150 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-c554385c-e005-4e29-8e2c-1047f8b6b96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:43.612627 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:43.645018 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 478/951] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:36:43.666627 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3689f-421f-4ad2-9cad-43dc6f020573 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:43.765873 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:43.774111 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3689f-421f-4ad2-9cad-43dc6f020573 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:43.811088 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecdebe7-8e70-4a75-bc39-6f41d998f264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:43.811810 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecdebe7-8e70-4a75-bc39-6f41d998f264 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:43.812086 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecdebe7-8e70-4a75-bc39-6f41d998f264 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:43.812354 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecdebe7-8e70-4a75-bc39-6f41d998f264 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:43.813006 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecdebe7-8e70-4a75-bc39-6f41d998f264 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:43.814420 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecdebe7-8e70-4a75-bc39-6f41d998f264 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:43.826508 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-2ecdebe7-8e70-4a75-bc39-6f41d998f264 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 20:36:43.826508 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:43.826508 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:36:43.826508 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:36:43.826508 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:36:43.826508 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:36:43.826508 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:36:43.826508 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:43.826508 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 20:36:43.826508 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:43.826508 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:36:43.826508 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:43.826508 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:43.826508 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:43.826508 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:43.826508 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:43.826508 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:43.827583 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:43.827583 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:43.827583 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:43.827583 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:43.827583 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:43.827583 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:43.827583 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:36:43.827583 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:36:43.827583 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:36:43.827583 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:36:43.827583 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:43.827583 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:43.827583 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:43.827583 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:43.827583 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:43.827583 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:43.828463 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:43.828463 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:43.828463 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:43.828463 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:43.828463 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:43.828463 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:43.828463 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:43.828463 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:43.828463 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:43.828463 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:43.828463 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:36:43.828463 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:43.828463 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 20:36:43.828463 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:43.828463 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 474/952] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:36:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:43.834257 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554385c-e005-4e29-8e2c-1047f8b6b96d None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:43.944057 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554385c-e005-4e29-8e2c-1047f8b6b96d None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:43.980588 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e119871-abb4-4931-82be-445c6ee2b47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:43.981645 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e119871-abb4-4931-82be-445c6ee2b47c None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:43.982153 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e119871-abb4-4931-82be-445c6ee2b47c None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:43.982648 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e119871-abb4-4931-82be-445c6ee2b47c None admin] PATH_INFO: `/v3/services` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:43.983596 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e119871-abb4-4931-82be-445c6ee2b47c None admin] RBAC: Adding query filter params (name=compute) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:43.984165 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e119871-abb4-4931-82be-445c6ee2b47c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:43.985754 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e119871-abb4-4931-82be-445c6ee2b47c None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:43.991419 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 479/953] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Jul 5 20:36:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:43.996867 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecdebe7-8e70-4a75-bc39-6f41d998f264 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:44.096207 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b326fb-2564-49c7-8f6c-02d63eca0e2f None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:44.096487 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b326fb-2564-49c7-8f6c-02d63eca0e2f None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:44.096762 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b326fb-2564-49c7-8f6c-02d63eca0e2f None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:44.098550 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 480/954] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:44.103470 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b5b58-b083-4efa-9ac8-e86d9b218d4b None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:44.103607 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecdebe7-8e70-4a75-bc39-6f41d998f264 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:44.104027 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b5b58-b083-4efa-9ac8-e86d9b218d4b None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:44.104512 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b5b58-b083-4efa-9ac8-e86d9b218d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:44.127421 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-ad9b5b58-b083-4efa-9ac8-e86d9b218d4b None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:44.129248 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-ad9b5b58-b083-4efa-9ac8-e86d9b218d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:44.144681 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9cd76-be0a-41f8-9a3c-81c49206a65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:44.145565 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9cd76-be0a-41f8-9a3c-81c49206a65f None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:44.146029 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9cd76-be0a-41f8-9a3c-81c49206a65f None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:44.146441 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9cd76-be0a-41f8-9a3c-81c49206a65f None admin] PATH_INFO: `/v3/services` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:44.147306 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9cd76-be0a-41f8-9a3c-81c49206a65f None admin] RBAC: Adding query filter params (type=compute) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:44.153167 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9cd76-be0a-41f8-9a3c-81c49206a65f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:44.154823 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9cd76-be0a-41f8-9a3c-81c49206a65f None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:44.160468 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 475/955] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Jul 5 20:36:43 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:44.167417 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:44.213612 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 481/956] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 20:36:44.236251 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9cd76-be0a-41f8-9a3c-81c49206a65f None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:44.265728 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:44.353249 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9cd76-be0a-41f8-9a3c-81c49206a65f None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:44.387525 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bfbcd0-30f0-415d-ad8d-d2862ee22a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:44.388644 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bfbcd0-30f0-415d-ad8d-d2862ee22a04 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:44.389113 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bfbcd0-30f0-415d-ad8d-d2862ee22a04 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:44.389533 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bfbcd0-30f0-415d-ad8d-d2862ee22a04 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:44.390377 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bfbcd0-30f0-415d-ad8d-d2862ee22a04 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:44.391900 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bfbcd0-30f0-415d-ad8d-d2862ee22a04 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:44.404186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-a4bfbcd0-30f0-415d-ad8d-d2862ee22a04 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 20:36:44.404186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:44.404186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:36:44.404186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:36:44.404186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:36:44.404186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:36:44.404186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:36:44.404186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:44.404186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 20:36:44.404186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:44.404186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:36:44.404186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:44.404186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:44.404186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:44.404186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:44.404186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:44.404186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:44.405584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:44.405584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:44.405584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:44.405584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:44.405584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:44.405584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:44.405584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:36:44.405584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:36:44.405584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:36:44.405584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:36:44.405584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:44.405584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:44.405584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:44.405584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:44.405584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:44.405584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:44.406708 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:44.406708 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:44.406708 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:44.406708 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:44.406708 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:44.406708 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:44.406708 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:44.406708 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:44.406708 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:44.406708 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:44.406708 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:36:44.406708 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:44.406708 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 20:36:44.406708 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:44.409338 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 476/957] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Jul 5 20:36:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:44.415540 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b5b58-b083-4efa-9ac8-e86d9b218d4b None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:44.520614 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b5b58-b083-4efa-9ac8-e86d9b218d4b None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:44.555775 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215655e-ebfd-4f68-b078-87a6f4914620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:44.556442 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215655e-ebfd-4f68-b078-87a6f4914620 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:44.556722 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215655e-ebfd-4f68-b078-87a6f4914620 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:44.556995 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215655e-ebfd-4f68-b078-87a6f4914620 None admin] PATH_INFO: `/v3/services` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:44.557704 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215655e-ebfd-4f68-b078-87a6f4914620 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:44.558098 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215655e-ebfd-4f68-b078-87a6f4914620 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:44.559487 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215655e-ebfd-4f68-b078-87a6f4914620 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:44.565065 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 482/958] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Jul 5 20:36:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:44.570578 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bfbcd0-30f0-415d-ad8d-d2862ee22a04 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:44.659600 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:44.676936 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bfbcd0-30f0-415d-ad8d-d2862ee22a04 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:44.712774 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ef1e4-ee92-46ca-a3ed-001f99d41994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:44.713449 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ef1e4-ee92-46ca-a3ed-001f99d41994 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:44.713729 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ef1e4-ee92-46ca-a3ed-001f99d41994 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:44.714029 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ef1e4-ee92-46ca-a3ed-001f99d41994 None admin] PATH_INFO: `/v3/services` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:44.714809 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ef1e4-ee92-46ca-a3ed-001f99d41994 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:44.715113 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ef1e4-ee92-46ca-a3ed-001f99d41994 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:44.716497 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ef1e4-ee92-46ca-a3ed-001f99d41994 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:44.722082 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 477/959] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Jul 5 20:36:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:44.731014 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215655e-ebfd-4f68-b078-87a6f4914620 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:44.764850 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:44.840664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215655e-ebfd-4f68-b078-87a6f4914620 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:44.860751 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eebae3-4f70-4343-aab3-f13146468fd7 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:44.861092 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eebae3-4f70-4343-aab3-f13146468fd7 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:44.861369 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eebae3-4f70-4343-aab3-f13146468fd7 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:44.863036 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 478/960] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:36:44.869415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721587b-aa4b-443b-a8bb-d6ef680a3dc3 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:44.870012 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721587b-aa4b-443b-a8bb-d6ef680a3dc3 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:44.870533 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721587b-aa4b-443b-a8bb-d6ef680a3dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:44.881335 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7aa5e-fe47-4333-bcf2-782143f38581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:44.882036 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7aa5e-fe47-4333-bcf2-782143f38581 None admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:44.882315 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7aa5e-fe47-4333-bcf2-782143f38581 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:44.882588 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7aa5e-fe47-4333-bcf2-782143f38581 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:44.883330 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7aa5e-fe47-4333-bcf2-782143f38581 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:44.886190 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7aa5e-fe47-4333-bcf2-782143f38581 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:44.890134 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-8721587b-aa4b-443b-a8bb-d6ef680a3dc3 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:44.891881 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-8721587b-aa4b-443b-a8bb-d6ef680a3dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:44.912751 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 483/961] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Jul 5 20:36:44 2022] POST /identity/v3/endpoints => generated 349 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:36:44.982866 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 479/962] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:36:45.008267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7aa5e-fe47-4333-bcf2-782143f38581 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:45.111820 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:45.126488 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7aa5e-fe47-4333-bcf2-782143f38581 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:45.175086 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21047d84-033b-436f-837e-3a08c8f4bc4d None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:45.175267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b1842-ef6a-454b-85cd-e226e42419bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:45.175267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b1842-ef6a-454b-85cd-e226e42419bf None admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:45.175458 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b1842-ef6a-454b-85cd-e226e42419bf None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:45.175644 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b1842-ef6a-454b-85cd-e226e42419bf None admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:45.176126 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21047d84-033b-436f-837e-3a08c8f4bc4d None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:45.176281 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b1842-ef6a-454b-85cd-e226e42419bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:45.176718 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21047d84-033b-436f-837e-3a08c8f4bc4d None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:45.177695 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b1842-ef6a-454b-85cd-e226e42419bf None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:45.178782 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 480/963] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:45 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:45.182457 dv-cinder-797608-49-smb devstack@keystone.service[87152]: WARNING keystone.server.flask.common [None req-ec9b1842-ef6a-454b-85cd-e226e42419bf None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 05 20:36:45.184188 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645c759-36d0-46d5-b1bd-45dbf1cfff44 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:45.184539 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645c759-36d0-46d5-b1bd-45dbf1cfff44 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:45.184884 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645c759-36d0-46d5-b1bd-45dbf1cfff44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:45.199410 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.sql.core [None req-ec9b1842-ef6a-454b-85cd-e226e42419bf None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 05 20:36:45.199410 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 05 20:36:45.199410 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [parameters: {'user_id': '4fffbb929c524f709576f367506523f8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 05 20:36:45.199410 dv-cinder-797608-49-smb devstack@keystone.service[87152]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87152) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 05 20:36:45.202584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-8645c759-36d0-46d5-b1bd-45dbf1cfff44 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:45.203902 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-8645c759-36d0-46d5-b1bd-45dbf1cfff44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:45.209313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-ec9b1842-ef6a-454b-85cd-e226e42419bf None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 05 20:36:45.209313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:45.209313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 20:36:45.209313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 20:36:45.209313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 20:36:45.209313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 20:36:45.209313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 20:36:45.209313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 20:36:45.209313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 20:36:45.209313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application conn.query(q) Jul 05 20:36:45.209313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 20:36:45.209313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 20:36:45.209313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 20:36:45.209313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application result.read() Jul 05 20:36:45.209313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 20:36:45.210285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 20:36:45.210285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 20:36:45.210285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 20:36:45.210285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 20:36:45.210285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 20:36:45.210285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 20:36:45.210285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 20:36:45.210285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 05 20:36:45.210285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:45.210285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 05 20:36:45.210285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:45.210285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:45.210285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 05 20:36:45.210285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 05 20:36:45.210285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 05 20:36:45.210285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 05 20:36:45.210285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 20:36:45.210285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application next(self.gen) Jul 05 20:36:45.211267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 05 20:36:45.211267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application yield resource Jul 05 20:36:45.211267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 05 20:36:45.211267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application next(self.gen) Jul 05 20:36:45.211267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 05 20:36:45.211267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self.session.rollback() Jul 05 20:36:45.211267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 05 20:36:45.211267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self.force_reraise() Jul 05 20:36:45.211267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 05 20:36:45.211267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise self.value Jul 05 20:36:45.211267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 05 20:36:45.211267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 05 20:36:45.211267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 05 20:36:45.211267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application session.commit() Jul 05 20:36:45.211267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 05 20:36:45.211267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 05 20:36:45.211267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 05 20:36:45.212181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self._prepare_impl() Jul 05 20:36:45.212181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 05 20:36:45.212181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self.session.flush() Jul 05 20:36:45.212181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 05 20:36:45.212181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self._flush(objects) Jul 05 20:36:45.212181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 05 20:36:45.212181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 05 20:36:45.212181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 05 20:36:45.212181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application compat.raise_( Jul 05 20:36:45.212181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 20:36:45.212181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception Jul 05 20:36:45.212181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 05 20:36:45.212181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application flush_context.execute() Jul 05 20:36:45.212181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 05 20:36:45.212181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rec.execute(self) Jul 05 20:36:45.212181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 05 20:36:45.212181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 05 20:36:45.213101 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 05 20:36:45.213101 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 05 20:36:45.213101 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 05 20:36:45.213101 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 05 20:36:45.213101 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 05 20:36:45.213101 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 05 20:36:45.213101 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 05 20:36:45.213101 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 05 20:36:45.213101 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 05 20:36:45.213101 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 05 20:36:45.213101 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 05 20:36:45.213101 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 05 20:36:45.213101 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 05 20:36:45.213101 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 05 20:36:45.213101 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 05 20:36:45.213101 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception Jul 05 20:36:45.214026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 05 20:36:45.214026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 05 20:36:45.214026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 05 20:36:45.214026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 05 20:36:45.214026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 05 20:36:45.214026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application result = self._query(query) Jul 05 20:36:45.214026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 05 20:36:45.214026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application conn.query(q) Jul 05 20:36:45.214026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 05 20:36:45.214026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 05 20:36:45.214026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 05 20:36:45.214026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application result.read() Jul 05 20:36:45.214026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 05 20:36:45.214026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 05 20:36:45.214026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 05 20:36:45.214026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 05 20:36:45.215045 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 05 20:36:45.215045 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 05 20:36:45.215045 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 05 20:36:45.215045 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 05 20:36:45.215045 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 05 20:36:45.215045 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 05 20:36:45.215045 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [parameters: {'user_id': '4fffbb929c524f709576f367506523f8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 05 20:36:45.215045 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 05 20:36:45.215045 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:45.215045 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:36:45.215045 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:45.215045 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:45.215045 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:45.215045 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:45.215045 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:45.215866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:45.215866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:45.215866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:45.215866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:45.215866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:45.215866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:45.215866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:45.215866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 05 20:36:45.215866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 05 20:36:45.215866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:45.215866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:45.215866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:36:45.215866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:45.215866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:36:45.215866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:45.215866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 05 20:36:45.215866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 05 20:36:45.216840 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 05 20:36:45.216840 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 05 20:36:45.216840 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 05 20:36:45.216840 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 05 20:36:45.216840 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 05 20:36:45.216840 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:45.216840 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 484/964] 10.222.0.27 () {60 vars in 1131 bytes} [Tue Jul 5 20:36:45 2022] POST /identity/v3/users => generated 160 bytes in 208 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:45.225019 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b1842-ef6a-454b-85cd-e226e42419bf None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:45.291610 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 481/965] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 20:36:45.309673 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645c759-36d0-46d5-b1bd-45dbf1cfff44 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:45.318074 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:45.355638 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b1842-ef6a-454b-85cd-e226e42419bf None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:45.392582 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90663b27-03e2-4de2-8def-b3fe136ba8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:45.393413 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90663b27-03e2-4de2-8def-b3fe136ba8dc None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:45.393694 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90663b27-03e2-4de2-8def-b3fe136ba8dc None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:45.394013 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90663b27-03e2-4de2-8def-b3fe136ba8dc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:45.403461 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90663b27-03e2-4de2-8def-b3fe136ba8dc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:45.406663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90663b27-03e2-4de2-8def-b3fe136ba8dc None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:45.421742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645c759-36d0-46d5-b1bd-45dbf1cfff44 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:45.426484 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-90663b27-03e2-4de2-8def-b3fe136ba8dc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 20:36:45.426484 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:45.426484 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:45.426484 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:45.426484 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:45.426484 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:45.426484 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:45.426484 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:45.426484 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:45.426484 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:45.426484 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:45.426484 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:45.426484 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:36:45.426484 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:36:45.426484 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:36:45.426484 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:36:45.427443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:45.427443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:45.427443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:36:45.427443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:45.427443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:36:45.427443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:45.427443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:45.427443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:45.427443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:45.427443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:45.427443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:45.427443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:45.427443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:45.427443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:45.427443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:45.427443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:45.427443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:45.427443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:45.428645 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:45.428645 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:45.428645 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:36:45.428645 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:36:45.428645 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:36:45.428645 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:36:45.428645 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:36:45.428645 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:36:45.428645 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 05 20:36:45.428645 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:45.428645 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 485/966] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:36:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:45.433352 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90663b27-03e2-4de2-8def-b3fe136ba8dc None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:45.447231 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:45.462168 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affde5d-581f-495a-a788-389fb77c73a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:45.463413 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affde5d-581f-495a-a788-389fb77c73a3 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:45.464460 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affde5d-581f-495a-a788-389fb77c73a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:45.464922 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6affde5d-581f-495a-a788-389fb77c73a3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:45.479134 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6affde5d-581f-495a-a788-389fb77c73a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:36:45.491268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-6affde5d-581f-495a-a788-389fb77c73a3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 20:36:45.491268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:45.491268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:45.491268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:45.491268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:45.491268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:45.491268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:45.491268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:45.491268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:45.491268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:45.491268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:45.491268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:45.491268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:36:45.491268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:36:45.491268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:36:45.491268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:36:45.492431 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:36:45.492431 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:36:45.492431 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:36:45.492431 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:36:45.492431 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:45.492431 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:45.492431 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:45.492431 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:45.492431 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:45.492431 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:45.492431 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:45.492431 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:45.492431 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:45.492431 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:45.492431 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:45.492431 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:45.493487 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:45.493487 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:45.493487 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:45.493487 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:45.493487 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:36:45.493487 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:36:45.493487 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:36:45.493487 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:36:45.493487 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:36:45.493487 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:36:45.493487 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 20:36:45.493487 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:45.501794 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 482/967] 10.222.0.27 () {56 vars in 1120 bytes} [Tue Jul 5 20:36:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:36:45.503543 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affde5d-581f-495a-a788-389fb77c73a3 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:45.557313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90663b27-03e2-4de2-8def-b3fe136ba8dc None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:45.594271 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:45.606112 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68407bd5-33ff-44af-8333-d3fb4bd4a2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:45.606795 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68407bd5-33ff-44af-8333-d3fb4bd4a2a3 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:45.607072 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68407bd5-33ff-44af-8333-d3fb4bd4a2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:45.607343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68407bd5-33ff-44af-8333-d3fb4bd4a2a3 None admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:45.608159 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68407bd5-33ff-44af-8333-d3fb4bd4a2a3 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:45.608461 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68407bd5-33ff-44af-8333-d3fb4bd4a2a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:45.609928 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68407bd5-33ff-44af-8333-d3fb4bd4a2a3 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:45.623308 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6affde5d-581f-495a-a788-389fb77c73a3 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:45.648886 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 486/968] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 5 20:36:45 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:45.666228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18767f2-227d-4f53-8c15-cc0f9c60a140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:45.667288 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18767f2-227d-4f53-8c15-cc0f9c60a140 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:45.667738 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18767f2-227d-4f53-8c15-cc0f9c60a140 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:45.668166 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18767f2-227d-4f53-8c15-cc0f9c60a140 None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:45.669096 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18767f2-227d-4f53-8c15-cc0f9c60a140 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:45.669570 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18767f2-227d-4f53-8c15-cc0f9c60a140 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:45.671192 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18767f2-227d-4f53-8c15-cc0f9c60a140 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:45.687140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 483/969] 10.222.0.27 () {56 vars in 1115 bytes} [Tue Jul 5 20:36:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:36:45.689264 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68407bd5-33ff-44af-8333-d3fb4bd4a2a3 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:45.766460 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:45.804404 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68407bd5-33ff-44af-8333-d3fb4bd4a2a3 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:45.840322 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af2df6-3e57-41ea-b68c-36e357a845b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:45.841126 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af2df6-3e57-41ea-b68c-36e357a845b0 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:45.841404 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af2df6-3e57-41ea-b68c-36e357a845b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:45.841667 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af2df6-3e57-41ea-b68c-36e357a845b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:45.851919 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af2df6-3e57-41ea-b68c-36e357a845b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:45.853374 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af2df6-3e57-41ea-b68c-36e357a845b0 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:45.871124 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-14af2df6-3e57-41ea-b68c-36e357a845b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:45.871124 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:45.871124 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:45.871124 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:45.871124 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:45.871124 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:45.871124 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:45.871124 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:45.871124 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:45.871124 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:45.871124 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:45.871124 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:45.871124 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:45.871124 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:45.871124 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:45.872056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:45.872056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:45.872056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:45.872056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:45.872056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:45.872056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:45.872056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:45.872056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:45.872056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:45.872056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:45.872056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:45.872056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:45.872056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:45.872056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:45.872056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:45.872056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:45.872056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:45.872976 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:45.872976 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:45.872976 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:45.872976 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:45.875374 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 487/970] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:45.879154 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18767f2-227d-4f53-8c15-cc0f9c60a140 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:45.985165 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18767f2-227d-4f53-8c15-cc0f9c60a140 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:46.010760 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:46.020244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570382f-71e3-449b-b16c-2edcb29b1f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:46.020913 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570382f-71e3-449b-b16c-2edcb29b1f3e None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:46.021168 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570382f-71e3-449b-b16c-2edcb29b1f3e None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:46.021467 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570382f-71e3-449b-b16c-2edcb29b1f3e None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:46.022211 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570382f-71e3-449b-b16c-2edcb29b1f3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:46.022521 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570382f-71e3-449b-b16c-2edcb29b1f3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:46.023906 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570382f-71e3-449b-b16c-2edcb29b1f3e None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:46.036775 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 484/971] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:46.042255 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af2df6-3e57-41ea-b68c-36e357a845b0 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:46.157302 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af2df6-3e57-41ea-b68c-36e357a845b0 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:46.180920 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:46.196972 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af960dd1-77ef-4105-a3e1-f21286fabe13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:46.197794 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af960dd1-77ef-4105-a3e1-f21286fabe13 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:46.198093 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af960dd1-77ef-4105-a3e1-f21286fabe13 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:46.198364 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af960dd1-77ef-4105-a3e1-f21286fabe13 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:46.205776 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af960dd1-77ef-4105-a3e1-f21286fabe13 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:46.207256 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af960dd1-77ef-4105-a3e1-f21286fabe13 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:46.222454 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-af960dd1-77ef-4105-a3e1-f21286fabe13 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 20:36:46.222454 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:46.222454 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:46.222454 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:46.222454 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:46.222454 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:46.222454 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:46.222454 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:46.222454 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:46.222454 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:46.222454 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:46.222454 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:46.222454 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:36:46.222454 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:36:46.222454 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:36:46.222454 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:36:46.223411 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:46.223411 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:46.223411 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:36:46.223411 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:46.223411 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:36:46.223411 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:46.223411 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:46.223411 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:46.223411 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:46.223411 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:46.223411 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:46.223411 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:46.223411 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:46.223411 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:46.223411 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:46.223411 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:46.223411 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:46.223411 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:46.224362 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:46.224362 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:46.224362 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:36:46.224362 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:36:46.224362 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:36:46.224362 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:36:46.224362 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:36:46.224362 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:36:46.224362 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 05 20:36:46.224362 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:46.224362 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 488/972] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Jul 5 20:36:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:46.230876 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570382f-71e3-449b-b16c-2edcb29b1f3e None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:46.332726 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278f144-7b4f-4c25-9bcb-692b88ecf4a7 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:46.333009 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278f144-7b4f-4c25-9bcb-692b88ecf4a7 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:46.333282 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278f144-7b4f-4c25-9bcb-692b88ecf4a7 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:46.334957 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 489/973] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:46.336270 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570382f-71e3-449b-b16c-2edcb29b1f3e None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:46.339520 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc396be-3578-4ab6-88ad-799c4c741a20 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:46.340006 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc396be-3578-4ab6-88ad-799c4c741a20 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:46.340453 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc396be-3578-4ab6-88ad-799c4c741a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:46.358648 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-4bc396be-3578-4ab6-88ad-799c4c741a20 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:46.360509 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-4bc396be-3578-4ab6-88ad-799c4c741a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:46.369079 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf996796-b04c-4f78-acd0-2f819e3f6e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:46.369757 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf996796-b04c-4f78-acd0-2f819e3f6e51 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:46.370065 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf996796-b04c-4f78-acd0-2f819e3f6e51 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:46.370366 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf996796-b04c-4f78-acd0-2f819e3f6e51 None admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:46.371233 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf996796-b04c-4f78-acd0-2f819e3f6e51 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:46.371539 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf996796-b04c-4f78-acd0-2f819e3f6e51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:46.372969 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf996796-b04c-4f78-acd0-2f819e3f6e51 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:46.394910 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 485/974] 10.222.0.27 () {56 vars in 1149 bytes} [Tue Jul 5 20:36:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:46.396076 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf996796-b04c-4f78-acd0-2f819e3f6e51 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:46.437708 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 490/975] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:36:46.445898 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:46.459960 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc396be-3578-4ab6-88ad-799c4c741a20 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:46.501342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf996796-b04c-4f78-acd0-2f819e3f6e51 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:46.536459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5d0cb-7635-4353-8ea2-d295f580f464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:46.537111 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5d0cb-7635-4353-8ea2-d295f580f464 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:46.537389 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5d0cb-7635-4353-8ea2-d295f580f464 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:46.537661 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5d0cb-7635-4353-8ea2-d295f580f464 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:46.564405 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc396be-3578-4ab6-88ad-799c4c741a20 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:46.576225 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:46.601773 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd34d3e1-0a72-45ce-8ec8-760fb8136e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:46.602387 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34d3e1-0a72-45ce-8ec8-760fb8136e73 None admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:46.602661 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34d3e1-0a72-45ce-8ec8-760fb8136e73 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:46.602928 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34d3e1-0a72-45ce-8ec8-760fb8136e73 None admin] PATH_INFO: `/v3/services` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:46.603643 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd34d3e1-0a72-45ce-8ec8-760fb8136e73 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:46.605316 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd34d3e1-0a72-45ce-8ec8-760fb8136e73 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:46.608122 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5d0cb-7635-4353-8ea2-d295f580f464 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:46.609593 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5d0cb-7635-4353-8ea2-d295f580f464 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:46.623431 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 491/976] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Jul 5 20:36:46 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:36:46.662164 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:46.723565 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 486/977] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:36:46 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 20:36:46.729582 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd34d3e1-0a72-45ce-8ec8-760fb8136e73 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:46.846829 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd34d3e1-0a72-45ce-8ec8-760fb8136e73 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:46.883974 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7055221-ee92-4c7a-819b-89c232c13678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:46.884695 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7055221-ee92-4c7a-819b-89c232c13678 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:46.884975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7055221-ee92-4c7a-819b-89c232c13678 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:46.885252 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7055221-ee92-4c7a-819b-89c232c13678 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:46.896218 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7055221-ee92-4c7a-819b-89c232c13678 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:46.897677 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7055221-ee92-4c7a-819b-89c232c13678 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:46.916058 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-b7055221-ee92-4c7a-819b-89c232c13678 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:46.916058 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:46.916058 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:46.916058 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:46.916058 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:46.916058 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:46.916058 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:46.916058 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:46.916058 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:46.916058 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:46.916058 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:46.916058 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:46.916058 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:46.916058 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:46.916058 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:46.917010 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:46.917010 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:46.917010 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:46.917010 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:46.917010 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:46.917010 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:46.917010 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:46.917010 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:46.917010 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:46.917010 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:46.917010 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:46.917010 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:46.917010 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:46.917010 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:46.917010 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:46.917010 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:46.917010 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:46.917965 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:46.917965 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:46.917965 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:46.917965 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:46.917965 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 492/978] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:46.923171 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5d0cb-7635-4353-8ea2-d295f580f464 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:46.996538 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02008e6b-5879-427e-bac9-6bf317c8b464 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:46.996894 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02008e6b-5879-427e-bac9-6bf317c8b464 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:46.997055 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02008e6b-5879-427e-bac9-6bf317c8b464 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:46.998468 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 493/979] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:36:47.003731 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a055d-0338-4359-a11d-5d822cd1c8bc None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:47.004012 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a055d-0338-4359-a11d-5d822cd1c8bc None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:47.004290 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a055d-0338-4359-a11d-5d822cd1c8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:47.023928 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-245a055d-0338-4359-a11d-5d822cd1c8bc None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:47.025442 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-245a055d-0338-4359-a11d-5d822cd1c8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:47.027037 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5d0cb-7635-4353-8ea2-d295f580f464 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:47.041170 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:47.064678 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bb8dd-b66a-45ab-a64c-5674176f6090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:47.065355 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bb8dd-b66a-45ab-a64c-5674176f6090 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:47.065642 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bb8dd-b66a-45ab-a64c-5674176f6090 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:47.065966 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bb8dd-b66a-45ab-a64c-5674176f6090 None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:47.066707 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504bb8dd-b66a-45ab-a64c-5674176f6090 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:47.067015 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504bb8dd-b66a-45ab-a64c-5674176f6090 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:47.068410 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504bb8dd-b66a-45ab-a64c-5674176f6090 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:47.080552 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 487/980] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:47.085786 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bb8dd-b66a-45ab-a64c-5674176f6090 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:47.095904 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:47.101393 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 494/981] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 20:36:47.123551 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a055d-0338-4359-a11d-5d822cd1c8bc None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:47.196751 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bb8dd-b66a-45ab-a64c-5674176f6090 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:47.234840 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa704cd-e559-402c-b25e-c809a3280534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:47.235956 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa704cd-e559-402c-b25e-c809a3280534 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:47.236379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa704cd-e559-402c-b25e-c809a3280534 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:47.236657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa704cd-e559-402c-b25e-c809a3280534 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:47.238161 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a055d-0338-4359-a11d-5d822cd1c8bc None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:47.243547 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa704cd-e559-402c-b25e-c809a3280534 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:47.245004 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa704cd-e559-402c-b25e-c809a3280534 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:47.259217 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-ffa704cd-e559-402c-b25e-c809a3280534 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:47.259217 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:47.259217 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:47.259217 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:47.259217 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:47.259217 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:47.259217 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:47.259217 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:47.259217 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:47.259217 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:47.259217 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:47.259217 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:47.259217 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:36:47.259217 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:36:47.259217 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:36:47.260160 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:36:47.260160 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:47.260160 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:47.260160 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:47.260160 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:47.260160 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:47.260160 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:47.260160 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:47.260160 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:47.260160 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:47.260160 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:47.260160 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:47.260160 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:47.260160 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:47.260160 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:47.260160 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:47.260160 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:47.261152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:36:47.261152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:36:47.261152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:36:47.261152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:36:47.261152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:36:47.261152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:36:47.261152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:47.261152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:47.261152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 488/982] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:36:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:47.266180 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa704cd-e559-402c-b25e-c809a3280534 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:47.276405 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f732ab2-2a82-4cc1-a27f-64a209fe06d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:47.277250 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f732ab2-2a82-4cc1-a27f-64a209fe06d3 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:47.277534 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f732ab2-2a82-4cc1-a27f-64a209fe06d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:47.277807 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f732ab2-2a82-4cc1-a27f-64a209fe06d3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:47.278495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f732ab2-2a82-4cc1-a27f-64a209fe06d3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:47.279886 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f732ab2-2a82-4cc1-a27f-64a209fe06d3 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:47.291839 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-8f732ab2-2a82-4cc1-a27f-64a209fe06d3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 20:36:47.291839 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:47.291839 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:36:47.291839 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:36:47.291839 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:36:47.291839 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:36:47.291839 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:36:47.291839 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:47.291839 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 20:36:47.291839 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:47.291839 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:36:47.291839 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:47.291839 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:47.291839 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:47.291839 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:47.291839 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:47.291839 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:47.292954 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:47.292954 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:47.292954 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:47.292954 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:47.292954 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:47.292954 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:47.292954 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:36:47.292954 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:36:47.292954 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:36:47.292954 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:36:47.292954 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:47.292954 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:47.292954 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:47.292954 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:47.292954 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:47.292954 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:47.293815 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:47.293815 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:47.293815 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:47.293815 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:47.293815 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:47.293815 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:47.293815 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:47.293815 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:47.293815 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:47.293815 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:47.293815 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:36:47.293815 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:47.293815 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 20:36:47.293815 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:47.293815 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 495/983] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Jul 5 20:36:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:36:47.299059 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f732ab2-2a82-4cc1-a27f-64a209fe06d3 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:47.318601 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:47.337158 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:47.378215 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa704cd-e559-402c-b25e-c809a3280534 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:47.412212 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f732ab2-2a82-4cc1-a27f-64a209fe06d3 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:47.416266 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c6106-6ecc-4aff-bd4b-b6e5786b0e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:47.417127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c6106-6ecc-4aff-bd4b-b6e5786b0e97 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:47.417604 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c6106-6ecc-4aff-bd4b-b6e5786b0e97 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:47.418063 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c6106-6ecc-4aff-bd4b-b6e5786b0e97 None admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:47.419003 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c6106-6ecc-4aff-bd4b-b6e5786b0e97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:47.419474 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c6106-6ecc-4aff-bd4b-b6e5786b0e97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:47.420936 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c6106-6ecc-4aff-bd4b-b6e5786b0e97 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:47.438951 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 489/984] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 5 20:36:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:36:47.440006 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c6106-6ecc-4aff-bd4b-b6e5786b0e97 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:47.453355 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7c28d-f7d0-4000-ac2f-e210bb777fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:47.454095 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7c28d-f7d0-4000-ac2f-e210bb777fa1 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:47.454319 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7c28d-f7d0-4000-ac2f-e210bb777fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:47.454596 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7c28d-f7d0-4000-ac2f-e210bb777fa1 None admin] PATH_INFO: `/v3/services` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:47.455294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7c28d-f7d0-4000-ac2f-e210bb777fa1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:47.455596 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7c28d-f7d0-4000-ac2f-e210bb777fa1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:47.456974 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7c28d-f7d0-4000-ac2f-e210bb777fa1 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:47.461976 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 496/985] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Jul 5 20:36:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:36:47.467584 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7c28d-f7d0-4000-ac2f-e210bb777fa1 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:47.547527 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:47.555773 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c6106-6ecc-4aff-bd4b-b6e5786b0e97 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:47.574503 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7c28d-f7d0-4000-ac2f-e210bb777fa1 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:47.584500 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:47.593899 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96552b0d-447d-4c76-9bfb-01d60d510676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:47.594567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96552b0d-447d-4c76-9bfb-01d60d510676 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:47.594849 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96552b0d-447d-4c76-9bfb-01d60d510676 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:47.595123 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96552b0d-447d-4c76-9bfb-01d60d510676 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:47.595953 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96552b0d-447d-4c76-9bfb-01d60d510676 None admin] RBAC: Adding query filter params (role.id=8d9d4dd4ce594ddb9579d0e117ad02e9, scope.project.id=b321588ec1f14bcb94a184310cf72856, user.id=c9647d15389e49e6b7c43ea1b1538a13) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:47.596265 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96552b0d-447d-4c76-9bfb-01d60d510676 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:47.597721 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96552b0d-447d-4c76-9bfb-01d60d510676 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:47.603742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 490/986] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:36:47 2022] GET /identity/v3/role_assignments?user.id=c9647d15389e49e6b7c43ea1b1538a13&scope.project.id=b321588ec1f14bcb94a184310cf72856&role.id=8d9d4dd4ce594ddb9579d0e117ad02e9 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:36:47.630380 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd1ab9-9ca9-4e9a-8707-a03188fa2209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:47.631074 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd1ab9-9ca9-4e9a-8707-a03188fa2209 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:47.631357 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd1ab9-9ca9-4e9a-8707-a03188fa2209 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:47.631632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd1ab9-9ca9-4e9a-8707-a03188fa2209 None admin] PATH_INFO: `/v3/services` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:47.632363 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd1ab9-9ca9-4e9a-8707-a03188fa2209 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:47.632670 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd1ab9-9ca9-4e9a-8707-a03188fa2209 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:47.634118 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd1ab9-9ca9-4e9a-8707-a03188fa2209 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:47.640296 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 497/987] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Jul 5 20:36:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:36:47.646403 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96552b0d-447d-4c76-9bfb-01d60d510676 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:47.769101 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96552b0d-447d-4c76-9bfb-01d60d510676 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:47.810887 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749e5f2-ae8d-484a-a7db-885a88fa7191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:47.811812 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749e5f2-ae8d-484a-a7db-885a88fa7191 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:47.812259 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749e5f2-ae8d-484a-a7db-885a88fa7191 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:47.812673 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749e5f2-ae8d-484a-a7db-885a88fa7191 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:47.813641 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749e5f2-ae8d-484a-a7db-885a88fa7191 None admin] RBAC: Adding query filter params (interface=admin, service_id=abee4d325f3e4953ae3101565cf30327, region_id=RegionOne) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:47.813995 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749e5f2-ae8d-484a-a7db-885a88fa7191 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:47.815381 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749e5f2-ae8d-484a-a7db-885a88fa7191 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:47.821254 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 491/988] 10.222.0.27 () {56 vars in 1249 bytes} [Tue Jul 5 20:36:47 2022] GET /identity/v3/endpoints?service_id=abee4d325f3e4953ae3101565cf30327&interface=admin®ion_id=RegionOne => generated 193 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:47.826959 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd1ab9-9ca9-4e9a-8707-a03188fa2209 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:47.932431 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd1ab9-9ca9-4e9a-8707-a03188fa2209 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:47.965758 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75d9c0-76d6-480f-86a4-8048316000f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:47.966441 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75d9c0-76d6-480f-86a4-8048316000f5 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:47.966718 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75d9c0-76d6-480f-86a4-8048316000f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:47.966989 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75d9c0-76d6-480f-86a4-8048316000f5 None admin] PATH_INFO: `/v3/services` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:47.967666 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd75d9c0-76d6-480f-86a4-8048316000f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:47.969022 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd75d9c0-76d6-480f-86a4-8048316000f5 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:47.981878 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 498/989] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Jul 5 20:36:47 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:36:48.666858 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa1233-cb0c-49ac-880f-0db68b6b53a3 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:48.667283 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa1233-cb0c-49ac-880f-0db68b6b53a3 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:48.667596 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa1233-cb0c-49ac-880f-0db68b6b53a3 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:48.669049 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 492/990] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:48.674752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73dae0-d700-40c8-8a87-b7aee0aab342 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:48.675064 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73dae0-d700-40c8-8a87-b7aee0aab342 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:48.675331 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73dae0-d700-40c8-8a87-b7aee0aab342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:48.683246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:48.696030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-1f73dae0-d700-40c8-8a87-b7aee0aab342 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:48.697227 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-1f73dae0-d700-40c8-8a87-b7aee0aab342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:48.768483 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 499/991] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:36:48.791014 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa1233-cb0c-49ac-880f-0db68b6b53a3 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:48.848940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:48.896587 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa1233-cb0c-49ac-880f-0db68b6b53a3 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:48.932332 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643de098-f11d-4683-965e-6ec81ac8bfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:48.933113 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643de098-f11d-4683-965e-6ec81ac8bfad None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:48.933396 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643de098-f11d-4683-965e-6ec81ac8bfad None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:48.933672 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643de098-f11d-4683-965e-6ec81ac8bfad None admin] PATH_INFO: `/v3/services/compute` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:48.934358 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643de098-f11d-4683-965e-6ec81ac8bfad None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:48.935751 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643de098-f11d-4683-965e-6ec81ac8bfad None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:48.947498 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-643de098-f11d-4683-965e-6ec81ac8bfad None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 20:36:48.947498 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:48.947498 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:36:48.947498 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:36:48.947498 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:36:48.947498 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:36:48.947498 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:36:48.947498 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:48.947498 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 20:36:48.947498 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:48.947498 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:36:48.947498 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:48.947498 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:48.947498 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:48.947498 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:48.947498 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:48.947498 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:48.948788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:48.948788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:48.948788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:48.948788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:48.948788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:48.948788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:48.948788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:36:48.948788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:36:48.948788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:36:48.948788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:36:48.948788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:48.948788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:48.948788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:48.948788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:48.948788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:48.948788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:48.949647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:48.949647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:48.949647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:48.949647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:48.949647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:48.949647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:48.949647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:48.949647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:48.949647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:48.949647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:48.949647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:36:48.949647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:48.949647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 20:36:48.949647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:48.953803 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 493/992] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:36:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:48.955315 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73dae0-d700-40c8-8a87-b7aee0aab342 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:49.064912 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73dae0-d700-40c8-8a87-b7aee0aab342 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:49.101736 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d153b21-558f-4c41-91c5-988245d72853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:49.102508 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d153b21-558f-4c41-91c5-988245d72853 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:49.102788 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d153b21-558f-4c41-91c5-988245d72853 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:49.103056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d153b21-558f-4c41-91c5-988245d72853 None admin] PATH_INFO: `/v3/services` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:49.103770 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d153b21-558f-4c41-91c5-988245d72853 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:49.104079 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d153b21-558f-4c41-91c5-988245d72853 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:49.105488 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d153b21-558f-4c41-91c5-988245d72853 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:49.106635 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:49.112810 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 500/993] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Jul 5 20:36:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:49.117558 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643de098-f11d-4683-965e-6ec81ac8bfad None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:49.232325 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643de098-f11d-4683-965e-6ec81ac8bfad None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:49.250433 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:49.268686 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40235bf-c257-4a49-853b-e44fa12f236c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:49.269416 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40235bf-c257-4a49-853b-e44fa12f236c None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:49.269697 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40235bf-c257-4a49-853b-e44fa12f236c None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:49.270000 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40235bf-c257-4a49-853b-e44fa12f236c None admin] PATH_INFO: `/v3/services` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:49.270697 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40235bf-c257-4a49-853b-e44fa12f236c None admin] RBAC: Adding query filter params (type=compute) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:49.271022 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40235bf-c257-4a49-853b-e44fa12f236c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:49.272397 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40235bf-c257-4a49-853b-e44fa12f236c None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:49.277797 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 494/994] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Jul 5 20:36:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:49.283543 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d153b21-558f-4c41-91c5-988245d72853 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:49.386472 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d153b21-558f-4c41-91c5-988245d72853 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:49.420790 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e41bb-a7c2-44d5-9572-d5b5d5b69ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:49.421444 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e41bb-a7c2-44d5-9572-d5b5d5b69ee5 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:49.421718 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e41bb-a7c2-44d5-9572-d5b5d5b69ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:49.422027 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e41bb-a7c2-44d5-9572-d5b5d5b69ee5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:49.422819 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e41bb-a7c2-44d5-9572-d5b5d5b69ee5 None admin] RBAC: Adding query filter params (interface=public, service_id=4c2f136a6d8b472b8547024209a0614c, region_id=RegionOne) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:49.423128 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e41bb-a7c2-44d5-9572-d5b5d5b69ee5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:49.424852 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e41bb-a7c2-44d5-9572-d5b5d5b69ee5 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:49.430310 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 501/995] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Jul 5 20:36:49 2022] GET /identity/v3/endpoints?service_id=4c2f136a6d8b472b8547024209a0614c&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:49.436419 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40235bf-c257-4a49-853b-e44fa12f236c None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:49.544807 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40235bf-c257-4a49-853b-e44fa12f236c None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:49.580194 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec80f73-cfd6-4056-9769-241f041a9e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:49.580856 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec80f73-cfd6-4056-9769-241f041a9e5e None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:49.581135 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec80f73-cfd6-4056-9769-241f041a9e5e None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:49.581407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec80f73-cfd6-4056-9769-241f041a9e5e None admin] PATH_INFO: `/v3/services` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:49.582110 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec80f73-cfd6-4056-9769-241f041a9e5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:49.583566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec80f73-cfd6-4056-9769-241f041a9e5e None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:49.597927 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 495/996] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Jul 5 20:36:49 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:36:49.650034 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c9c05-5010-4cfe-9c53-cd9402216493 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:49.650327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c9c05-5010-4cfe-9c53-cd9402216493 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:49.650756 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c9c05-5010-4cfe-9c53-cd9402216493 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:49.652495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 502/997] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:49.658157 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c62a3f-6fed-4fba-9888-a9123afa40cc None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:49.658505 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c62a3f-6fed-4fba-9888-a9123afa40cc None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:49.658739 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c62a3f-6fed-4fba-9888-a9123afa40cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:49.677761 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-f4c62a3f-6fed-4fba-9888-a9123afa40cc None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:49.679060 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-f4c62a3f-6fed-4fba-9888-a9123afa40cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:49.729302 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:49.760407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 496/998] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:49 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:36:49.782015 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c9c05-5010-4cfe-9c53-cd9402216493 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:49.849389 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:49.892193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c9c05-5010-4cfe-9c53-cd9402216493 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:49.926932 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04d1c5-d3f8-43de-9527-58b6b7e7d57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:49.927731 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04d1c5-d3f8-43de-9527-58b6b7e7d57e None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:49.928012 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04d1c5-d3f8-43de-9527-58b6b7e7d57e None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:49.928284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04d1c5-d3f8-43de-9527-58b6b7e7d57e None admin] PATH_INFO: `/v3/services/image` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:49.928930 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04d1c5-d3f8-43de-9527-58b6b7e7d57e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:49.930360 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04d1c5-d3f8-43de-9527-58b6b7e7d57e None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:49.941865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-ee04d1c5-d3f8-43de-9527-58b6b7e7d57e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 20:36:49.941865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:49.941865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:36:49.941865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:36:49.941865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:36:49.941865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:36:49.941865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:36:49.941865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:49.941865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 20:36:49.941865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:49.941865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:36:49.941865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:49.941865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:49.941865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:49.941865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:49.941865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:49.941865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:49.942962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:49.942962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:49.942962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:49.942962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:49.942962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:49.942962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:49.942962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:36:49.942962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:36:49.942962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:36:49.942962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:36:49.942962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:49.942962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:49.942962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:49.942962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:49.942962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:49.942962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:49.943822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:49.943822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:49.943822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:49.943822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:49.943822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:49.943822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:49.943822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:49.943822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:49.943822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:49.943822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:49.943822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:36:49.943822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:49.943822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 20:36:49.943822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:49.945189 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 503/999] 10.222.0.27 () {56 vars in 1105 bytes} [Tue Jul 5 20:36:49 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:49.949250 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c62a3f-6fed-4fba-9888-a9123afa40cc None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:50.015920 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3b5e4-29ce-4145-b800-8f1c75b8653b None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:50.016788 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3b5e4-29ce-4145-b800-8f1c75b8653b None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:50.017068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3b5e4-29ce-4145-b800-8f1c75b8653b None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:50.018635 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 504/1000] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:50.023403 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3f57d-7736-4035-a3dd-8ca09c3cfdb2 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:50.023687 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3f57d-7736-4035-a3dd-8ca09c3cfdb2 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:50.023961 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3f57d-7736-4035-a3dd-8ca09c3cfdb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:50.041104 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-6ad3f57d-7736-4035-a3dd-8ca09c3cfdb2 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:50.042356 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-6ad3f57d-7736-4035-a3dd-8ca09c3cfdb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:50.054843 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c62a3f-6fed-4fba-9888-a9123afa40cc None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:50.092197 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d32c0-2748-49d1-a9b8-33a831eae07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:50.092872 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d32c0-2748-49d1-a9b8-33a831eae07d None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:50.093152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d32c0-2748-49d1-a9b8-33a831eae07d None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:50.093673 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d32c0-2748-49d1-a9b8-33a831eae07d None admin] PATH_INFO: `/v3/services` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:50.094150 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d32c0-2748-49d1-a9b8-33a831eae07d None admin] RBAC: Adding query filter params (name=image) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:50.094534 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d32c0-2748-49d1-a9b8-33a831eae07d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:50.095830 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d32c0-2748-49d1-a9b8-33a831eae07d None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:50.101057 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 497/1001] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:50.106608 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d32c0-2748-49d1-a9b8-33a831eae07d None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:50.114943 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 505/1002] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:50 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:36:50.137199 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3f57d-7736-4035-a3dd-8ca09c3cfdb2 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:50.153919 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:50.200104 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:50.215350 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d32c0-2748-49d1-a9b8-33a831eae07d None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:50.248153 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3f57d-7736-4035-a3dd-8ca09c3cfdb2 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:50.251556 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085d908-dff7-43c7-8b05-996a3532772c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:50.252233 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085d908-dff7-43c7-8b05-996a3532772c None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:50.252515 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085d908-dff7-43c7-8b05-996a3532772c None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:50.252789 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085d908-dff7-43c7-8b05-996a3532772c None admin] PATH_INFO: `/v3/services` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:50.253498 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085d908-dff7-43c7-8b05-996a3532772c None admin] RBAC: Adding query filter params (type=image) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:50.253804 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085d908-dff7-43c7-8b05-996a3532772c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:50.255206 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085d908-dff7-43c7-8b05-996a3532772c None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:50.259997 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 498/1003] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:50 2022] GET /identity/v3/services?type=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:36:50.286500 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5129410-9b31-4db0-ac9d-f1094aebc3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:50.287341 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5129410-9b31-4db0-ac9d-f1094aebc3cd None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:50.287621 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5129410-9b31-4db0-ac9d-f1094aebc3cd None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:50.287897 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5129410-9b31-4db0-ac9d-f1094aebc3cd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:50.288572 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5129410-9b31-4db0-ac9d-f1094aebc3cd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:50.290078 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5129410-9b31-4db0-ac9d-f1094aebc3cd None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:50.304030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-b5129410-9b31-4db0-ac9d-f1094aebc3cd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 20:36:50.304030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:50.304030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:36:50.304030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:36:50.304030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:36:50.304030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:36:50.304030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:36:50.304030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:50.304030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 20:36:50.304030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:50.304030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:36:50.304030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:50.304030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:50.304030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:50.304030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:50.304030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:50.304030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:50.305123 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:50.305123 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:50.305123 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:50.305123 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:50.305123 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:50.305123 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:50.305123 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:36:50.305123 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:36:50.305123 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:36:50.305123 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:36:50.305123 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:50.305123 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:50.305123 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:50.305123 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:50.305123 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:50.305123 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:50.306051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:50.306051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:50.306051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:50.306051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:50.306051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:50.306051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:50.306051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:50.306051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:50.306051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:50.306051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:50.306051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:36:50.306051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:50.306051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 05 20:36:50.306051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:50.310279 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 506/1004] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Jul 5 20:36:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:36:50.311701 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085d908-dff7-43c7-8b05-996a3532772c None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:50.421997 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085d908-dff7-43c7-8b05-996a3532772c None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:50.425957 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:50.459554 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9e47a-ce7f-4e9c-9484-d25abd929536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:50.460225 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9e47a-ce7f-4e9c-9484-d25abd929536 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:50.460539 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9e47a-ce7f-4e9c-9484-d25abd929536 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:50.460804 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9e47a-ce7f-4e9c-9484-d25abd929536 None admin] PATH_INFO: `/v3/services` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:50.461506 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9e47a-ce7f-4e9c-9484-d25abd929536 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:50.461810 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9e47a-ce7f-4e9c-9484-d25abd929536 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:50.463213 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9e47a-ce7f-4e9c-9484-d25abd929536 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:50.468318 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 499/1005] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Jul 5 20:36:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:50.473896 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5129410-9b31-4db0-ac9d-f1094aebc3cd None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:50.576548 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5129410-9b31-4db0-ac9d-f1094aebc3cd None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:50.598863 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:50.615167 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94b4c4-8bd0-4045-9ffd-21ffac2d36d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:50.615838 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94b4c4-8bd0-4045-9ffd-21ffac2d36d5 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:50.616120 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94b4c4-8bd0-4045-9ffd-21ffac2d36d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:50.616395 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94b4c4-8bd0-4045-9ffd-21ffac2d36d5 None admin] PATH_INFO: `/v3/services` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:50.617100 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94b4c4-8bd0-4045-9ffd-21ffac2d36d5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:50.617400 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94b4c4-8bd0-4045-9ffd-21ffac2d36d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:50.618816 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94b4c4-8bd0-4045-9ffd-21ffac2d36d5 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:50.624198 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 507/1006] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Jul 5 20:36:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:50.629753 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9e47a-ce7f-4e9c-9484-d25abd929536 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:50.741340 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9e47a-ce7f-4e9c-9484-d25abd929536 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:50.777391 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5b831-d7be-42da-b061-6ebb8b74d691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:50.778081 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5b831-d7be-42da-b061-6ebb8b74d691 None admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:50.778358 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5b831-d7be-42da-b061-6ebb8b74d691 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:50.778628 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5b831-d7be-42da-b061-6ebb8b74d691 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:50.779375 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5b831-d7be-42da-b061-6ebb8b74d691 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:50.780755 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5b831-d7be-42da-b061-6ebb8b74d691 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:50.805885 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 500/1007] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Jul 5 20:36:50 2022] POST /identity/v3/endpoints => generated 325 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:36:51.620839 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3843b9b-2f02-4a7c-ba9c-345233ad7c04 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:51.621381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3843b9b-2f02-4a7c-ba9c-345233ad7c04 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:51.621381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3843b9b-2f02-4a7c-ba9c-345233ad7c04 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:51.622805 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 508/1008] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:51.628256 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966110c7-2815-4b83-afc5-d99ca10d244f None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:51.628684 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966110c7-2815-4b83-afc5-d99ca10d244f None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:51.628852 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966110c7-2815-4b83-afc5-d99ca10d244f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:51.646280 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-966110c7-2815-4b83-afc5-d99ca10d244f None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:51.647456 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-966110c7-2815-4b83-afc5-d99ca10d244f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:51.671377 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:51.724918 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 501/1009] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:51 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:36:51.747310 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3843b9b-2f02-4a7c-ba9c-345233ad7c04 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:51.852072 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3843b9b-2f02-4a7c-ba9c-345233ad7c04 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:51.887248 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26f3bd-87ce-47b0-a214-add5caeceab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:51.887972 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26f3bd-87ce-47b0-a214-add5caeceab4 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:51.888251 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26f3bd-87ce-47b0-a214-add5caeceab4 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:51.888524 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26f3bd-87ce-47b0-a214-add5caeceab4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:51.889174 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d26f3bd-87ce-47b0-a214-add5caeceab4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:51.890593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d26f3bd-87ce-47b0-a214-add5caeceab4 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:51.903775 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-7d26f3bd-87ce-47b0-a214-add5caeceab4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 20:36:51.903775 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:51.903775 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:36:51.903775 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:36:51.903775 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:36:51.903775 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:36:51.903775 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:36:51.903775 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:51.903775 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 20:36:51.903775 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:51.903775 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:36:51.903775 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:51.903775 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:51.903775 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:51.903775 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:51.903775 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:51.903775 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:51.905033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:51.905033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:51.905033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:51.905033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:51.905033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:51.905033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:51.905033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:36:51.905033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:36:51.905033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:36:51.905033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:36:51.905033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:51.905033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:51.905033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:51.905033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:51.905033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:51.905033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:51.906141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:51.906141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:51.906141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:51.906141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:51.906141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:51.906141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:51.906141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:51.906141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:51.906141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:51.906141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:51.906141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:36:51.906141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:51.906141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 05 20:36:51.906141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:51.911256 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966110c7-2815-4b83-afc5-d99ca10d244f None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:51.913358 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 509/1010] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:36:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:52.015411 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966110c7-2815-4b83-afc5-d99ca10d244f None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:52.050272 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9eea3e-3ce5-4d3e-9ccb-2de50b857bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:52.050947 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9eea3e-3ce5-4d3e-9ccb-2de50b857bff None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:52.051225 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9eea3e-3ce5-4d3e-9ccb-2de50b857bff None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:52.051495 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9eea3e-3ce5-4d3e-9ccb-2de50b857bff None admin] PATH_INFO: `/v3/services` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:52.052210 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9eea3e-3ce5-4d3e-9ccb-2de50b857bff None admin] RBAC: Adding query filter params (name=compute) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:52.052514 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9eea3e-3ce5-4d3e-9ccb-2de50b857bff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:52.053920 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9eea3e-3ce5-4d3e-9ccb-2de50b857bff None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:52.059117 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 502/1011] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Jul 5 20:36:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:52.064803 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26f3bd-87ce-47b0-a214-add5caeceab4 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:52.115372 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:52.177371 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26f3bd-87ce-47b0-a214-add5caeceab4 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:52.211159 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a3e19-4da3-4808-8cb8-82adbd763e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:52.211823 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a3e19-4da3-4808-8cb8-82adbd763e17 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:52.212100 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a3e19-4da3-4808-8cb8-82adbd763e17 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:52.212372 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a3e19-4da3-4808-8cb8-82adbd763e17 None admin] PATH_INFO: `/v3/services` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:52.213076 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a3e19-4da3-4808-8cb8-82adbd763e17 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:52.213378 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a3e19-4da3-4808-8cb8-82adbd763e17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:52.214851 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a3e19-4da3-4808-8cb8-82adbd763e17 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:52.220004 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 510/1012] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Jul 5 20:36:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:52.225513 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9eea3e-3ce5-4d3e-9ccb-2de50b857bff None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:52.244956 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:52.288760 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73b659-3f24-4404-95d4-5ecaf03c1fcc None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:52.289076 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73b659-3f24-4404-95d4-5ecaf03c1fcc None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:52.289359 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73b659-3f24-4404-95d4-5ecaf03c1fcc None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:52.290905 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 511/1013] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:52.296890 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544ffd8-a2a1-46e3-801f-982f7e06291a None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:52.297161 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544ffd8-a2a1-46e3-801f-982f7e06291a None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:52.297432 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544ffd8-a2a1-46e3-801f-982f7e06291a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:52.314343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-6544ffd8-a2a1-46e3-801f-982f7e06291a None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:52.315538 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-6544ffd8-a2a1-46e3-801f-982f7e06291a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:52.332266 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9eea3e-3ce5-4d3e-9ccb-2de50b857bff None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:52.367004 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103762c-79e4-489c-912c-4f62853c1815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:52.367672 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103762c-79e4-489c-912c-4f62853c1815 None admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:52.367958 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103762c-79e4-489c-912c-4f62853c1815 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:52.368228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103762c-79e4-489c-912c-4f62853c1815 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:52.368986 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103762c-79e4-489c-912c-4f62853c1815 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:52.370454 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103762c-79e4-489c-912c-4f62853c1815 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:52.382734 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 512/1014] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:52 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 20:36:52.389967 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 503/1015] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Jul 5 20:36:52 2022] POST /identity/v3/endpoints => generated 334 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:36:52.406087 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544ffd8-a2a1-46e3-801f-982f7e06291a None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:52.455589 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:52.518837 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544ffd8-a2a1-46e3-801f-982f7e06291a None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:52.565075 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4caf58-b3e3-4f7c-bc70-7b4129842070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:52.566609 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4caf58-b3e3-4f7c-bc70-7b4129842070 None admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:52.566609 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4caf58-b3e3-4f7c-bc70-7b4129842070 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:52.566609 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4caf58-b3e3-4f7c-bc70-7b4129842070 None admin] PATH_INFO: `/v3/services` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:52.567059 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4caf58-b3e3-4f7c-bc70-7b4129842070 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:52.569002 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4caf58-b3e3-4f7c-bc70-7b4129842070 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:52.586159 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 513/1016] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Jul 5 20:36:52 2022] POST /identity/v3/services => generated 242 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:36:52.829308 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b48e8-cc82-4256-8746-baa2cf5c2664 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:52.829867 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b48e8-cc82-4256-8746-baa2cf5c2664 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:52.829867 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b48e8-cc82-4256-8746-baa2cf5c2664 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:52.831428 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 504/1017] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:52.836686 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c20f8-6016-46cd-8d80-1fe077344349 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:52.837137 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c20f8-6016-46cd-8d80-1fe077344349 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:52.837216 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c20f8-6016-46cd-8d80-1fe077344349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:52.854570 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-ba0c20f8-6016-46cd-8d80-1fe077344349 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:52.855655 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-ba0c20f8-6016-46cd-8d80-1fe077344349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:52.934919 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 514/1018] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:36:52.957876 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b48e8-cc82-4256-8746-baa2cf5c2664 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:53.039456 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:53.072696 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b48e8-cc82-4256-8746-baa2cf5c2664 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:53.108425 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2db4b9-f3a6-485c-a110-9f5c2fb2724a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:53.109456 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2db4b9-f3a6-485c-a110-9f5c2fb2724a None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:53.109981 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2db4b9-f3a6-485c-a110-9f5c2fb2724a None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:53.110422 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2db4b9-f3a6-485c-a110-9f5c2fb2724a None admin] PATH_INFO: `/v3/domains/default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:53.111785 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2db4b9-f3a6-485c-a110-9f5c2fb2724a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:53.113410 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2db4b9-f3a6-485c-a110-9f5c2fb2724a None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:53.115280 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 505/1019] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:53.121346 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c20f8-6016-46cd-8d80-1fe077344349 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:53.147213 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:53.225503 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c20f8-6016-46cd-8d80-1fe077344349 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:53.261753 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109b59e-a32f-4b92-b768-96d8bd4c6a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:53.262444 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109b59e-a32f-4b92-b768-96d8bd4c6a22 None admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:53.262724 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109b59e-a32f-4b92-b768-96d8bd4c6a22 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:53.262997 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109b59e-a32f-4b92-b768-96d8bd4c6a22 None admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:53.263707 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109b59e-a32f-4b92-b768-96d8bd4c6a22 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:53.265145 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109b59e-a32f-4b92-b768-96d8bd4c6a22 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:53.302336 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 515/1020] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Jul 5 20:36:53 2022] POST /identity/v3/projects => generated 311 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:36:54.541465 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596689dc-83b6-4dc1-9dd2-59890b5bfe7f None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:54.542009 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596689dc-83b6-4dc1-9dd2-59890b5bfe7f None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:54.542009 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596689dc-83b6-4dc1-9dd2-59890b5bfe7f None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:54.543537 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 506/1021] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:54.548666 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e6d7a-0725-4d88-ba30-2ff680a7eea7 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:54.549080 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e6d7a-0725-4d88-ba30-2ff680a7eea7 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:54.549157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e6d7a-0725-4d88-ba30-2ff680a7eea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:54.566722 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-e40e6d7a-0725-4d88-ba30-2ff680a7eea7 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:54.567900 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-e40e6d7a-0725-4d88-ba30-2ff680a7eea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:54.601490 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7abd62-364d-470f-baf5-4877f528c422 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:54.601753 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7abd62-364d-470f-baf5-4877f528c422 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:54.602237 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7abd62-364d-470f-baf5-4877f528c422 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:54.603801 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 507/1022] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:36:54.608640 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31732a-2d3a-4592-931c-f603cf0fc76d None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:54.609106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31732a-2d3a-4592-931c-f603cf0fc76d None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:54.609551 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31732a-2d3a-4592-931c-f603cf0fc76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:54.626802 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-3a31732a-2d3a-4592-931c-f603cf0fc76d None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:54.628248 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-3a31732a-2d3a-4592-931c-f603cf0fc76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:54.640270 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 516/1023] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 20:36:54.663159 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e6d7a-0725-4d88-ba30-2ff680a7eea7 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:54.671406 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:54.706451 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 508/1024] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 20:36:54.728789 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31732a-2d3a-4592-931c-f603cf0fc76d None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:54.770276 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e6d7a-0725-4d88-ba30-2ff680a7eea7 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:54.806750 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:54.809117 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09344447-dbb2-4f54-99cc-2d4b73394615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:54.810034 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09344447-dbb2-4f54-99cc-2d4b73394615 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:54.810346 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09344447-dbb2-4f54-99cc-2d4b73394615 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:54.810717 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09344447-dbb2-4f54-99cc-2d4b73394615 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:54.820943 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09344447-dbb2-4f54-99cc-2d4b73394615 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:36:54.829012 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-09344447-dbb2-4f54-99cc-2d4b73394615 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 20:36:54.829012 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:54.829012 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:54.829012 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:54.829012 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:54.829012 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:54.829012 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:54.829012 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:54.829012 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:54.829012 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:54.829012 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:54.829012 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:54.829012 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:36:54.829012 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:36:54.829012 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:36:54.829012 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:36:54.830049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:36:54.830049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:36:54.830049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:36:54.830049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:36:54.830049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:54.830049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:54.830049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:54.830049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:54.830049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:54.830049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:54.830049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:54.830049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:54.830049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:54.830049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:54.830049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:54.830049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:54.830934 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:54.830934 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:54.830934 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:54.830934 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:54.830934 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:36:54.830934 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:36:54.830934 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:36:54.830934 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:36:54.830934 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:36:54.830934 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:36:54.830934 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 20:36:54.830934 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:54.830934 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 517/1025] 10.222.0.27 () {56 vars in 1120 bytes} [Tue Jul 5 20:36:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:54.836776 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09344447-dbb2-4f54-99cc-2d4b73394615 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:54.841655 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31732a-2d3a-4592-931c-f603cf0fc76d None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:54.877568 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c027268-79b8-4502-b4b8-ff485b3212cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:54.878413 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c027268-79b8-4502-b4b8-ff485b3212cf None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:54.878687 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c027268-79b8-4502-b4b8-ff485b3212cf None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:54.878957 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c027268-79b8-4502-b4b8-ff485b3212cf None admin] PATH_INFO: `/v3/services/image` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:54.879716 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c027268-79b8-4502-b4b8-ff485b3212cf None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:54.881190 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c027268-79b8-4502-b4b8-ff485b3212cf None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:54.893650 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-2c027268-79b8-4502-b4b8-ff485b3212cf None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 20:36:54.893650 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:54.893650 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:36:54.893650 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:36:54.893650 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:36:54.893650 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:36:54.893650 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:36:54.893650 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:54.893650 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 20:36:54.893650 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:54.893650 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:36:54.893650 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:54.893650 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:54.893650 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:54.893650 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:54.893650 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:54.893650 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:54.894921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:54.894921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:54.894921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:54.894921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:54.894921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:54.894921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:54.894921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:36:54.894921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:36:54.894921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:36:54.894921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:36:54.894921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:54.894921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:54.894921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:54.894921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:54.894921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:54.894921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:54.896043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:54.896043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:54.896043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:54.896043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:54.896043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:54.896043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:54.896043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:54.896043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:54.896043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:54.896043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:54.896043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:36:54.896043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:54.896043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 20:36:54.896043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:54.899516 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 509/1026] 10.222.0.27 () {56 vars in 1105 bytes} [Tue Jul 5 20:36:54 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:36:54.901114 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c027268-79b8-4502-b4b8-ff485b3212cf None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:54.906940 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:54.943626 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09344447-dbb2-4f54-99cc-2d4b73394615 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:54.977523 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182da01e-8387-4124-a3d0-96d30bd40faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:54.978271 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182da01e-8387-4124-a3d0-96d30bd40faa None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:54.978552 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182da01e-8387-4124-a3d0-96d30bd40faa None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:54.978820 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182da01e-8387-4124-a3d0-96d30bd40faa None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:54.979603 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182da01e-8387-4124-a3d0-96d30bd40faa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:54.979903 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182da01e-8387-4124-a3d0-96d30bd40faa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:54.981263 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182da01e-8387-4124-a3d0-96d30bd40faa None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:54.989814 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 518/1027] 10.222.0.27 () {56 vars in 1115 bytes} [Tue Jul 5 20:36:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:36:54.995596 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182da01e-8387-4124-a3d0-96d30bd40faa None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:55.009948 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c027268-79b8-4502-b4b8-ff485b3212cf None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:55.050139 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ccffd-457d-40e0-b605-2e0a061e3de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:55.051122 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ccffd-457d-40e0-b605-2e0a061e3de9 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:55.051597 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ccffd-457d-40e0-b605-2e0a061e3de9 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:55.052053 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ccffd-457d-40e0-b605-2e0a061e3de9 None admin] PATH_INFO: `/v3/services` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:55.052830 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ccffd-457d-40e0-b605-2e0a061e3de9 None admin] RBAC: Adding query filter params (name=image) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:55.053199 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ccffd-457d-40e0-b605-2e0a061e3de9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:55.054708 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ccffd-457d-40e0-b605-2e0a061e3de9 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:55.056497 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:55.069137 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 510/1028] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:36:55.069743 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ccffd-457d-40e0-b605-2e0a061e3de9 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:55.097543 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182da01e-8387-4124-a3d0-96d30bd40faa None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:55.124223 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:55.133242 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1166cf-f79e-40b9-b0c5-00f94e10bd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:55.134119 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1166cf-f79e-40b9-b0c5-00f94e10bd07 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:55.134396 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1166cf-f79e-40b9-b0c5-00f94e10bd07 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:55.134706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1166cf-f79e-40b9-b0c5-00f94e10bd07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:55.147282 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1166cf-f79e-40b9-b0c5-00f94e10bd07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:55.149920 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1166cf-f79e-40b9-b0c5-00f94e10bd07 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:55.166465 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-8f1166cf-f79e-40b9-b0c5-00f94e10bd07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:55.166465 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:55.166465 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:55.166465 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:55.166465 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:55.166465 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:55.166465 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:55.166465 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:55.166465 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:55.166465 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:55.166465 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:55.166465 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:55.166465 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:55.166465 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:55.166465 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:55.167469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:55.167469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:55.167469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:55.167469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:55.167469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:55.167469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:55.167469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:55.167469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:55.167469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:55.167469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:55.167469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:55.167469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:55.167469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:55.167469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:55.167469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:55.167469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:55.167469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:55.168367 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:55.168367 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:55.168367 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:55.168367 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:55.168367 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 519/1029] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:36:55.173423 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1166cf-f79e-40b9-b0c5-00f94e10bd07 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:55.182256 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ccffd-457d-40e0-b605-2e0a061e3de9 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:55.221344 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20ef0b-f1b4-4b28-b21f-586594c73288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:55.222194 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20ef0b-f1b4-4b28-b21f-586594c73288 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:55.222474 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20ef0b-f1b4-4b28-b21f-586594c73288 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:55.223069 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20ef0b-f1b4-4b28-b21f-586594c73288 None admin] PATH_INFO: `/v3/services` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:55.223787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20ef0b-f1b4-4b28-b21f-586594c73288 None admin] RBAC: Adding query filter params (type=image) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:55.224101 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20ef0b-f1b4-4b28-b21f-586594c73288 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:55.225477 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20ef0b-f1b4-4b28-b21f-586594c73288 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:55.230550 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 511/1030] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:36:55.236338 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20ef0b-f1b4-4b28-b21f-586594c73288 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:55.284591 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1166cf-f79e-40b9-b0c5-00f94e10bd07 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:55.301321 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:55.323414 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde312e-217f-4177-9683-0e9a579e8302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:55.324078 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde312e-217f-4177-9683-0e9a579e8302 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:55.324274 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde312e-217f-4177-9683-0e9a579e8302 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:55.324548 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde312e-217f-4177-9683-0e9a579e8302 None admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:55.325284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde312e-217f-4177-9683-0e9a579e8302 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:55.325571 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde312e-217f-4177-9683-0e9a579e8302 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:55.327011 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde312e-217f-4177-9683-0e9a579e8302 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:55.343683 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 520/1031] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:36:55.343683 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f865d5a-4f79-4ae0-a684-fe0aff2143ca None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:55.343683 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f865d5a-4f79-4ae0-a684-fe0aff2143ca None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:55.343683 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f865d5a-4f79-4ae0-a684-fe0aff2143ca None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:55.343683 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 521/1032] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:55.344555 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f865d5a-4f79-4ae0-a684-fe0aff2143ca None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:55.347253 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20ef0b-f1b4-4b28-b21f-586594c73288 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:55.388379 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:55.388965 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37786502-7aa1-427f-a3ce-234b5ba88a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:55.389652 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37786502-7aa1-427f-a3ce-234b5ba88a84 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:55.389945 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37786502-7aa1-427f-a3ce-234b5ba88a84 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:55.390218 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37786502-7aa1-427f-a3ce-234b5ba88a84 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:55.391012 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37786502-7aa1-427f-a3ce-234b5ba88a84 None admin] RBAC: Adding query filter params (interface=public, service_id=8e8d0e737ab543ea9ce891d9c456a0de, region_id=RegionOne) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:55.391313 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37786502-7aa1-427f-a3ce-234b5ba88a84 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:55.392692 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37786502-7aa1-427f-a3ce-234b5ba88a84 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:55.402352 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 512/1033] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Jul 5 20:36:55 2022] GET /identity/v3/endpoints?service_id=8e8d0e737ab543ea9ce891d9c456a0de&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:36:55.402352 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61866d-ddb3-4738-9b4d-4bd7bba7ae9a None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:55.402352 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61866d-ddb3-4738-9b4d-4bd7bba7ae9a None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:55.402352 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61866d-ddb3-4738-9b4d-4bd7bba7ae9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:55.415529 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-dd61866d-ddb3-4738-9b4d-4bd7bba7ae9a None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:55.416728 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-dd61866d-ddb3-4738-9b4d-4bd7bba7ae9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:55.448810 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f865d5a-4f79-4ae0-a684-fe0aff2143ca None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:55.481729 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 513/1034] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:36:55.482687 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6832ec-b8a3-4ba1-9ce9-7dd14a6f9ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:55.482902 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61866d-ddb3-4738-9b4d-4bd7bba7ae9a None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:55.483478 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6832ec-b8a3-4ba1-9ce9-7dd14a6f9ca8 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:55.483753 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6832ec-b8a3-4ba1-9ce9-7dd14a6f9ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:55.484031 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6832ec-b8a3-4ba1-9ce9-7dd14a6f9ca8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:55.496131 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6832ec-b8a3-4ba1-9ce9-7dd14a6f9ca8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:55.498497 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6832ec-b8a3-4ba1-9ce9-7dd14a6f9ca8 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:55.517053 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-2d6832ec-b8a3-4ba1-9ce9-7dd14a6f9ca8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 20:36:55.517053 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:55.517053 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:55.517053 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:55.517053 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:55.517053 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:55.517053 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:55.517053 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:55.517053 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:55.517053 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:55.517053 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:55.517053 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:55.517053 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:36:55.517053 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:36:55.517053 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:36:55.517053 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:36:55.518181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:55.518181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:55.518181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:36:55.518181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:55.518181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:36:55.518181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:55.518181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:55.518181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:55.518181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:55.518181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:55.518181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:55.518181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:55.518181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:55.518181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:55.518181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:55.518181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:55.518181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:55.518181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:55.519148 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:55.519148 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:55.519148 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:36:55.519148 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:36:55.519148 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:36:55.519148 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:36:55.519148 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:36:55.519148 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:36:55.519148 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 20:36:55.519148 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:55.519148 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 522/1035] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Jul 5 20:36:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:55.519148 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6832ec-b8a3-4ba1-9ce9-7dd14a6f9ca8 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:55.546817 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:55.589109 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61866d-ddb3-4738-9b4d-4bd7bba7ae9a None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:55.618084 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:55.621582 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6832ec-b8a3-4ba1-9ce9-7dd14a6f9ca8 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:55.622192 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02330a-cb82-40ff-baa0-540c2458308e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:55.622859 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02330a-cb82-40ff-baa0-540c2458308e None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:55.623136 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02330a-cb82-40ff-baa0-540c2458308e None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:55.623409 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02330a-cb82-40ff-baa0-540c2458308e None admin] PATH_INFO: `/v3/services` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:55.624082 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02330a-cb82-40ff-baa0-540c2458308e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:55.625449 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02330a-cb82-40ff-baa0-540c2458308e None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:55.631903 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 514/1036] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Jul 5 20:36:55 2022] GET /identity/v3/services => generated 1957 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:36:55.632660 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02330a-cb82-40ff-baa0-540c2458308e None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:55.658382 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1620e3bf-5bc1-46a3-9302-575c4dec6c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:55.659262 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620e3bf-5bc1-46a3-9302-575c4dec6c8d None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:55.659566 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620e3bf-5bc1-46a3-9302-575c4dec6c8d None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:55.659842 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620e3bf-5bc1-46a3-9302-575c4dec6c8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:55.661117 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1620e3bf-5bc1-46a3-9302-575c4dec6c8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:55.662630 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1620e3bf-5bc1-46a3-9302-575c4dec6c8d None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:55.664349 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 523/1037] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:55.670609 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1620e3bf-5bc1-46a3-9302-575c4dec6c8d None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:55.759257 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02330a-cb82-40ff-baa0-540c2458308e None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:55.782906 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1620e3bf-5bc1-46a3-9302-575c4dec6c8d None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:55.785720 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:55.801225 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba86ccb-78cb-4ae7-8d33-8469e4feb20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:55.802191 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba86ccb-78cb-4ae7-8d33-8469e4feb20b None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:55.802299 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba86ccb-78cb-4ae7-8d33-8469e4feb20b None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:55.802564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba86ccb-78cb-4ae7-8d33-8469e4feb20b None admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:55.803416 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba86ccb-78cb-4ae7-8d33-8469e4feb20b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:55.803726 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba86ccb-78cb-4ae7-8d33-8469e4feb20b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:55.805170 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba86ccb-78cb-4ae7-8d33-8469e4feb20b None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:55.823370 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 515/1038] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Jul 5 20:36:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:55.826591 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e401c-1a5f-478d-bf01-12bfce32caae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:55.827278 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e401c-1a5f-478d-bf01-12bfce32caae None admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:55.827561 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e401c-1a5f-478d-bf01-12bfce32caae None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:55.827839 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e401c-1a5f-478d-bf01-12bfce32caae None admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:55.828641 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e401c-1a5f-478d-bf01-12bfce32caae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:55.829067 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba86ccb-78cb-4ae7-8d33-8469e4feb20b None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:55.830108 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e401c-1a5f-478d-bf01-12bfce32caae None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:55.858871 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 524/1039] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Jul 5 20:36:55 2022] POST /identity/v3/users => generated 285 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:36:55.942182 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba86ccb-78cb-4ae7-8d33-8469e4feb20b None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:55.980417 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab9c2f-9607-47ac-9d25-e504fca751a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:55.981088 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab9c2f-9607-47ac-9d25-e504fca751a6 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:55.981365 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab9c2f-9607-47ac-9d25-e504fca751a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:55.981635 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab9c2f-9607-47ac-9d25-e504fca751a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:56.034560 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:56.055814 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab9c2f-9607-47ac-9d25-e504fca751a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:56.057338 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab9c2f-9607-47ac-9d25-e504fca751a6 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:56.165160 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 516/1040] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:36:55 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 05 20:36:56.170874 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e401c-1a5f-478d-bf01-12bfce32caae None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:56.197087 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:56.272166 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e401c-1a5f-478d-bf01-12bfce32caae None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:56.308824 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2bf046-7d84-4705-a458-c2b40373b945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:56.309626 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2bf046-7d84-4705-a458-c2b40373b945 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:56.309932 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2bf046-7d84-4705-a458-c2b40373b945 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:56.310205 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2bf046-7d84-4705-a458-c2b40373b945 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:56.321227 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2bf046-7d84-4705-a458-c2b40373b945 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:56.322711 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2bf046-7d84-4705-a458-c2b40373b945 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:56.340003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-2a2bf046-7d84-4705-a458-c2b40373b945 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:56.340003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:56.340003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:56.340003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:56.340003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:56.340003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:56.340003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:56.340003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:56.340003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:56.340003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:56.340003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:56.340003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:56.340003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:56.340003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:56.340003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:56.340950 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:56.340950 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:56.340950 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:56.340950 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:56.340950 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:56.340950 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:56.340950 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:56.340950 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:56.340950 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:56.340950 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:56.340950 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:56.340950 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:56.340950 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:56.340950 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:56.340950 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:56.340950 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:56.340950 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:56.342336 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:56.342336 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:56.342336 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:56.342336 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:56.345727 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 525/1041] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:56.346977 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab9c2f-9607-47ac-9d25-e504fca751a6 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:56.434232 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:56.454334 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab9c2f-9607-47ac-9d25-e504fca751a6 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:56.488875 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebce03-a46b-446b-9f1b-d8f3bf18352d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:56.489538 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebce03-a46b-446b-9f1b-d8f3bf18352d None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:56.489812 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebce03-a46b-446b-9f1b-d8f3bf18352d None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:56.490113 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebce03-a46b-446b-9f1b-d8f3bf18352d None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:56.490827 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ebce03-a46b-446b-9f1b-d8f3bf18352d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:56.491127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ebce03-a46b-446b-9f1b-d8f3bf18352d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:56.492587 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ebce03-a46b-446b-9f1b-d8f3bf18352d None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:56.504059 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 517/1042] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:36:56.509446 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2bf046-7d84-4705-a458-c2b40373b945 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:56.588761 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:56.612996 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2bf046-7d84-4705-a458-c2b40373b945 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:56.646558 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ad4c0-be6a-469d-9a53-accd6ac39aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:56.647345 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ad4c0-be6a-469d-9a53-accd6ac39aaa None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:56.647659 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ad4c0-be6a-469d-9a53-accd6ac39aaa None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:56.647925 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ad4c0-be6a-469d-9a53-accd6ac39aaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:56.654853 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ad4c0-be6a-469d-9a53-accd6ac39aaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:56.656362 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ad4c0-be6a-469d-9a53-accd6ac39aaa None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:56.670661 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-ef7ad4c0-be6a-469d-9a53-accd6ac39aaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:56.670661 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:56.670661 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:56.670661 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:56.670661 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:56.670661 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:56.670661 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:56.670661 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:56.670661 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:56.670661 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:56.670661 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:56.670661 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:56.670661 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:36:56.670661 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:36:56.670661 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:36:56.671613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:36:56.671613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:56.671613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:56.671613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:56.671613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:56.671613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:56.671613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:56.671613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:56.671613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:56.671613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:56.671613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:56.671613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:56.671613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:56.671613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:56.671613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:56.671613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:56.671613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:56.672549 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:36:56.672549 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:36:56.672549 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:36:56.672549 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:36:56.672549 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:36:56.672549 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:36:56.672549 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:36:56.672549 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:56.672549 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 526/1043] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:36:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:36:56.679367 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebce03-a46b-446b-9f1b-d8f3bf18352d None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:56.789369 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebce03-a46b-446b-9f1b-d8f3bf18352d None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:56.824998 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431a59d-7953-460c-8623-17eb0d7de546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:56.825656 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431a59d-7953-460c-8623-17eb0d7de546 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:56.825959 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431a59d-7953-460c-8623-17eb0d7de546 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:56.826233 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431a59d-7953-460c-8623-17eb0d7de546 None admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:56.827013 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431a59d-7953-460c-8623-17eb0d7de546 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:56.827321 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431a59d-7953-460c-8623-17eb0d7de546 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:56.828759 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431a59d-7953-460c-8623-17eb0d7de546 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:56.837905 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:56.848499 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ad4c0-be6a-469d-9a53-accd6ac39aaa None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:56.849475 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 518/1044] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 5 20:36:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:56.954053 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ad4c0-be6a-469d-9a53-accd6ac39aaa None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:56.989033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f202f09a-56d1-4896-b837-eef4d41d01a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:56.989685 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202f09a-56d1-4896-b837-eef4d41d01a7 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:56.989999 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202f09a-56d1-4896-b837-eef4d41d01a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:56.990271 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f202f09a-56d1-4896-b837-eef4d41d01a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:56.991093 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f202f09a-56d1-4896-b837-eef4d41d01a7 None admin] RBAC: Adding query filter params (role.id=8d9d4dd4ce594ddb9579d0e117ad02e9, scope.project.id=b321588ec1f14bcb94a184310cf72856, user.id=814b675b98b844a2a12a39890ee69d2b) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:56.991400 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f202f09a-56d1-4896-b837-eef4d41d01a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:56.992896 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f202f09a-56d1-4896-b837-eef4d41d01a7 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:56.995873 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:57.005933 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 527/1045] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:36:56 2022] GET /identity/v3/role_assignments?user.id=814b675b98b844a2a12a39890ee69d2b&scope.project.id=b321588ec1f14bcb94a184310cf72856&role.id=8d9d4dd4ce594ddb9579d0e117ad02e9 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:36:57.693072 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2082f-b281-4900-b01b-db33ff39ac1f None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:57.693631 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2082f-b281-4900-b01b-db33ff39ac1f None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:57.693631 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2082f-b281-4900-b01b-db33ff39ac1f None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:57.695013 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 519/1046] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:57.700528 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae845cc4-ab4c-4a24-ac4a-cefa5719fe85 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:57.700950 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae845cc4-ab4c-4a24-ac4a-cefa5719fe85 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:57.701141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae845cc4-ab4c-4a24-ac4a-cefa5719fe85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:57.719205 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-ae845cc4-ab4c-4a24-ac4a-cefa5719fe85 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:57.720405 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-ae845cc4-ab4c-4a24-ac4a-cefa5719fe85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:57.792084 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 528/1047] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:36:57.814765 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2082f-b281-4900-b01b-db33ff39ac1f None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:57.919489 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2082f-b281-4900-b01b-db33ff39ac1f None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:57.930805 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141be11-7d59-47d1-8890-1a67e4118c4b None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:57.931096 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141be11-7d59-47d1-8890-1a67e4118c4b None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:57.931380 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141be11-7d59-47d1-8890-1a67e4118c4b None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:57.932965 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 529/1048] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:36:57.937670 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a434ad-24f0-4668-83a4-1b49fdd120b3 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:57.938008 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a434ad-24f0-4668-83a4-1b49fdd120b3 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:57.938290 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a434ad-24f0-4668-83a4-1b49fdd120b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:57.955068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-e1a434ad-24f0-4668-83a4-1b49fdd120b3 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:57.956535 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-e1a434ad-24f0-4668-83a4-1b49fdd120b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:57.956969 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc2e25-8d83-4177-92ae-56657af59b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:57.958126 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc2e25-8d83-4177-92ae-56657af59b34 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:57.958530 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc2e25-8d83-4177-92ae-56657af59b34 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:57.958956 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc2e25-8d83-4177-92ae-56657af59b34 None admin] PATH_INFO: `/v3/services/image` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:57.960070 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc2e25-8d83-4177-92ae-56657af59b34 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:57.962173 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc2e25-8d83-4177-92ae-56657af59b34 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:57.974291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-c9dc2e25-8d83-4177-92ae-56657af59b34 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 20:36:57.974291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:57.974291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:36:57.974291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:36:57.974291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:36:57.974291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:36:57.974291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:36:57.974291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:57.974291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 20:36:57.974291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:57.974291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:36:57.974291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:57.974291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:57.974291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:57.974291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:57.974291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:57.974291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:57.975305 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:57.975305 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:57.975305 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:57.975305 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:57.975305 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:57.975305 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:57.975305 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:36:57.975305 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:36:57.975305 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:36:57.975305 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:36:57.975305 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:57.975305 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:57.975305 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:57.975305 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:57.975305 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:57.975305 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:57.976152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:57.976152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:57.976152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:57.976152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:57.976152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:57.976152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:57.976152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:57.976152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:57.976152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:57.976152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:57.976152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:36:57.976152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:36:57.976152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 05 20:36:57.976152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:36:57.976152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 520/1049] 10.222.0.27 () {56 vars in 1105 bytes} [Tue Jul 5 20:36:57 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:57.981503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc2e25-8d83-4177-92ae-56657af59b34 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:58.031458 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 530/1050] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 20:36:58.041984 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:58.055637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a434ad-24f0-4668-83a4-1b49fdd120b3 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:58.084509 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc2e25-8d83-4177-92ae-56657af59b34 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:58.118572 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:58.124029 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c3838-6a62-4632-b9c1-301570bacd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:58.124740 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c3838-6a62-4632-b9c1-301570bacd5b None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:58.125138 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c3838-6a62-4632-b9c1-301570bacd5b None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:58.125655 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c3838-6a62-4632-b9c1-301570bacd5b None admin] PATH_INFO: `/v3/services` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:58.126809 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5c3838-6a62-4632-b9c1-301570bacd5b None admin] RBAC: Adding query filter params (name=image) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:58.127116 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5c3838-6a62-4632-b9c1-301570bacd5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:58.128829 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5c3838-6a62-4632-b9c1-301570bacd5b None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:58.140508 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 521/1051] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:36:58.144177 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c3838-6a62-4632-b9c1-301570bacd5b None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:58.173946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a434ad-24f0-4668-83a4-1b49fdd120b3 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:58.209716 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e22e17-821e-47f2-9610-8f48173f197d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:58.210473 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e22e17-821e-47f2-9610-8f48173f197d None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:58.210753 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e22e17-821e-47f2-9610-8f48173f197d None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:58.211029 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e22e17-821e-47f2-9610-8f48173f197d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:58.221502 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e22e17-821e-47f2-9610-8f48173f197d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:36:58.229096 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-b2e22e17-821e-47f2-9610-8f48173f197d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:36:58.229096 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:58.229096 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:58.229096 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:58.229096 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:58.229096 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:58.229096 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:58.229096 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:58.229096 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:58.229096 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:58.229096 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:58.229096 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:58.229096 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:36:58.229096 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:36:58.229096 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:36:58.229096 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:36:58.230386 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:36:58.230386 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:36:58.230386 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:36:58.230386 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:36:58.230386 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:58.230386 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:58.230386 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:58.230386 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:58.230386 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:58.230386 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:58.230386 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:58.230386 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:58.230386 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:58.230386 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:58.230386 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:58.230386 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:58.231461 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:58.231461 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:58.231461 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:58.231461 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:58.231461 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:36:58.231461 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:36:58.231461 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:36:58.231461 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:36:58.231461 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:36:58.231461 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:36:58.231461 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:36:58.231461 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:58.235174 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 531/1052] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 5 20:36:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:36:58.236543 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e22e17-821e-47f2-9610-8f48173f197d None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:58.257833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c3838-6a62-4632-b9c1-301570bacd5b None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:58.285157 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:58.294510 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172e7d0-6728-4bed-9f57-005f2a24b49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:58.295279 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172e7d0-6728-4bed-9f57-005f2a24b49e None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:58.295565 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172e7d0-6728-4bed-9f57-005f2a24b49e None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:58.295837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172e7d0-6728-4bed-9f57-005f2a24b49e None admin] PATH_INFO: `/v3/services` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:58.296556 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6172e7d0-6728-4bed-9f57-005f2a24b49e None admin] RBAC: Adding query filter params (type=image) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:58.296860 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6172e7d0-6728-4bed-9f57-005f2a24b49e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:58.298275 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6172e7d0-6728-4bed-9f57-005f2a24b49e None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:58.304363 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 522/1053] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:58.310130 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172e7d0-6728-4bed-9f57-005f2a24b49e None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:58.343233 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e22e17-821e-47f2-9610-8f48173f197d None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:58.362467 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:58.379848 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16448cc2-dbea-40ff-b5da-039fc0af1004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:58.380769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16448cc2-dbea-40ff-b5da-039fc0af1004 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:58.381197 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16448cc2-dbea-40ff-b5da-039fc0af1004 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:58.381619 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16448cc2-dbea-40ff-b5da-039fc0af1004 None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:58.382628 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16448cc2-dbea-40ff-b5da-039fc0af1004 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:58.383109 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16448cc2-dbea-40ff-b5da-039fc0af1004 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:58.384496 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16448cc2-dbea-40ff-b5da-039fc0af1004 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:58.395407 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 532/1054] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:36:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:36:58.400820 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16448cc2-dbea-40ff-b5da-039fc0af1004 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:58.421756 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172e7d0-6728-4bed-9f57-005f2a24b49e None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:58.467897 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e67b42-ff30-4922-bdb1-06f12234a1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:58.468477 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e67b42-ff30-4922-bdb1-06f12234a1e5 None admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:58.468812 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e67b42-ff30-4922-bdb1-06f12234a1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:58.469294 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e67b42-ff30-4922-bdb1-06f12234a1e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:58.469833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e67b42-ff30-4922-bdb1-06f12234a1e5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:58.471243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e67b42-ff30-4922-bdb1-06f12234a1e5 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:58.503347 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 523/1055] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Jul 5 20:36:58 2022] POST /identity/v3/endpoints => generated 327 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:36:58.515209 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16448cc2-dbea-40ff-b5da-039fc0af1004 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:58.561336 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668b2f5-b987-4918-9b96-7b84875addcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:58.562530 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668b2f5-b987-4918-9b96-7b84875addcc None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:58.562888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668b2f5-b987-4918-9b96-7b84875addcc None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:58.563220 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668b2f5-b987-4918-9b96-7b84875addcc None admin] PATH_INFO: `/v3/users/3c1f9c38ff6b4639848e417b22ee7c78` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:58.580058 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4668b2f5-b987-4918-9b96-7b84875addcc None admin] RBAC: Authorizing `identity:get_user(user_id=3c1f9c38ff6b4639848e417b22ee7c78)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:58.581650 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4668b2f5-b987-4918-9b96-7b84875addcc None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:58.583802 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 533/1056] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:36:58 2022] GET /identity/v3/users/3c1f9c38ff6b4639848e417b22ee7c78 => generated 285 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:58.589600 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e67b42-ff30-4922-bdb1-06f12234a1e5 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:58.645456 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:58.705180 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e67b42-ff30-4922-bdb1-06f12234a1e5 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:58.738356 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e4b56-232b-4228-93de-5b7f14bab8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:58.738936 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e4b56-232b-4228-93de-5b7f14bab8a2 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:58.739218 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e4b56-232b-4228-93de-5b7f14bab8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:58.739508 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e4b56-232b-4228-93de-5b7f14bab8a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:58.808559 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e4b56-232b-4228-93de-5b7f14bab8a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:58.810066 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e4b56-232b-4228-93de-5b7f14bab8a2 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:58.858896 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:58.913215 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 524/1057] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:36:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 05 20:36:58.919016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668b2f5-b987-4918-9b96-7b84875addcc None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:58.955362 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:58.984417 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc9272-3237-4d19-9a3b-61866e4470d2 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:58.984700 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc9272-3237-4d19-9a3b-61866e4470d2 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:58.984981 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc9272-3237-4d19-9a3b-61866e4470d2 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:58.986414 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 525/1058] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:36:58.991558 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a5744-d441-4967-b990-10b59dce34e4 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:58.991784 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a5744-d441-4967-b990-10b59dce34e4 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:58.992060 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a5744-d441-4967-b990-10b59dce34e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:59.008699 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-dc2a5744-d441-4967-b990-10b59dce34e4 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:36:59.009908 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-dc2a5744-d441-4967-b990-10b59dce34e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:36:59.040038 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668b2f5-b987-4918-9b96-7b84875addcc None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:59.077765 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 526/1059] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:36:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:36:59.078790 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a774ca-7e76-4be7-b883-8efc1b862fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:59.079657 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a774ca-7e76-4be7-b883-8efc1b862fe6 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:59.079936 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a774ca-7e76-4be7-b883-8efc1b862fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:59.080206 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a774ca-7e76-4be7-b883-8efc1b862fe6 None admin] PATH_INFO: `/v3/projects/69220ad6fc8b4a12aab90c6c7b5c3373` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:59.081395 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a774ca-7e76-4be7-b883-8efc1b862fe6 None admin] RBAC: Authorizing `identity:get_project(project_id=69220ad6fc8b4a12aab90c6c7b5c3373)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:59.082927 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a774ca-7e76-4be7-b883-8efc1b862fe6 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:59.089817 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 534/1060] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:36:58 2022] GET /identity/v3/projects/69220ad6fc8b4a12aab90c6c7b5c3373 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:59.090729 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a5744-d441-4967-b990-10b59dce34e4 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:59.099837 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a774ca-7e76-4be7-b883-8efc1b862fe6 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:59.179931 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:59.206728 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a5744-d441-4967-b990-10b59dce34e4 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:59.210113 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a774ca-7e76-4be7-b883-8efc1b862fe6 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:59.212560 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:59.243335 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6303ff9-59d9-40e0-9cfb-8776618177a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:59.243891 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6303ff9-59d9-40e0-9cfb-8776618177a5 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:59.244179 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6303ff9-59d9-40e0-9cfb-8776618177a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:59.244480 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6303ff9-59d9-40e0-9cfb-8776618177a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:59.245346 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6303ff9-59d9-40e0-9cfb-8776618177a5 None admin] RBAC: Adding query filter params (role.id=37ba4a62052348d4811b560c19a07e02, scope.project.id=69220ad6fc8b4a12aab90c6c7b5c3373, user.id=3c1f9c38ff6b4639848e417b22ee7c78) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:59.245760 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6303ff9-59d9-40e0-9cfb-8776618177a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:59.247243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6303ff9-59d9-40e0-9cfb-8776618177a5 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:59.248997 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208853ce-81de-4c55-a00a-6330d7a57a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:59.249830 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208853ce-81de-4c55-a00a-6330d7a57a58 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:59.250189 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208853ce-81de-4c55-a00a-6330d7a57a58 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:59.250455 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208853ce-81de-4c55-a00a-6330d7a57a58 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:59.253370 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 527/1061] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:36:59 2022] GET /identity/v3/role_assignments?user.id=3c1f9c38ff6b4639848e417b22ee7c78&scope.project.id=69220ad6fc8b4a12aab90c6c7b5c3373&role.id=37ba4a62052348d4811b560c19a07e02 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:59.262244 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208853ce-81de-4c55-a00a-6330d7a57a58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:36:59.270895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-208853ce-81de-4c55-a00a-6330d7a57a58 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 20:36:59.270895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:59.270895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:59.270895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:59.270895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:59.270895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:59.270895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:59.270895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:59.270895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:59.270895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:59.270895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:59.270895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:59.270895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:36:59.270895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:36:59.270895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:36:59.270895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:36:59.271946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:36:59.271946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:36:59.271946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:36:59.271946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:36:59.271946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:59.271946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:59.271946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:59.271946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:59.271946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:59.271946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:59.271946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:59.271946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:59.271946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:59.271946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:59.271946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:59.271946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:59.272865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:59.272865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:59.272865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:59.272865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:59.272865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:36:59.272865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:36:59.272865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:36:59.272865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:36:59.272865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:36:59.272865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:36:59.272865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 20:36:59.272865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:59.277777 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 535/1062] 10.222.0.27 () {56 vars in 1120 bytes} [Tue Jul 5 20:36:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:36:59.278957 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6303ff9-59d9-40e0-9cfb-8776618177a5 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:59.388128 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6303ff9-59d9-40e0-9cfb-8776618177a5 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:59.426042 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26957511-0779-4ea9-aab1-91723b6cc9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:59.426730 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26957511-0779-4ea9-aab1-91723b6cc9dd None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:59.427083 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26957511-0779-4ea9-aab1-91723b6cc9dd None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:59.427586 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26957511-0779-4ea9-aab1-91723b6cc9dd None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:59.428994 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26957511-0779-4ea9-aab1-91723b6cc9dd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:59.429533 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26957511-0779-4ea9-aab1-91723b6cc9dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:59.430955 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26957511-0779-4ea9-aab1-91723b6cc9dd None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:59.440487 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 528/1063] 10.222.0.27 () {56 vars in 1115 bytes} [Tue Jul 5 20:36:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:59.446092 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208853ce-81de-4c55-a00a-6330d7a57a58 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:59.553724 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208853ce-81de-4c55-a00a-6330d7a57a58 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:59.589609 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593210f-4e77-466d-94cb-5a4f0a848f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:59.590460 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593210f-4e77-466d-94cb-5a4f0a848f98 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:59.590736 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593210f-4e77-466d-94cb-5a4f0a848f98 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:59.591005 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593210f-4e77-466d-94cb-5a4f0a848f98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:59.602109 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7593210f-4e77-466d-94cb-5a4f0a848f98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:59.603561 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7593210f-4e77-466d-94cb-5a4f0a848f98 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:59.621068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-7593210f-4e77-466d-94cb-5a4f0a848f98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:59.621068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:59.621068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:59.621068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:59.621068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:59.621068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:59.621068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:59.621068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:59.621068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:59.621068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:59.621068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:59.621068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:59.621068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:36:59.621068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:36:59.621068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:36:59.622347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:36:59.622347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:59.622347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:59.622347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:59.622347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:59.622347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:59.622347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:59.622347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:59.622347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:59.622347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:59.622347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:59.622347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:59.622347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:59.622347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:59.622347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:59.622347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:59.622347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:59.623262 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:36:59.623262 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:36:59.623262 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:36:59.623262 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:59.623981 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 536/1064] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:36:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:59.628566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26957511-0779-4ea9-aab1-91723b6cc9dd None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:59.632861 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:59.735452 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26957511-0779-4ea9-aab1-91723b6cc9dd None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:59.770140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606213b-98cd-494f-b9d5-0e5375b492b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:59.770793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606213b-98cd-494f-b9d5-0e5375b492b8 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:59.771070 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606213b-98cd-494f-b9d5-0e5375b492b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:59.771342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606213b-98cd-494f-b9d5-0e5375b492b8 None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:59.772050 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606213b-98cd-494f-b9d5-0e5375b492b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:36:59.772369 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606213b-98cd-494f-b9d5-0e5375b492b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:59.773749 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606213b-98cd-494f-b9d5-0e5375b492b8 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:59.786723 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 529/1065] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:36:59.792376 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593210f-4e77-466d-94cb-5a4f0a848f98 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:36:59.812987 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:36:59.899182 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593210f-4e77-466d-94cb-5a4f0a848f98 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:36:59.934351 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fb908-9d50-42da-83d9-2f9bea399a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:36:59.935166 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fb908-9d50-42da-83d9-2f9bea399a75 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:36:59.935418 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fb908-9d50-42da-83d9-2f9bea399a75 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:36:59.935685 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fb908-9d50-42da-83d9-2f9bea399a75 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:36:59.943389 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970fb908-9d50-42da-83d9-2f9bea399a75 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:36:59.944829 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970fb908-9d50-42da-83d9-2f9bea399a75 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:36:59.958756 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-970fb908-9d50-42da-83d9-2f9bea399a75 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 20:36:59.958756 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:36:59.958756 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:36:59.958756 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:36:59.958756 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:36:59.958756 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:36:59.958756 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:36:59.958756 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:36:59.958756 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:36:59.958756 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:36:59.958756 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:36:59.958756 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:36:59.958756 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:36:59.958756 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:36:59.958756 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:36:59.958756 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:36:59.959723 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:36:59.959723 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:36:59.959723 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:36:59.959723 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:59.959723 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:36:59.959723 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:36:59.959723 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:36:59.959723 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:36:59.959723 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:36:59.959723 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:36:59.959723 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:36:59.959723 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:36:59.959723 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:36:59.959723 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:36:59.959723 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:36:59.959723 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:36:59.959723 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:36:59.959723 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:36:59.965491 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:36:59.965491 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:36:59.965491 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:36:59.965491 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:36:59.965491 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:36:59.965491 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:36:59.965491 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:36:59.965491 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:36:59.965491 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 20:36:59.965491 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:36:59.965491 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 537/1066] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Jul 5 20:36:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:36:59.967716 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606213b-98cd-494f-b9d5-0e5375b492b8 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:00.033037 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:00.073460 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606213b-98cd-494f-b9d5-0e5375b492b8 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:00.107351 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8fa0d8-011f-4d92-833c-f2dd6838615a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:00.108026 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fa0d8-011f-4d92-833c-f2dd6838615a None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:00.108304 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fa0d8-011f-4d92-833c-f2dd6838615a None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:00.108575 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fa0d8-011f-4d92-833c-f2dd6838615a None admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:00.109412 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8fa0d8-011f-4d92-833c-f2dd6838615a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:37:00.109721 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8fa0d8-011f-4d92-833c-f2dd6838615a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:00.111269 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8fa0d8-011f-4d92-833c-f2dd6838615a None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:00.128711 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 530/1067] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Jul 5 20:36:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:00.134333 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fb908-9d50-42da-83d9-2f9bea399a75 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:00.216842 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:00.242760 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fb908-9d50-42da-83d9-2f9bea399a75 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:00.277068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00f135-b8d7-48d8-906b-b543307cbdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:00.277947 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00f135-b8d7-48d8-906b-b543307cbdcd None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:00.278311 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00f135-b8d7-48d8-906b-b543307cbdcd None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:00.278592 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00f135-b8d7-48d8-906b-b543307cbdcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:00.289885 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00f135-b8d7-48d8-906b-b543307cbdcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:00.291409 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00f135-b8d7-48d8-906b-b543307cbdcd None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:00.309620 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-9f00f135-b8d7-48d8-906b-b543307cbdcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:37:00.309620 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:37:00.309620 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:37:00.309620 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:37:00.309620 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:37:00.309620 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:37:00.309620 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:37:00.309620 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:37:00.309620 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:37:00.309620 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:37:00.309620 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:37:00.309620 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:37:00.309620 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:37:00.309620 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:37:00.309620 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:37:00.310585 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:37:00.310585 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:37:00.310585 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:37:00.310585 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:37:00.310585 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:37:00.310585 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:37:00.310585 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:37:00.310585 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:37:00.310585 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:37:00.310585 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:37:00.310585 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:37:00.310585 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:37:00.310585 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:37:00.310585 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:37:00.310585 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:37:00.310585 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:37:00.310585 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:37:00.311541 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:37:00.311541 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:37:00.311541 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:37:00.311541 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:37:00.311541 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 538/1068] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:37:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:37:00.316548 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8fa0d8-011f-4d92-833c-f2dd6838615a None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:00.419347 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8fa0d8-011f-4d92-833c-f2dd6838615a None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:00.443147 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:00.459529 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f248d44-92a7-42c1-abf2-e18a6a49a9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:00.460373 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f248d44-92a7-42c1-abf2-e18a6a49a9f2 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:00.460659 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f248d44-92a7-42c1-abf2-e18a6a49a9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:00.460935 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f248d44-92a7-42c1-abf2-e18a6a49a9f2 None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:00.461666 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f248d44-92a7-42c1-abf2-e18a6a49a9f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:37:00.462003 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f248d44-92a7-42c1-abf2-e18a6a49a9f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:00.463527 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f248d44-92a7-42c1-abf2-e18a6a49a9f2 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:00.481794 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 531/1069] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:37:00.487284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00f135-b8d7-48d8-906b-b543307cbdcd None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:00.531734 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6a3b1-7ef4-4d5c-b6d5-c02ed23e9dd0 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:00.532017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6a3b1-7ef4-4d5c-b6d5-c02ed23e9dd0 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:00.532291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6a3b1-7ef4-4d5c-b6d5-c02ed23e9dd0 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:00.533943 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 532/1070] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:37:00.539722 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efba7fd-a8b7-4e7f-8866-effbef97195b None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:00.540007 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efba7fd-a8b7-4e7f-8866-effbef97195b None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:00.540281 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efba7fd-a8b7-4e7f-8866-effbef97195b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:00.558666 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-3efba7fd-a8b7-4e7f-8866-effbef97195b None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:37:00.559842 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-3efba7fd-a8b7-4e7f-8866-effbef97195b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:37:00.592248 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00f135-b8d7-48d8-906b-b543307cbdcd None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:00.622362 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:00.627156 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 533/1071] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:37:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 20:37:00.630795 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245458f-e5ab-4ca9-bb7d-53f8e13798a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:00.631586 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245458f-e5ab-4ca9-bb7d-53f8e13798a9 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:00.631861 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245458f-e5ab-4ca9-bb7d-53f8e13798a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:00.632129 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245458f-e5ab-4ca9-bb7d-53f8e13798a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:00.639093 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a245458f-e5ab-4ca9-bb7d-53f8e13798a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:00.640533 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a245458f-e5ab-4ca9-bb7d-53f8e13798a9 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:00.649095 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efba7fd-a8b7-4e7f-8866-effbef97195b None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:00.655375 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-a245458f-e5ab-4ca9-bb7d-53f8e13798a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:37:00.655375 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:37:00.655375 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:37:00.655375 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:37:00.655375 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:37:00.655375 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:37:00.655375 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:37:00.655375 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:37:00.655375 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:37:00.655375 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:37:00.655375 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:37:00.655375 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:37:00.655375 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:37:00.655375 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:37:00.655375 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:37:00.656279 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:37:00.656279 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:37:00.656279 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:37:00.656279 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:37:00.656279 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:37:00.656279 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:37:00.656279 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:37:00.656279 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:37:00.656279 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:37:00.656279 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:37:00.656279 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:37:00.656279 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:37:00.656279 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:37:00.656279 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:37:00.656279 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:37:00.656279 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:37:00.656279 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:37:00.662115 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:37:00.662115 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:37:00.662115 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:37:00.662115 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:37:00.662115 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:37:00.662115 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:37:00.662115 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:37:00.662115 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:37:00.662115 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 539/1072] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:37:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:37:00.662694 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245458f-e5ab-4ca9-bb7d-53f8e13798a9 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:00.761210 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efba7fd-a8b7-4e7f-8866-effbef97195b None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:00.763874 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245458f-e5ab-4ca9-bb7d-53f8e13798a9 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:00.779281 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:00.800135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fa1d1-4ec2-42a4-bea7-2d1e26f7ef13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:00.800793 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fa1d1-4ec2-42a4-bea7-2d1e26f7ef13 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:00.801071 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fa1d1-4ec2-42a4-bea7-2d1e26f7ef13 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:00.801341 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fa1d1-4ec2-42a4-bea7-2d1e26f7ef13 None admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:00.802155 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857fa1d1-4ec2-42a4-bea7-2d1e26f7ef13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:37:00.802460 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857fa1d1-4ec2-42a4-bea7-2d1e26f7ef13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:00.803595 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ac5bb-1334-48d0-bd5f-b5c28225b6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:00.803902 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857fa1d1-4ec2-42a4-bea7-2d1e26f7ef13 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:00.804257 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ac5bb-1334-48d0-bd5f-b5c28225b6d0 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:00.804540 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ac5bb-1334-48d0-bd5f-b5c28225b6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:00.804829 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ac5bb-1334-48d0-bd5f-b5c28225b6d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:00.816070 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 540/1073] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 5 20:37:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:00.821825 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fa1d1-4ec2-42a4-bea7-2d1e26f7ef13 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:00.873192 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:00.876765 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01ac5bb-1334-48d0-bd5f-b5c28225b6d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:00.878353 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01ac5bb-1334-48d0-bd5f-b5c28225b6d0 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:00.935447 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fa1d1-4ec2-42a4-bea7-2d1e26f7ef13 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:00.978405 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7204d39-19d5-4385-8554-f7b6fb4df7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:00.979333 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7204d39-19d5-4385-8554-f7b6fb4df7cb None admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:00.979610 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7204d39-19d5-4385-8554-f7b6fb4df7cb None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:00.979880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7204d39-19d5-4385-8554-f7b6fb4df7cb None admin] PATH_INFO: `/v3/projects/b321588ec1f14bcb94a184310cf72856/users/814b675b98b844a2a12a39890ee69d2b/roles/8d9d4dd4ce594ddb9579d0e117ad02e9` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:00.981568 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 534/1074] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:37:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 05 20:37:00.982164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7204d39-19d5-4385-8554-f7b6fb4df7cb None admin] RBAC: Authorizing `identity:create_grant(project_id=b321588ec1f14bcb94a184310cf72856, user_id=814b675b98b844a2a12a39890ee69d2b, role_id=8d9d4dd4ce594ddb9579d0e117ad02e9)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:00.983795 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7204d39-19d5-4385-8554-f7b6fb4df7cb None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:00.987205 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ac5bb-1334-48d0-bd5f-b5c28225b6d0 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:00.999333 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 541/1075] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 5 20:37:00 2022] PUT /identity/v3/projects/b321588ec1f14bcb94a184310cf72856/users/814b675b98b844a2a12a39890ee69d2b/roles/8d9d4dd4ce594ddb9579d0e117ad02e9 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:37:01.010128 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:01.098343 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ac5bb-1334-48d0-bd5f-b5c28225b6d0 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:01.135651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f324f52-8d4b-41cc-8146-91d6bcf26d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:01.136474 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f324f52-8d4b-41cc-8146-91d6bcf26d9c None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:01.136756 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f324f52-8d4b-41cc-8146-91d6bcf26d9c None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:01.137028 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f324f52-8d4b-41cc-8146-91d6bcf26d9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:01.153626 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f324f52-8d4b-41cc-8146-91d6bcf26d9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:01.153626 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f324f52-8d4b-41cc-8146-91d6bcf26d9c None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:01.173043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-7f324f52-8d4b-41cc-8146-91d6bcf26d9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:37:01.173043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:37:01.173043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:37:01.173043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:37:01.173043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:37:01.173043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:37:01.173043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:37:01.173043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:37:01.173043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:37:01.173043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:37:01.173043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:37:01.173043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:37:01.173043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:37:01.173043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:37:01.173043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:37:01.174457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:37:01.174457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:37:01.174457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:37:01.174457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:37:01.174457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:37:01.174457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:37:01.174457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:37:01.174457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:37:01.174457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:37:01.174457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:37:01.174457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:37:01.174457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:37:01.174457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:37:01.174457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:37:01.174457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:37:01.174457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:37:01.174457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:37:01.175371 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:37:01.175371 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:37:01.175371 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:37:01.175371 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:37:01.175371 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 535/1076] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:37:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:37:01.180992 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7204d39-19d5-4385-8554-f7b6fb4df7cb None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:01.277496 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d83a5f-5602-4bd9-8533-24b4c141fdc4 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:01.277809 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d83a5f-5602-4bd9-8533-24b4c141fdc4 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:01.278068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d83a5f-5602-4bd9-8533-24b4c141fdc4 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:01.279644 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 536/1077] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:37:01.283674 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7204d39-19d5-4385-8554-f7b6fb4df7cb None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:01.284412 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2d265-a715-4894-9934-1e2f0a124c76 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:01.284690 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2d265-a715-4894-9934-1e2f0a124c76 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:01.284961 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2d265-a715-4894-9934-1e2f0a124c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:01.294251 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:01.302474 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-9da2d265-a715-4894-9934-1e2f0a124c76 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:37:01.303654 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-9da2d265-a715-4894-9934-1e2f0a124c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:37:01.326382 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2b3dc-cfd6-4c3a-9400-0c64bd335c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:01.327065 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2b3dc-cfd6-4c3a-9400-0c64bd335c54 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:01.327348 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2b3dc-cfd6-4c3a-9400-0c64bd335c54 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:01.327619 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2b3dc-cfd6-4c3a-9400-0c64bd335c54 None admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:01.328345 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2b3dc-cfd6-4c3a-9400-0c64bd335c54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:37:01.328744 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2b3dc-cfd6-4c3a-9400-0c64bd335c54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:01.330182 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2b3dc-cfd6-4c3a-9400-0c64bd335c54 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:01.342495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 542/1078] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:37:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:01.373491 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:01.383666 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 537/1079] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:37:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 20:37:01.406310 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2b3dc-cfd6-4c3a-9400-0c64bd335c54 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:01.522126 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2b3dc-cfd6-4c3a-9400-0c64bd335c54 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:01.561334 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3c608-eb3a-4658-8ebb-4fcb70832121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:01.562162 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3c608-eb3a-4658-8ebb-4fcb70832121 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:01.562438 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3c608-eb3a-4658-8ebb-4fcb70832121 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:01.562707 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3c608-eb3a-4658-8ebb-4fcb70832121 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:01.573465 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd3c608-eb3a-4658-8ebb-4fcb70832121 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:37:01.581016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-0fd3c608-eb3a-4658-8ebb-4fcb70832121 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:37:01.581016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:37:01.581016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:37:01.581016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:37:01.581016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:37:01.581016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:37:01.581016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:37:01.581016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:37:01.581016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:37:01.581016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:37:01.581016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:37:01.581016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:37:01.581016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:37:01.581016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:37:01.581016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:37:01.581016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:37:01.582026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:37:01.582026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:37:01.582026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:37:01.582026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:37:01.582026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:37:01.582026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:37:01.582026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:37:01.582026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:37:01.582026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:37:01.582026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:37:01.582026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:37:01.582026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:37:01.582026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:37:01.582026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:37:01.582026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:37:01.582026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:37:01.582911 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:37:01.582911 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:37:01.582911 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:37:01.582911 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:37:01.582911 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:37:01.582911 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:37:01.582911 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:37:01.582911 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:37:01.582911 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:37:01.582911 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:37:01.582911 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:37:01.582911 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:37:01.582911 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 543/1080] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 5 20:37:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:37:01.588508 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2d265-a715-4894-9934-1e2f0a124c76 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:01.691016 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2d265-a715-4894-9934-1e2f0a124c76 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:01.726413 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6b99f-623b-49f8-bb18-f482a1a58c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:01.727087 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6b99f-623b-49f8-bb18-f482a1a58c45 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:01.727372 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6b99f-623b-49f8-bb18-f482a1a58c45 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:01.727654 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6b99f-623b-49f8-bb18-f482a1a58c45 None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:01.728403 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6b99f-623b-49f8-bb18-f482a1a58c45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:37:01.728709 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6b99f-623b-49f8-bb18-f482a1a58c45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:01.730135 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6b99f-623b-49f8-bb18-f482a1a58c45 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:01.738484 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 538/1081] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:37:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:01.744404 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3c608-eb3a-4658-8ebb-4fcb70832121 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:01.776850 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:01.850993 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3c608-eb3a-4658-8ebb-4fcb70832121 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:01.885733 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438314a-ed92-4ffd-83d0-60187ce9a82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:01.886636 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438314a-ed92-4ffd-83d0-60187ce9a82e None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:01.886920 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438314a-ed92-4ffd-83d0-60187ce9a82e None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:01.887194 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438314a-ed92-4ffd-83d0-60187ce9a82e None admin] PATH_INFO: `/v3/users/3c1f9c38ff6b4639848e417b22ee7c78` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:01.888425 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438314a-ed92-4ffd-83d0-60187ce9a82e None admin] RBAC: Authorizing `identity:get_user(user_id=3c1f9c38ff6b4639848e417b22ee7c78)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:01.889876 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438314a-ed92-4ffd-83d0-60187ce9a82e None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:01.891557 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 544/1082] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:37:01 2022] GET /identity/v3/users/3c1f9c38ff6b4639848e417b22ee7c78 => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:01.897596 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6b99f-623b-49f8-bb18-f482a1a58c45 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:01.958972 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:02.006946 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6b99f-623b-49f8-bb18-f482a1a58c45 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:02.041710 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020f4c4-2b55-43f0-b394-d459db39ecd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:02.042595 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020f4c4-2b55-43f0-b394-d459db39ecd2 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:02.042872 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020f4c4-2b55-43f0-b394-d459db39ecd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:02.043140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020f4c4-2b55-43f0-b394-d459db39ecd2 None admin] PATH_INFO: `/v3/projects/69220ad6fc8b4a12aab90c6c7b5c3373` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:02.044349 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020f4c4-2b55-43f0-b394-d459db39ecd2 None admin] RBAC: Authorizing `identity:get_project(project_id=69220ad6fc8b4a12aab90c6c7b5c3373)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:02.045797 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020f4c4-2b55-43f0-b394-d459db39ecd2 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:02.047535 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 539/1083] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:37:01 2022] GET /identity/v3/projects/69220ad6fc8b4a12aab90c6c7b5c3373 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:02.054956 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438314a-ed92-4ffd-83d0-60187ce9a82e None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:02.157038 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:02.163961 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438314a-ed92-4ffd-83d0-60187ce9a82e None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:02.199820 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb8110-0d9b-4f46-9087-80075bba2802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:02.200716 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb8110-0d9b-4f46-9087-80075bba2802 None admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:02.200989 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb8110-0d9b-4f46-9087-80075bba2802 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:02.201259 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb8110-0d9b-4f46-9087-80075bba2802 None admin] PATH_INFO: `/v3/projects/69220ad6fc8b4a12aab90c6c7b5c3373/users/3c1f9c38ff6b4639848e417b22ee7c78/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:02.203362 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb8110-0d9b-4f46-9087-80075bba2802 None admin] RBAC: Authorizing `identity:create_grant(project_id=69220ad6fc8b4a12aab90c6c7b5c3373, user_id=3c1f9c38ff6b4639848e417b22ee7c78, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:02.204802 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb8110-0d9b-4f46-9087-80075bba2802 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:02.223440 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 545/1084] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 5 20:37:02 2022] PUT /identity/v3/projects/69220ad6fc8b4a12aab90c6c7b5c3373/users/3c1f9c38ff6b4639848e417b22ee7c78/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:37:02.989187 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efdde2-73fc-49ab-94ce-d3193c1852f7 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:02.989809 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efdde2-73fc-49ab-94ce-d3193c1852f7 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:02.989809 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efdde2-73fc-49ab-94ce-d3193c1852f7 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:02.991146 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 540/1085] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:37:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:37:02.996599 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbfc1e-f846-46b1-a09f-e68ef201957c None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:02.996967 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbfc1e-f846-46b1-a09f-e68ef201957c None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:02.997251 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbbfc1e-f846-46b1-a09f-e68ef201957c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:03.014289 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-5bbbfc1e-f846-46b1-a09f-e68ef201957c None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:37:03.015462 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-5bbbfc1e-f846-46b1-a09f-e68ef201957c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:37:03.083266 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 546/1086] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:37:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 20:37:03.106181 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1efdde2-73fc-49ab-94ce-d3193c1852f7 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:03.212675 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1efdde2-73fc-49ab-94ce-d3193c1852f7 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:03.237741 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:03.250507 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95206571-d8e2-4ea6-9baf-d13c81fec631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:03.251271 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95206571-d8e2-4ea6-9baf-d13c81fec631 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:03.251551 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95206571-d8e2-4ea6-9baf-d13c81fec631 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:03.251825 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95206571-d8e2-4ea6-9baf-d13c81fec631 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:03.262341 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95206571-d8e2-4ea6-9baf-d13c81fec631 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:37:03.270664 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-95206571-d8e2-4ea6-9baf-d13c81fec631 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 20:37:03.270664 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:37:03.270664 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:37:03.270664 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:37:03.270664 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:37:03.270664 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:37:03.270664 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:37:03.270664 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:37:03.270664 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:37:03.270664 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:37:03.270664 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:37:03.270664 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:37:03.270664 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:37:03.270664 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:37:03.270664 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:37:03.270664 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:37:03.271700 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:37:03.271700 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:37:03.271700 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:37:03.271700 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:37:03.271700 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:37:03.271700 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:37:03.271700 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:37:03.271700 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:37:03.271700 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:37:03.271700 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:37:03.271700 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:37:03.271700 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:37:03.271700 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:37:03.271700 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:37:03.271700 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:37:03.271700 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:37:03.272773 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:37:03.272773 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:37:03.272773 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:37:03.272773 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:37:03.272773 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:37:03.272773 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:37:03.272773 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:37:03.272773 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:37:03.272773 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:37:03.272773 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:37:03.272773 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 05 20:37:03.272773 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:37:03.272773 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 541/1087] 10.222.0.27 () {56 vars in 1120 bytes} [Tue Jul 5 20:37:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:37:03.278664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbfc1e-f846-46b1-a09f-e68ef201957c None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:03.363659 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:03.380496 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbbfc1e-f846-46b1-a09f-e68ef201957c None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:03.414887 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c28d47-907d-4f5a-bcb9-aa692381f02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:03.415548 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c28d47-907d-4f5a-bcb9-aa692381f02d None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:03.415829 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c28d47-907d-4f5a-bcb9-aa692381f02d None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:03.416078 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c28d47-907d-4f5a-bcb9-aa692381f02d None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:03.416819 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c28d47-907d-4f5a-bcb9-aa692381f02d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:37:03.417115 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c28d47-907d-4f5a-bcb9-aa692381f02d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:03.418525 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c28d47-907d-4f5a-bcb9-aa692381f02d None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:03.427054 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 547/1088] 10.222.0.27 () {56 vars in 1115 bytes} [Tue Jul 5 20:37:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:03.432721 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95206571-d8e2-4ea6-9baf-d13c81fec631 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:03.534225 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95206571-d8e2-4ea6-9baf-d13c81fec631 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:03.570608 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea8ce8-31b3-47aa-8dd9-cad05127cdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:03.571407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea8ce8-31b3-47aa-8dd9-cad05127cdea None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:03.571688 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea8ce8-31b3-47aa-8dd9-cad05127cdea None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:03.571966 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea8ce8-31b3-47aa-8dd9-cad05127cdea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:03.583110 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea8ce8-31b3-47aa-8dd9-cad05127cdea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:03.584648 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea8ce8-31b3-47aa-8dd9-cad05127cdea None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:03.601587 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-1cea8ce8-31b3-47aa-8dd9-cad05127cdea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:37:03.601587 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:37:03.601587 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:37:03.601587 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:37:03.601587 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:37:03.601587 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:37:03.601587 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:37:03.601587 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:37:03.601587 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:37:03.601587 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:37:03.601587 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:37:03.601587 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:37:03.601587 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:37:03.601587 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:37:03.601587 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:37:03.602577 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:37:03.602577 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:37:03.602577 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:37:03.602577 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:37:03.602577 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:37:03.602577 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:37:03.602577 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:37:03.602577 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:37:03.602577 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:37:03.602577 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:37:03.602577 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:37:03.602577 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:37:03.602577 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:37:03.602577 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:37:03.602577 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:37:03.602577 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:37:03.602577 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:37:03.603483 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:37:03.603483 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:37:03.603483 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:37:03.603483 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:37:03.603483 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 542/1089] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:37:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:37:03.608818 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c28d47-907d-4f5a-bcb9-aa692381f02d None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:03.711341 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c28d47-907d-4f5a-bcb9-aa692381f02d None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:03.746549 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618f36d-9be4-45ae-bf6d-e76e00a68aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:03.747208 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618f36d-9be4-45ae-bf6d-e76e00a68aaa None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:03.747499 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618f36d-9be4-45ae-bf6d-e76e00a68aaa None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:03.747767 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618f36d-9be4-45ae-bf6d-e76e00a68aaa None admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:03.748486 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a618f36d-9be4-45ae-bf6d-e76e00a68aaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:37:03.748789 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a618f36d-9be4-45ae-bf6d-e76e00a68aaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:03.750190 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a618f36d-9be4-45ae-bf6d-e76e00a68aaa None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:03.762440 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 548/1090] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:03.768379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea8ce8-31b3-47aa-8dd9-cad05127cdea None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:03.805089 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:03.872709 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea8ce8-31b3-47aa-8dd9-cad05127cdea None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:03.908021 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635775d5-611a-4704-a370-58f7f5718fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:03.908820 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635775d5-611a-4704-a370-58f7f5718fdd None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:03.909100 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635775d5-611a-4704-a370-58f7f5718fdd None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:03.909370 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635775d5-611a-4704-a370-58f7f5718fdd None admin] PATH_INFO: `/v3/users/nova` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:03.917572 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635775d5-611a-4704-a370-58f7f5718fdd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:03.919061 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635775d5-611a-4704-a370-58f7f5718fdd None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:03.933817 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-635775d5-611a-4704-a370-58f7f5718fdd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 05 20:37:03.933817 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:37:03.933817 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:37:03.933817 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:37:03.933817 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:37:03.933817 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:37:03.933817 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:37:03.933817 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:37:03.933817 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:37:03.933817 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:37:03.933817 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:37:03.933817 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:37:03.933817 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:37:03.933817 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:37:03.933817 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:37:03.933817 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:37:03.934837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:37:03.934837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:37:03.934837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:37:03.934837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:37:03.934837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:37:03.934837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:37:03.934837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:37:03.934837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:37:03.934837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:37:03.934837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:37:03.934837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:37:03.934837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:37:03.934837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:37:03.934837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:37:03.934837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:37:03.934837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:37:03.934837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:37:03.934837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:37:03.935790 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:37:03.935790 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:37:03.935790 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:37:03.935790 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:37:03.935790 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:37:03.935790 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:37:03.935790 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:37:03.935790 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:37:03.935790 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 05 20:37:03.935790 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:37:03.935790 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 543/1091] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Jul 5 20:37:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:37:03.940983 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618f36d-9be4-45ae-bf6d-e76e00a68aaa None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:03.952329 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:04.043806 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618f36d-9be4-45ae-bf6d-e76e00a68aaa None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:04.080427 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1080123-f71e-472b-9240-48b6c05c287c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:04.081098 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1080123-f71e-472b-9240-48b6c05c287c None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:04.081380 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1080123-f71e-472b-9240-48b6c05c287c None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:04.081654 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1080123-f71e-472b-9240-48b6c05c287c None admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:04.082517 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1080123-f71e-472b-9240-48b6c05c287c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:37:04.082822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1080123-f71e-472b-9240-48b6c05c287c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:04.084263 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1080123-f71e-472b-9240-48b6c05c287c None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:04.102376 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 549/1092] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Jul 5 20:37:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:04.108242 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635775d5-611a-4704-a370-58f7f5718fdd None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:04.171261 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445cc75f-5006-475c-aee4-2e8efb0a8bb8 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:04.171618 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445cc75f-5006-475c-aee4-2e8efb0a8bb8 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:04.171934 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445cc75f-5006-475c-aee4-2e8efb0a8bb8 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:04.173421 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 550/1093] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:37:04.178714 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0ede8-d484-4846-ba5f-2b311eb9099f None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:04.178996 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0ede8-d484-4846-ba5f-2b311eb9099f None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:04.179302 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0ede8-d484-4846-ba5f-2b311eb9099f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:04.195800 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-43c0ede8-d484-4846-ba5f-2b311eb9099f None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:37:04.196998 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-43c0ede8-d484-4846-ba5f-2b311eb9099f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:37:04.205470 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:04.212229 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635775d5-611a-4704-a370-58f7f5718fdd None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:04.253617 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2145a-634b-4358-8e29-6ba10cabc420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:04.254291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2145a-634b-4358-8e29-6ba10cabc420 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:04.254579 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2145a-634b-4358-8e29-6ba10cabc420 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:04.254860 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2145a-634b-4358-8e29-6ba10cabc420 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:04.260652 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:04.268584 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 551/1094] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:37:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 20:37:04.291922 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0ede8-d484-4846-ba5f-2b311eb9099f None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:04.323251 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb2145a-634b-4358-8e29-6ba10cabc420 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:04.324727 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb2145a-634b-4358-8e29-6ba10cabc420 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:04.389155 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0ede8-d484-4846-ba5f-2b311eb9099f None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:04.416603 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:04.423147 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270cc07-d40a-4738-90a0-c19f7149d63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:04.423849 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 544/1095] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:37:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 20:37:04.424313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270cc07-d40a-4738-90a0-c19f7149d63d None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:04.424564 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270cc07-d40a-4738-90a0-c19f7149d63d None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:04.424838 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270cc07-d40a-4738-90a0-c19f7149d63d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:04.429978 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2145a-634b-4358-8e29-6ba10cabc420 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:04.435999 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9270cc07-d40a-4738-90a0-c19f7149d63d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:37:04.443664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-9270cc07-d40a-4738-90a0-c19f7149d63d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:37:04.443664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:37:04.443664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:37:04.443664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:37:04.443664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:37:04.443664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:37:04.443664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:37:04.443664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:37:04.443664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:37:04.443664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:37:04.443664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:37:04.443664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:37:04.443664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:37:04.443664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:37:04.443664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:37:04.443664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:37:04.444617 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:37:04.444617 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:37:04.444617 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:37:04.444617 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:37:04.444617 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:37:04.444617 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:37:04.444617 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:37:04.444617 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:37:04.444617 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:37:04.444617 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:37:04.444617 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:37:04.444617 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:37:04.444617 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:37:04.444617 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:37:04.444617 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:37:04.444617 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:37:04.445569 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:37:04.445569 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:37:04.445569 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:37:04.445569 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:37:04.445569 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:37:04.445569 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:37:04.445569 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:37:04.445569 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:37:04.445569 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:37:04.445569 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:37:04.445569 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:37:04.445569 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:37:04.449985 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 552/1096] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 5 20:37:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:37:04.450808 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270cc07-d40a-4738-90a0-c19f7149d63d None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:04.504743 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:04.527487 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2145a-634b-4358-8e29-6ba10cabc420 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:04.548361 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270cc07-d40a-4738-90a0-c19f7149d63d None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:04.561833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7457ec1-9d0c-401e-a676-53f3fe97df67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:04.562644 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7457ec1-9d0c-401e-a676-53f3fe97df67 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:04.562931 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7457ec1-9d0c-401e-a676-53f3fe97df67 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:04.563201 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7457ec1-9d0c-401e-a676-53f3fe97df67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:04.573111 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7457ec1-9d0c-401e-a676-53f3fe97df67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:04.574623 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7457ec1-9d0c-401e-a676-53f3fe97df67 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:04.583762 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b78d6e-013d-4b85-a8ab-50583963af95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:04.584470 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b78d6e-013d-4b85-a8ab-50583963af95 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:04.584751 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b78d6e-013d-4b85-a8ab-50583963af95 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:04.585029 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b78d6e-013d-4b85-a8ab-50583963af95 None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:04.585776 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b78d6e-013d-4b85-a8ab-50583963af95 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:37:04.586090 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b78d6e-013d-4b85-a8ab-50583963af95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:04.587912 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b78d6e-013d-4b85-a8ab-50583963af95 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:04.592839 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-b7457ec1-9d0c-401e-a676-53f3fe97df67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:37:04.592839 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:37:04.592839 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:37:04.592839 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:37:04.592839 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:37:04.592839 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:37:04.592839 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:37:04.592839 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:37:04.592839 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:37:04.592839 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:37:04.592839 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:37:04.592839 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:37:04.592839 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:37:04.592839 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:37:04.592839 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:37:04.593777 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:37:04.593777 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:37:04.593777 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:37:04.593777 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:37:04.593777 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:37:04.593777 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:37:04.593777 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:37:04.593777 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:37:04.593777 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:37:04.593777 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:37:04.593777 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:37:04.593777 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:37:04.593777 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:37:04.593777 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:37:04.593777 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:37:04.593777 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:37:04.593777 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:37:04.594733 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:37:04.594733 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:37:04.594733 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:37:04.594733 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:37:04.594733 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 545/1097] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:37:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:37:04.599776 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7457ec1-9d0c-401e-a676-53f3fe97df67 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:04.604171 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 553/1098] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:37:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:04.610744 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b78d6e-013d-4b85-a8ab-50583963af95 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:04.652280 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:04.702628 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7457ec1-9d0c-401e-a676-53f3fe97df67 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:04.722204 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b78d6e-013d-4b85-a8ab-50583963af95 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:04.739210 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:04.739351 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602663d-8f0a-4f60-93eb-4a960b1a5ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:04.740356 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602663d-8f0a-4f60-93eb-4a960b1a5ed2 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:04.740602 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602663d-8f0a-4f60-93eb-4a960b1a5ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:04.741039 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602663d-8f0a-4f60-93eb-4a960b1a5ed2 None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:04.741767 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602663d-8f0a-4f60-93eb-4a960b1a5ed2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:37:04.742108 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602663d-8f0a-4f60-93eb-4a960b1a5ed2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:04.743499 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602663d-8f0a-4f60-93eb-4a960b1a5ed2 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:04.754842 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 546/1099] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:37:04.756356 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8cfb2b-b298-4a0c-9b28-c3d2ccae1c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:04.757299 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cfb2b-b298-4a0c-9b28-c3d2ccae1c64 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:04.757654 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cfb2b-b298-4a0c-9b28-c3d2ccae1c64 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:04.758044 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cfb2b-b298-4a0c-9b28-c3d2ccae1c64 None admin] PATH_INFO: `/v3/users/3c1f9c38ff6b4639848e417b22ee7c78` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:04.759312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8cfb2b-b298-4a0c-9b28-c3d2ccae1c64 None admin] RBAC: Authorizing `identity:get_user(user_id=3c1f9c38ff6b4639848e417b22ee7c78)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:04.760399 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602663d-8f0a-4f60-93eb-4a960b1a5ed2 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:04.760849 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8cfb2b-b298-4a0c-9b28-c3d2ccae1c64 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:04.762621 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 554/1100] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:37:04 2022] GET /identity/v3/users/3c1f9c38ff6b4639848e417b22ee7c78 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:04.768140 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8cfb2b-b298-4a0c-9b28-c3d2ccae1c64 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:04.858689 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602663d-8f0a-4f60-93eb-4a960b1a5ed2 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:04.864550 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8cfb2b-b298-4a0c-9b28-c3d2ccae1c64 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:04.867695 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:04.897736 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42650b-47ae-4e45-b608-563042dae527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:04.898502 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42650b-47ae-4e45-b608-563042dae527 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:04.898814 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42650b-47ae-4e45-b608-563042dae527 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:04.899090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42650b-47ae-4e45-b608-563042dae527 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:04.901962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4879164-dcb3-4f15-9601-dd3d8a2453d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:04.902658 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4879164-dcb3-4f15-9601-dd3d8a2453d5 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:04.902887 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4879164-dcb3-4f15-9601-dd3d8a2453d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:04.903160 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4879164-dcb3-4f15-9601-dd3d8a2453d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:04.906367 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e42650b-47ae-4e45-b608-563042dae527 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:04.907842 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e42650b-47ae-4e45-b608-563042dae527 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:04.921766 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-9e42650b-47ae-4e45-b608-563042dae527 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:37:04.921766 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:37:04.921766 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:37:04.921766 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:37:04.921766 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:37:04.921766 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:37:04.921766 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:37:04.921766 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:37:04.921766 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:37:04.921766 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:37:04.921766 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:37:04.921766 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:37:04.921766 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:37:04.921766 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:37:04.921766 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:37:04.922787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:37:04.922787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:37:04.922787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:37:04.922787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:37:04.922787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:37:04.922787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:37:04.922787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:37:04.922787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:37:04.922787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:37:04.922787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:37:04.922787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:37:04.922787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:37:04.922787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:37:04.922787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:37:04.922787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:37:04.922787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:37:04.922787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:37:04.923694 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:37:04.923694 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:37:04.923694 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:37:04.923694 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:37:04.923694 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:37:04.923694 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:37:04.923694 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:37:04.923694 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:37:04.923694 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 547/1101] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:37:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:37:04.929816 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42650b-47ae-4e45-b608-563042dae527 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:04.959083 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:04.972529 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4879164-dcb3-4f15-9601-dd3d8a2453d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:04.974016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4879164-dcb3-4f15-9601-dd3d8a2453d5 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:05.030315 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42650b-47ae-4e45-b608-563042dae527 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:05.064629 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0fdf8-0dad-482a-b02a-d30e211b5091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:05.065273 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0fdf8-0dad-482a-b02a-d30e211b5091 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:05.065565 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0fdf8-0dad-482a-b02a-d30e211b5091 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:05.065831 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0fdf8-0dad-482a-b02a-d30e211b5091 None admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:05.066660 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0fdf8-0dad-482a-b02a-d30e211b5091 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:37:05.066963 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0fdf8-0dad-482a-b02a-d30e211b5091 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:05.068383 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0fdf8-0dad-482a-b02a-d30e211b5091 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:05.075363 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 555/1102] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:37:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 05 20:37:05.080089 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 548/1103] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 5 20:37:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:05.081297 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4879164-dcb3-4f15-9601-dd3d8a2453d5 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:05.085743 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0fdf8-0dad-482a-b02a-d30e211b5091 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:05.113714 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:05.168947 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:05.184511 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4879164-dcb3-4f15-9601-dd3d8a2453d5 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:05.187157 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0fdf8-0dad-482a-b02a-d30e211b5091 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:05.217493 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5535d3a-20af-4515-b5c0-c3193e636d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:05.218406 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5535d3a-20af-4515-b5c0-c3193e636d65 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:05.218684 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5535d3a-20af-4515-b5c0-c3193e636d65 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:05.218950 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5535d3a-20af-4515-b5c0-c3193e636d65 None admin] PATH_INFO: `/v3/projects/69220ad6fc8b4a12aab90c6c7b5c3373` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:05.220106 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5535d3a-20af-4515-b5c0-c3193e636d65 None admin] RBAC: Authorizing `identity:get_project(project_id=69220ad6fc8b4a12aab90c6c7b5c3373)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:05.220204 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d4e0d1-5cfe-46b7-a36a-ac98e4c7513e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:05.220819 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4e0d1-5cfe-46b7-a36a-ac98e4c7513e None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:05.221099 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4e0d1-5cfe-46b7-a36a-ac98e4c7513e None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:05.221371 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4e0d1-5cfe-46b7-a36a-ac98e4c7513e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:05.221548 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5535d3a-20af-4515-b5c0-c3193e636d65 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:05.222295 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d4e0d1-5cfe-46b7-a36a-ac98e4c7513e None admin] RBAC: Adding query filter params (role.id=8d9d4dd4ce594ddb9579d0e117ad02e9, scope.project.id=b321588ec1f14bcb94a184310cf72856, user.id=814b675b98b844a2a12a39890ee69d2b) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:37:05.222603 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d4e0d1-5cfe-46b7-a36a-ac98e4c7513e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:05.223298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 556/1104] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:37:05 2022] GET /identity/v3/projects/69220ad6fc8b4a12aab90c6c7b5c3373 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:05.224040 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d4e0d1-5cfe-46b7-a36a-ac98e4c7513e None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:05.229326 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5535d3a-20af-4515-b5c0-c3193e636d65 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:05.245869 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 549/1105] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:37:05 2022] GET /identity/v3/role_assignments?user.id=814b675b98b844a2a12a39890ee69d2b&scope.project.id=b321588ec1f14bcb94a184310cf72856&role.id=8d9d4dd4ce594ddb9579d0e117ad02e9 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:37:05.338367 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5535d3a-20af-4515-b5c0-c3193e636d65 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:05.376149 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa04c52-53e3-4e71-9cc5-888a7eebe911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:05.376811 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa04c52-53e3-4e71-9cc5-888a7eebe911 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:05.377089 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa04c52-53e3-4e71-9cc5-888a7eebe911 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:05.377360 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa04c52-53e3-4e71-9cc5-888a7eebe911 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:05.378219 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa04c52-53e3-4e71-9cc5-888a7eebe911 None admin] RBAC: Adding query filter params (role.id=37ba4a62052348d4811b560c19a07e02, scope.project.id=69220ad6fc8b4a12aab90c6c7b5c3373, user.id=3c1f9c38ff6b4639848e417b22ee7c78) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:37:05.378531 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa04c52-53e3-4e71-9cc5-888a7eebe911 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:05.379980 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa04c52-53e3-4e71-9cc5-888a7eebe911 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:05.386584 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 557/1106] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:37:05 2022] GET /identity/v3/role_assignments?user.id=3c1f9c38ff6b4639848e417b22ee7c78&scope.project.id=69220ad6fc8b4a12aab90c6c7b5c3373&role.id=37ba4a62052348d4811b560c19a07e02 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:37:07.456402 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43a89f-637a-4637-a3a8-d37b7c32f833 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:07.457217 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43a89f-637a-4637-a3a8-d37b7c32f833 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:07.457217 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43a89f-637a-4637-a3a8-d37b7c32f833 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:07.459461 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 550/1107] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:37:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:37:07.465700 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f0f3f-9c52-487d-bcf4-3948dd70ef30 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:07.466442 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f0f3f-9c52-487d-bcf4-3948dd70ef30 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:07.466591 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f0f3f-9c52-487d-bcf4-3948dd70ef30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:07.487632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-8e0f0f3f-9c52-487d-bcf4-3948dd70ef30 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:37:07.488824 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-8e0f0f3f-9c52-487d-bcf4-3948dd70ef30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:37:07.503084 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:07.560754 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 558/1108] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:37:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:37:07.585161 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43a89f-637a-4637-a3a8-d37b7c32f833 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:07.685169 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:07.696025 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43a89f-637a-4637-a3a8-d37b7c32f833 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:07.732240 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6b647-4773-4498-9b4d-38b94c4c2fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:07.732955 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6b647-4773-4498-9b4d-38b94c4c2fe2 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:07.733229 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6b647-4773-4498-9b4d-38b94c4c2fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:07.733496 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6b647-4773-4498-9b4d-38b94c4c2fe2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:07.734725 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af6b647-4773-4498-9b4d-38b94c4c2fe2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:07.736180 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af6b647-4773-4498-9b4d-38b94c4c2fe2 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:07.737781 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 551/1109] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:37:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:07.746311 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f0f3f-9c52-487d-bcf4-3948dd70ef30 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:07.845997 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f0f3f-9c52-487d-bcf4-3948dd70ef30 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:07.882140 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9ba67-36c4-4ff1-a845-e8260428c8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:07.882934 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9ba67-36c4-4ff1-a845-e8260428c8eb None admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:07.883092 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9ba67-36c4-4ff1-a845-e8260428c8eb None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:07.883340 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9ba67-36c4-4ff1-a845-e8260428c8eb None admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:07.884047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd9ba67-36c4-4ff1-a845-e8260428c8eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:07.885527 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd9ba67-36c4-4ff1-a845-e8260428c8eb None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:07.908819 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 559/1110] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Jul 5 20:37:07 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:37:09.960692 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91331a57-f6c9-492e-902c-58b24266c660 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:09.961568 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91331a57-f6c9-492e-902c-58b24266c660 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:09.961568 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91331a57-f6c9-492e-902c-58b24266c660 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:09.963611 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 552/1111] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:37:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:37:09.969294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd40946-ee90-4170-a1bb-b71aebebb092 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:09.969717 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd40946-ee90-4170-a1bb-b71aebebb092 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:09.969872 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd40946-ee90-4170-a1bb-b71aebebb092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:09.976422 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:09.988817 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-dcd40946-ee90-4170-a1bb-b71aebebb092 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:37:09.990075 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-dcd40946-ee90-4170-a1bb-b71aebebb092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:37:10.063854 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 560/1112] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:37:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:37:10.087502 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91331a57-f6c9-492e-902c-58b24266c660 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:10.210065 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91331a57-f6c9-492e-902c-58b24266c660 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:10.245293 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87811c2-c475-436f-b627-d031cabb83ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:10.246111 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87811c2-c475-436f-b627-d031cabb83ec None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:10.246391 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87811c2-c475-436f-b627-d031cabb83ec None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:10.246661 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87811c2-c475-436f-b627-d031cabb83ec None admin] PATH_INFO: `/v3/roles/c403525d65944d2187540a6d893b91e7` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:10.248176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87811c2-c475-436f-b627-d031cabb83ec None admin] RBAC: Authorizing `identity:get_role(role_id=c403525d65944d2187540a6d893b91e7)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:10.249574 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87811c2-c475-436f-b627-d031cabb83ec None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:10.251000 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 553/1113] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:37:10 2022] GET /identity/v3/roles/c403525d65944d2187540a6d893b91e7 => generated 223 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:10.257743 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd40946-ee90-4170-a1bb-b71aebebb092 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:10.368726 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd40946-ee90-4170-a1bb-b71aebebb092 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:10.403788 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794e391-0fd8-40ab-b507-e6f222cb24d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:10.404649 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794e391-0fd8-40ab-b507-e6f222cb24d7 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:10.404921 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794e391-0fd8-40ab-b507-e6f222cb24d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:10.405182 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794e391-0fd8-40ab-b507-e6f222cb24d7 None admin] PATH_INFO: `/v3/users/cc9ca6d0433049c8b14c3f8bf57bbb20` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:10.407408 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:10.420192 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794e391-0fd8-40ab-b507-e6f222cb24d7 None admin] RBAC: Authorizing `identity:get_user(user_id=cc9ca6d0433049c8b14c3f8bf57bbb20)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:10.421635 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794e391-0fd8-40ab-b507-e6f222cb24d7 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:10.423347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 561/1114] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:37:10 2022] GET /identity/v3/users/cc9ca6d0433049c8b14c3f8bf57bbb20 => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:10.429718 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87811c2-c475-436f-b627-d031cabb83ec None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:10.472669 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:10.547072 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87811c2-c475-436f-b627-d031cabb83ec None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:10.583549 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1e003-d282-4acc-9966-8152b156ee97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:10.584209 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1e003-d282-4acc-9966-8152b156ee97 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:10.584489 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1e003-d282-4acc-9966-8152b156ee97 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:10.584766 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1e003-d282-4acc-9966-8152b156ee97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:10.663628 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1e003-d282-4acc-9966-8152b156ee97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:10.665093 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1e003-d282-4acc-9966-8152b156ee97 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:10.695121 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:10.767217 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 554/1115] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:37:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 20:37:10.776873 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794e391-0fd8-40ab-b507-e6f222cb24d7 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:10.892659 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794e391-0fd8-40ab-b507-e6f222cb24d7 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:10.928154 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea54756-4ad8-4289-8c5e-0072e171b549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:10.929004 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea54756-4ad8-4289-8c5e-0072e171b549 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:10.929282 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea54756-4ad8-4289-8c5e-0072e171b549 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:10.929552 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea54756-4ad8-4289-8c5e-0072e171b549 None admin] PATH_INFO: `/v3/projects/69220ad6fc8b4a12aab90c6c7b5c3373` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:10.930871 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea54756-4ad8-4289-8c5e-0072e171b549 None admin] RBAC: Authorizing `identity:get_project(project_id=69220ad6fc8b4a12aab90c6c7b5c3373)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:10.932405 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea54756-4ad8-4289-8c5e-0072e171b549 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:10.934129 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 562/1116] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:37:10 2022] GET /identity/v3/projects/69220ad6fc8b4a12aab90c6c7b5c3373 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:10.943156 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1e003-d282-4acc-9966-8152b156ee97 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:11.056954 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1e003-d282-4acc-9966-8152b156ee97 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:11.085966 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:11.095321 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d07e0-e126-4dca-9a49-18b3a6c54d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:11.095977 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d07e0-e126-4dca-9a49-18b3a6c54d6c None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:11.096258 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d07e0-e126-4dca-9a49-18b3a6c54d6c None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:11.096523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d07e0-e126-4dca-9a49-18b3a6c54d6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:11.097356 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d07e0-e126-4dca-9a49-18b3a6c54d6c None admin] RBAC: Adding query filter params (role.id=c403525d65944d2187540a6d893b91e7, scope.project.id=69220ad6fc8b4a12aab90c6c7b5c3373, user.id=cc9ca6d0433049c8b14c3f8bf57bbb20) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:37:11.097662 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d07e0-e126-4dca-9a49-18b3a6c54d6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:11.099149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d07e0-e126-4dca-9a49-18b3a6c54d6c None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:11.104818 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 555/1117] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:37:10 2022] GET /identity/v3/role_assignments?user.id=cc9ca6d0433049c8b14c3f8bf57bbb20&scope.project.id=69220ad6fc8b4a12aab90c6c7b5c3373&role.id=c403525d65944d2187540a6d893b91e7 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:37:13.072410 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebf42a-ff4b-4aa6-81b6-7d7665c8358f None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:13.073089 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebf42a-ff4b-4aa6-81b6-7d7665c8358f None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:13.073089 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebf42a-ff4b-4aa6-81b6-7d7665c8358f None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:13.074364 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 563/1118] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:37:13.079818 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c323bee-652f-478f-aafa-8d2ed695c619 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:13.080266 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c323bee-652f-478f-aafa-8d2ed695c619 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:13.080367 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c323bee-652f-478f-aafa-8d2ed695c619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:13.099151 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-0c323bee-652f-478f-aafa-8d2ed695c619 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:37:13.100342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-0c323bee-652f-478f-aafa-8d2ed695c619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:37:13.174052 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 556/1119] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:37:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:37:13.196862 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebf42a-ff4b-4aa6-81b6-7d7665c8358f None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:13.265029 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:13.308353 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebf42a-ff4b-4aa6-81b6-7d7665c8358f None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:13.343394 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8be1f3-c9c8-4c5b-8688-0d7eeb218e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:13.344227 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8be1f3-c9c8-4c5b-8688-0d7eeb218e95 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:13.344498 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8be1f3-c9c8-4c5b-8688-0d7eeb218e95 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:13.344767 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8be1f3-c9c8-4c5b-8688-0d7eeb218e95 None admin] PATH_INFO: `/v3/roles/c403525d65944d2187540a6d893b91e7` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:13.346297 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8be1f3-c9c8-4c5b-8688-0d7eeb218e95 None admin] RBAC: Authorizing `identity:get_role(role_id=c403525d65944d2187540a6d893b91e7)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:13.347678 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8be1f3-c9c8-4c5b-8688-0d7eeb218e95 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:13.349034 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 564/1120] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:37:13 2022] GET /identity/v3/roles/c403525d65944d2187540a6d893b91e7 => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:13.356788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c323bee-652f-478f-aafa-8d2ed695c619 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:13.461383 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c323bee-652f-478f-aafa-8d2ed695c619 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:13.484536 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:13.496216 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ec6b9-919b-4ad1-aaec-beef3a6e8e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:13.497092 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ec6b9-919b-4ad1-aaec-beef3a6e8e03 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:13.497369 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ec6b9-919b-4ad1-aaec-beef3a6e8e03 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:13.497641 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ec6b9-919b-4ad1-aaec-beef3a6e8e03 None admin] PATH_INFO: `/v3/users/cc9ca6d0433049c8b14c3f8bf57bbb20` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:13.498830 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ec6b9-919b-4ad1-aaec-beef3a6e8e03 None admin] RBAC: Authorizing `identity:get_user(user_id=cc9ca6d0433049c8b14c3f8bf57bbb20)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:13.500285 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ec6b9-919b-4ad1-aaec-beef3a6e8e03 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:13.501918 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 557/1121] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:37:13 2022] GET /identity/v3/users/cc9ca6d0433049c8b14c3f8bf57bbb20 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:13.510769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8be1f3-c9c8-4c5b-8688-0d7eeb218e95 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:13.614521 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8be1f3-c9c8-4c5b-8688-0d7eeb218e95 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:13.640198 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:13.649284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50c533-9144-4d7a-be0c-9c785943ba41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:13.650168 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50c533-9144-4d7a-be0c-9c785943ba41 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:13.650464 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50c533-9144-4d7a-be0c-9c785943ba41 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:13.650847 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50c533-9144-4d7a-be0c-9c785943ba41 None admin] PATH_INFO: `/v3/projects/69220ad6fc8b4a12aab90c6c7b5c3373` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:13.652651 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c50c533-9144-4d7a-be0c-9c785943ba41 None admin] RBAC: Authorizing `identity:get_project(project_id=69220ad6fc8b4a12aab90c6c7b5c3373)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:13.655031 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c50c533-9144-4d7a-be0c-9c785943ba41 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:13.657698 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 565/1122] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:37:13 2022] GET /identity/v3/projects/69220ad6fc8b4a12aab90c6c7b5c3373 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:13.667652 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ec6b9-919b-4ad1-aaec-beef3a6e8e03 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:13.787983 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ec6b9-919b-4ad1-aaec-beef3a6e8e03 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:13.826517 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102085c-b1a4-46f9-9232-eb01d16ecbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:13.827415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102085c-b1a4-46f9-9232-eb01d16ecbd7 None admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:13.827697 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102085c-b1a4-46f9-9232-eb01d16ecbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:13.827971 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102085c-b1a4-46f9-9232-eb01d16ecbd7 None admin] PATH_INFO: `/v3/projects/69220ad6fc8b4a12aab90c6c7b5c3373/users/cc9ca6d0433049c8b14c3f8bf57bbb20/roles/c403525d65944d2187540a6d893b91e7` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:13.830561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a102085c-b1a4-46f9-9232-eb01d16ecbd7 None admin] RBAC: Authorizing `identity:create_grant(project_id=69220ad6fc8b4a12aab90c6c7b5c3373, user_id=cc9ca6d0433049c8b14c3f8bf57bbb20, role_id=c403525d65944d2187540a6d893b91e7)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:13.832017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a102085c-b1a4-46f9-9232-eb01d16ecbd7 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:13.848696 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 558/1123] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 5 20:37:13 2022] PUT /identity/v3/projects/69220ad6fc8b4a12aab90c6c7b5c3373/users/cc9ca6d0433049c8b14c3f8bf57bbb20/roles/c403525d65944d2187540a6d893b91e7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:37:15.835902 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8bcd5-22fb-4d3e-8a40-205d2bbbb0e0 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:15.836503 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8bcd5-22fb-4d3e-8a40-205d2bbbb0e0 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:15.836503 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8bcd5-22fb-4d3e-8a40-205d2bbbb0e0 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:15.837886 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 566/1124] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:37:15.844216 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9a14c-a540-4102-8f9e-0c1aaa74fa0b None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:15.844928 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9a14c-a540-4102-8f9e-0c1aaa74fa0b None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:15.845081 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9a14c-a540-4102-8f9e-0c1aaa74fa0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:15.866945 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-4ea9a14c-a540-4102-8f9e-0c1aaa74fa0b None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:37:15.868142 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-4ea9a14c-a540-4102-8f9e-0c1aaa74fa0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:37:15.919367 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:15.942996 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 559/1125] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:37:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:37:15.966418 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8bcd5-22fb-4d3e-8a40-205d2bbbb0e0 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:16.074111 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8bcd5-22fb-4d3e-8a40-205d2bbbb0e0 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:16.109369 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511f4f6-ec1e-4f62-8b28-a51888c72e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:16.110169 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511f4f6-ec1e-4f62-8b28-a51888c72e1a None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:16.110455 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511f4f6-ec1e-4f62-8b28-a51888c72e1a None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:16.110712 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511f4f6-ec1e-4f62-8b28-a51888c72e1a None admin] PATH_INFO: `/v3/roles/c403525d65944d2187540a6d893b91e7` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:16.112297 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511f4f6-ec1e-4f62-8b28-a51888c72e1a None admin] RBAC: Authorizing `identity:get_role(role_id=c403525d65944d2187540a6d893b91e7)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:16.113678 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511f4f6-ec1e-4f62-8b28-a51888c72e1a None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:16.115092 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 567/1126] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:37:15 2022] GET /identity/v3/roles/c403525d65944d2187540a6d893b91e7 => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:16.121343 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9a14c-a540-4102-8f9e-0c1aaa74fa0b None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:16.221502 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9a14c-a540-4102-8f9e-0c1aaa74fa0b None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:16.257080 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e71a61-248d-435d-a986-81275bb2abde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:16.257978 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e71a61-248d-435d-a986-81275bb2abde None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:16.258260 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e71a61-248d-435d-a986-81275bb2abde None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:16.258533 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e71a61-248d-435d-a986-81275bb2abde None admin] PATH_INFO: `/v3/users/cc9ca6d0433049c8b14c3f8bf57bbb20` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:16.259862 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e71a61-248d-435d-a986-81275bb2abde None admin] RBAC: Authorizing `identity:get_user(user_id=cc9ca6d0433049c8b14c3f8bf57bbb20)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:16.261315 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e71a61-248d-435d-a986-81275bb2abde None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:16.262981 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 560/1127] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:37:16 2022] GET /identity/v3/users/cc9ca6d0433049c8b14c3f8bf57bbb20 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:16.269150 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511f4f6-ec1e-4f62-8b28-a51888c72e1a None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:16.332555 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:16.372226 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511f4f6-ec1e-4f62-8b28-a51888c72e1a None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:16.413103 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9837f6-3305-4e91-b18a-e901c9c24394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:16.413738 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9837f6-3305-4e91-b18a-e901c9c24394 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:16.414143 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9837f6-3305-4e91-b18a-e901c9c24394 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:16.414418 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9837f6-3305-4e91-b18a-e901c9c24394 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:16.487205 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9837f6-3305-4e91-b18a-e901c9c24394 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:16.488646 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9837f6-3305-4e91-b18a-e901c9c24394 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:16.549729 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:16.589942 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 568/1128] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:37:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 20:37:16.596192 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e71a61-248d-435d-a986-81275bb2abde None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:16.646358 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:16.700360 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e71a61-248d-435d-a986-81275bb2abde None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:16.735689 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e5fda9-9506-4b7b-ab6f-6f73da345491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:16.736550 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5fda9-9506-4b7b-ab6f-6f73da345491 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:16.736828 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5fda9-9506-4b7b-ab6f-6f73da345491 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:16.737099 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5fda9-9506-4b7b-ab6f-6f73da345491 None admin] PATH_INFO: `/v3/projects/69220ad6fc8b4a12aab90c6c7b5c3373` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:16.738346 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e5fda9-9506-4b7b-ab6f-6f73da345491 None admin] RBAC: Authorizing `identity:get_project(project_id=69220ad6fc8b4a12aab90c6c7b5c3373)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:16.739809 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e5fda9-9506-4b7b-ab6f-6f73da345491 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:16.741510 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 561/1129] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:37:16 2022] GET /identity/v3/projects/69220ad6fc8b4a12aab90c6c7b5c3373 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:16.748550 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9837f6-3305-4e91-b18a-e901c9c24394 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:16.866917 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9837f6-3305-4e91-b18a-e901c9c24394 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:16.901715 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0385cfc-6450-4d43-b5e9-f34130f7b263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:16.902323 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0385cfc-6450-4d43-b5e9-f34130f7b263 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:16.902605 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0385cfc-6450-4d43-b5e9-f34130f7b263 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:16.902883 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0385cfc-6450-4d43-b5e9-f34130f7b263 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:16.903714 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0385cfc-6450-4d43-b5e9-f34130f7b263 None admin] RBAC: Adding query filter params (role.id=c403525d65944d2187540a6d893b91e7, scope.project.id=69220ad6fc8b4a12aab90c6c7b5c3373, user.id=cc9ca6d0433049c8b14c3f8bf57bbb20) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:37:16.904027 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0385cfc-6450-4d43-b5e9-f34130f7b263 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:16.905483 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0385cfc-6450-4d43-b5e9-f34130f7b263 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:16.911521 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 569/1130] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:37:16 2022] GET /identity/v3/role_assignments?user.id=cc9ca6d0433049c8b14c3f8bf57bbb20&scope.project.id=69220ad6fc8b4a12aab90c6c7b5c3373&role.id=c403525d65944d2187540a6d893b91e7 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:18.930329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a09bf3-fc29-415c-918f-ee44287a9dc1 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:18.931284 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a09bf3-fc29-415c-918f-ee44287a9dc1 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:18.931284 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a09bf3-fc29-415c-918f-ee44287a9dc1 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:18.932745 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 562/1131] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:37:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:37:18.938236 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ddca3-a2df-4a0c-8c95-0477f4763c3c None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:18.938674 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ddca3-a2df-4a0c-8c95-0477f4763c3c None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:18.938797 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ddca3-a2df-4a0c-8c95-0477f4763c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:18.956879 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-424ddca3-a2df-4a0c-8c95-0477f4763c3c None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:37:18.958075 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-424ddca3-a2df-4a0c-8c95-0477f4763c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:37:18.981588 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:19.030876 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 570/1132] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:37:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:37:19.055291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a09bf3-fc29-415c-918f-ee44287a9dc1 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:19.174575 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a09bf3-fc29-415c-918f-ee44287a9dc1 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:19.193226 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:19.218177 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9714eda-c854-49e4-b2d3-08ca6e7dcdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:19.218968 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9714eda-c854-49e4-b2d3-08ca6e7dcdf2 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:19.219242 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9714eda-c854-49e4-b2d3-08ca6e7dcdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:19.219513 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9714eda-c854-49e4-b2d3-08ca6e7dcdf2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:19.220722 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9714eda-c854-49e4-b2d3-08ca6e7dcdf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:19.222191 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9714eda-c854-49e4-b2d3-08ca6e7dcdf2 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:19.223814 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 563/1133] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:37:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:19.233284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ddca3-a2df-4a0c-8c95-0477f4763c3c None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:19.345897 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ddca3-a2df-4a0c-8c95-0477f4763c3c None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:19.381078 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447479df-accd-44b6-bb9a-b8659d9e2254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:19.381710 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447479df-accd-44b6-bb9a-b8659d9e2254 None admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:19.382013 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447479df-accd-44b6-bb9a-b8659d9e2254 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:19.382282 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447479df-accd-44b6-bb9a-b8659d9e2254 None admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:19.382971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447479df-accd-44b6-bb9a-b8659d9e2254 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:19.384452 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447479df-accd-44b6-bb9a-b8659d9e2254 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:19.412790 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 571/1134] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Jul 5 20:37:19 2022] POST /identity/v3/projects => generated 311 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:37:21.438951 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884740f-7f39-43b9-b1f4-08167a319af1 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:21.439493 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884740f-7f39-43b9-b1f4-08167a319af1 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:21.439493 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4884740f-7f39-43b9-b1f4-08167a319af1 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:21.440793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 564/1135] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:37:21.447173 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509c7fa-ce69-4f55-8434-df18d637bc0e None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:21.447886 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509c7fa-ce69-4f55-8434-df18d637bc0e None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:21.448115 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509c7fa-ce69-4f55-8434-df18d637bc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:21.470634 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-a509c7fa-ce69-4f55-8434-df18d637bc0e None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:37:21.471827 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-a509c7fa-ce69-4f55-8434-df18d637bc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:37:21.474645 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:21.548082 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 572/1136] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:37:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:37:21.575818 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884740f-7f39-43b9-b1f4-08167a319af1 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:21.686853 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4884740f-7f39-43b9-b1f4-08167a319af1 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:21.724121 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71566647-b15a-403d-a6b1-5dd9461059ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:21.724842 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71566647-b15a-403d-a6b1-5dd9461059ef None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:21.725122 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71566647-b15a-403d-a6b1-5dd9461059ef None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:21.725393 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71566647-b15a-403d-a6b1-5dd9461059ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:21.726616 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71566647-b15a-403d-a6b1-5dd9461059ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:21.728187 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71566647-b15a-403d-a6b1-5dd9461059ef None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:21.729796 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 565/1137] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:37:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:21.738220 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509c7fa-ce69-4f55-8434-df18d637bc0e None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:21.858310 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509c7fa-ce69-4f55-8434-df18d637bc0e None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:21.893805 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca25757-c6ee-44e6-a43f-ece3a9a973c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:21.894488 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca25757-c6ee-44e6-a43f-ece3a9a973c6 None admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:21.894762 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca25757-c6ee-44e6-a43f-ece3a9a973c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:21.895062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca25757-c6ee-44e6-a43f-ece3a9a973c6 None admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:21.895751 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca25757-c6ee-44e6-a43f-ece3a9a973c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:21.897188 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca25757-c6ee-44e6-a43f-ece3a9a973c6 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:21.907848 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:21.920951 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 573/1138] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Jul 5 20:37:21 2022] POST /identity/v3/users => generated 286 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:37:23.950216 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c5e57-094e-4dda-9054-a4bef4dd4d17 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:23.950797 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c5e57-094e-4dda-9054-a4bef4dd4d17 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:23.950797 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c5e57-094e-4dda-9054-a4bef4dd4d17 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:23.952158 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 566/1139] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:37:23.958507 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9b3b4-32bc-40bd-a3eb-3a9c0c391c8f None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:23.959181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9b3b4-32bc-40bd-a3eb-3a9c0c391c8f None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:23.959375 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9b3b4-32bc-40bd-a3eb-3a9c0c391c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:23.984800 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-b7d9b3b4-32bc-40bd-a3eb-3a9c0c391c8f None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:37:23.986025 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-b7d9b3b4-32bc-40bd-a3eb-3a9c0c391c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:37:24.062525 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 574/1140] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:37:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:37:24.090866 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c5e57-094e-4dda-9054-a4bef4dd4d17 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:24.146873 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:24.202950 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c5e57-094e-4dda-9054-a4bef4dd4d17 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:24.240634 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95daf22-34b5-4518-ba69-d8b753746748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:24.241417 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95daf22-34b5-4518-ba69-d8b753746748 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:24.241692 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95daf22-34b5-4518-ba69-d8b753746748 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:24.241993 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95daf22-34b5-4518-ba69-d8b753746748 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:24.253004 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95daf22-34b5-4518-ba69-d8b753746748 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:37:24.260564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-c95daf22-34b5-4518-ba69-d8b753746748 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:37:24.260564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:37:24.260564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:37:24.260564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:37:24.260564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:37:24.260564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:37:24.260564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:37:24.260564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:37:24.260564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:37:24.260564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:37:24.260564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:37:24.260564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:37:24.260564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:37:24.260564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:37:24.260564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:37:24.260564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:37:24.261679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:37:24.261679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:37:24.261679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:37:24.261679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:37:24.261679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:37:24.261679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:37:24.261679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:37:24.261679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:37:24.261679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:37:24.261679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:37:24.261679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:37:24.261679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:37:24.261679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:37:24.261679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:37:24.261679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:37:24.261679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:37:24.262679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:37:24.262679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:37:24.262679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:37:24.262679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:37:24.262679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:37:24.262679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:37:24.262679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:37:24.262679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:37:24.262679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:37:24.262679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:37:24.262679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:37:24.262679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:37:24.262679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 567/1141] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 5 20:37:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:37:24.269834 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9b3b4-32bc-40bd-a3eb-3a9c0c391c8f None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:24.374630 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9b3b4-32bc-40bd-a3eb-3a9c0c391c8f None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:24.402548 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:24.412391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c3cae-57c1-4cf8-8429-11553f0cd8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:24.413049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c3cae-57c1-4cf8-8429-11553f0cd8a3 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:24.413328 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c3cae-57c1-4cf8-8429-11553f0cd8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:24.413609 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c3cae-57c1-4cf8-8429-11553f0cd8a3 None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:24.414378 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c3cae-57c1-4cf8-8429-11553f0cd8a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:37:24.414681 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c3cae-57c1-4cf8-8429-11553f0cd8a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:24.416082 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10c3cae-57c1-4cf8-8429-11553f0cd8a3 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:24.425225 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 575/1142] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:37:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:24.431570 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95daf22-34b5-4518-ba69-d8b753746748 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:24.540473 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95daf22-34b5-4518-ba69-d8b753746748 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:24.555353 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:24.578624 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15042543-4fb6-4ad9-88e2-630b09de5237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:24.579491 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15042543-4fb6-4ad9-88e2-630b09de5237 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:24.579762 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15042543-4fb6-4ad9-88e2-630b09de5237 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:24.580034 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15042543-4fb6-4ad9-88e2-630b09de5237 None admin] PATH_INFO: `/v3/users/e588567040a948919b8fc52d23dd894b` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:24.594183 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15042543-4fb6-4ad9-88e2-630b09de5237 None admin] RBAC: Authorizing `identity:get_user(user_id=e588567040a948919b8fc52d23dd894b)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:24.595632 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15042543-4fb6-4ad9-88e2-630b09de5237 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:24.597256 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 568/1143] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:37:24 2022] GET /identity/v3/users/e588567040a948919b8fc52d23dd894b => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:24.603500 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c3cae-57c1-4cf8-8429-11553f0cd8a3 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:24.707830 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c3cae-57c1-4cf8-8429-11553f0cd8a3 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:24.742884 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7264b-6e5b-460e-8b1d-7491392a3ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:24.743540 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7264b-6e5b-460e-8b1d-7491392a3ea0 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:24.743821 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7264b-6e5b-460e-8b1d-7491392a3ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:24.744097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7264b-6e5b-460e-8b1d-7491392a3ea0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:24.806383 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:24.825831 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7264b-6e5b-460e-8b1d-7491392a3ea0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:24.827328 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7264b-6e5b-460e-8b1d-7491392a3ea0 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:24.927797 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 576/1144] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:37:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 20:37:24.934460 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15042543-4fb6-4ad9-88e2-630b09de5237 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:25.047471 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15042543-4fb6-4ad9-88e2-630b09de5237 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:25.082240 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2ba2c-ed23-447e-9cf0-9b7b8ba53b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:25.083085 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2ba2c-ed23-447e-9cf0-9b7b8ba53b0e None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:25.083361 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2ba2c-ed23-447e-9cf0-9b7b8ba53b0e None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:25.083629 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2ba2c-ed23-447e-9cf0-9b7b8ba53b0e None admin] PATH_INFO: `/v3/projects/c842c78184a04a9ba9ec670ed7ad0e7a` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:25.084915 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c2ba2c-ed23-447e-9cf0-9b7b8ba53b0e None admin] RBAC: Authorizing `identity:get_project(project_id=c842c78184a04a9ba9ec670ed7ad0e7a)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:25.086413 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c2ba2c-ed23-447e-9cf0-9b7b8ba53b0e None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:25.088314 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 569/1145] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:37:24 2022] GET /identity/v3/projects/c842c78184a04a9ba9ec670ed7ad0e7a => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:25.097995 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7264b-6e5b-460e-8b1d-7491392a3ea0 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:25.197158 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:25.217409 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7264b-6e5b-460e-8b1d-7491392a3ea0 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:25.261128 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c9c2b-5e90-426c-a93c-49d2a4831655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:25.262070 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c9c2b-5e90-426c-a93c-49d2a4831655 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:25.262355 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c9c2b-5e90-426c-a93c-49d2a4831655 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:25.262654 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c9c2b-5e90-426c-a93c-49d2a4831655 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:25.263901 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c9c2b-5e90-426c-a93c-49d2a4831655 None admin] RBAC: Adding query filter params (role.id=37ba4a62052348d4811b560c19a07e02, scope.project.id=c842c78184a04a9ba9ec670ed7ad0e7a, user.id=e588567040a948919b8fc52d23dd894b) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:37:25.264271 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c9c2b-5e90-426c-a93c-49d2a4831655 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:25.266534 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c9c2b-5e90-426c-a93c-49d2a4831655 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:25.275669 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 577/1146] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:37:25 2022] GET /identity/v3/role_assignments?user.id=e588567040a948919b8fc52d23dd894b&scope.project.id=c842c78184a04a9ba9ec670ed7ad0e7a&role.id=37ba4a62052348d4811b560c19a07e02 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:27.250380 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665088c-aa5d-4f56-a4f5-a40d3efda362 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:27.251210 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665088c-aa5d-4f56-a4f5-a40d3efda362 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:27.251210 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665088c-aa5d-4f56-a4f5-a40d3efda362 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:27.253481 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 570/1147] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:37:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:37:27.259821 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b29ef-fe44-4d0c-b920-ee5d32fa03f0 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:27.260247 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b29ef-fe44-4d0c-b920-ee5d32fa03f0 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:27.260363 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b29ef-fe44-4d0c-b920-ee5d32fa03f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:27.284057 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-af3b29ef-fe44-4d0c-b920-ee5d32fa03f0 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:37:27.285250 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-af3b29ef-fe44-4d0c-b920-ee5d32fa03f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:37:27.357967 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 578/1148] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:37:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:37:27.381322 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665088c-aa5d-4f56-a4f5-a40d3efda362 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:27.430142 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:27.493019 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665088c-aa5d-4f56-a4f5-a40d3efda362 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:27.527988 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdbc78-2288-4277-a2e9-382f1971dbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:27.528772 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdbc78-2288-4277-a2e9-382f1971dbb8 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:27.529053 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdbc78-2288-4277-a2e9-382f1971dbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:27.529328 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdbc78-2288-4277-a2e9-382f1971dbb8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:27.540504 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bdbc78-2288-4277-a2e9-382f1971dbb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:37:27.548580 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-26bdbc78-2288-4277-a2e9-382f1971dbb8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:37:27.548580 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:37:27.548580 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:37:27.548580 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:37:27.548580 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:37:27.548580 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:37:27.548580 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:37:27.548580 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:37:27.548580 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:37:27.548580 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:37:27.548580 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:37:27.548580 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:37:27.548580 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:37:27.548580 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:37:27.548580 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:37:27.548580 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:37:27.549561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:37:27.549561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:37:27.549561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:37:27.549561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:37:27.549561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:37:27.549561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:37:27.549561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:37:27.549561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:37:27.549561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:37:27.549561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:37:27.549561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:37:27.549561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:37:27.549561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:37:27.549561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:37:27.549561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:37:27.549561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:37:27.550652 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:37:27.550652 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:37:27.550652 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:37:27.550652 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:37:27.550652 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:37:27.550652 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:37:27.550652 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:37:27.550652 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:37:27.550652 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:37:27.550652 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:37:27.550652 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:37:27.550652 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:37:27.550652 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 571/1149] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 5 20:37:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:37:27.559298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b29ef-fe44-4d0c-b920-ee5d32fa03f0 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:27.647145 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:27.665833 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b29ef-fe44-4d0c-b920-ee5d32fa03f0 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:27.702821 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a807c-eef1-4365-8c8c-9979b750bba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:27.703411 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a807c-eef1-4365-8c8c-9979b750bba7 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:27.703690 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a807c-eef1-4365-8c8c-9979b750bba7 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:27.703961 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a807c-eef1-4365-8c8c-9979b750bba7 None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:27.704700 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a807c-eef1-4365-8c8c-9979b750bba7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:37:27.705002 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a807c-eef1-4365-8c8c-9979b750bba7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:27.706413 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a807c-eef1-4365-8c8c-9979b750bba7 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:27.714644 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 579/1150] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:37:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:27.721325 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdbc78-2288-4277-a2e9-382f1971dbb8 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:27.829410 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:27.835914 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdbc78-2288-4277-a2e9-382f1971dbb8 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:27.880074 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc3855-93bd-4c73-ab22-94e1fb8fecc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:27.880944 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc3855-93bd-4c73-ab22-94e1fb8fecc9 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:27.881222 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc3855-93bd-4c73-ab22-94e1fb8fecc9 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:27.881496 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc3855-93bd-4c73-ab22-94e1fb8fecc9 None admin] PATH_INFO: `/v3/users/e588567040a948919b8fc52d23dd894b` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:27.882779 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc3855-93bd-4c73-ab22-94e1fb8fecc9 None admin] RBAC: Authorizing `identity:get_user(user_id=e588567040a948919b8fc52d23dd894b)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:27.884254 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc3855-93bd-4c73-ab22-94e1fb8fecc9 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:27.885965 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 572/1151] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:37:27 2022] GET /identity/v3/users/e588567040a948919b8fc52d23dd894b => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:27.892153 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a807c-eef1-4365-8c8c-9979b750bba7 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:27.994181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a807c-eef1-4365-8c8c-9979b750bba7 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:28.033053 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03859a-1985-4c43-a117-ffd45d5a3c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:28.033901 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03859a-1985-4c43-a117-ffd45d5a3c72 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:28.034210 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03859a-1985-4c43-a117-ffd45d5a3c72 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:28.034478 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03859a-1985-4c43-a117-ffd45d5a3c72 None admin] PATH_INFO: `/v3/projects/c842c78184a04a9ba9ec670ed7ad0e7a` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:28.035788 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03859a-1985-4c43-a117-ffd45d5a3c72 None admin] RBAC: Authorizing `identity:get_project(project_id=c842c78184a04a9ba9ec670ed7ad0e7a)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:28.037222 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03859a-1985-4c43-a117-ffd45d5a3c72 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:28.038953 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 580/1152] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:37:27 2022] GET /identity/v3/projects/c842c78184a04a9ba9ec670ed7ad0e7a => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:28.049035 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc3855-93bd-4c73-ab22-94e1fb8fecc9 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:28.169034 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc3855-93bd-4c73-ab22-94e1fb8fecc9 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:28.205138 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12059834-f2e6-45d5-80bd-93b79fd69930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:28.206040 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12059834-f2e6-45d5-80bd-93b79fd69930 None admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:28.206318 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12059834-f2e6-45d5-80bd-93b79fd69930 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:28.206586 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12059834-f2e6-45d5-80bd-93b79fd69930 None admin] PATH_INFO: `/v3/projects/c842c78184a04a9ba9ec670ed7ad0e7a/users/e588567040a948919b8fc52d23dd894b/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:28.208624 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12059834-f2e6-45d5-80bd-93b79fd69930 None admin] RBAC: Authorizing `identity:create_grant(project_id=c842c78184a04a9ba9ec670ed7ad0e7a, user_id=e588567040a948919b8fc52d23dd894b, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:28.210086 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12059834-f2e6-45d5-80bd-93b79fd69930 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:28.225716 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 573/1153] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 5 20:37:28 2022] PUT /identity/v3/projects/c842c78184a04a9ba9ec670ed7ad0e7a/users/e588567040a948919b8fc52d23dd894b/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:37:30.195043 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03887576-639b-4272-9440-68c0a368ed5c None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:30.195548 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03887576-639b-4272-9440-68c0a368ed5c None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:30.195548 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03887576-639b-4272-9440-68c0a368ed5c None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:30.196969 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 581/1154] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:37:30.203421 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edc42e-1b43-466f-80af-1fbca16701fa None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:30.204144 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edc42e-1b43-466f-80af-1fbca16701fa None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:30.204312 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02edc42e-1b43-466f-80af-1fbca16701fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:30.225234 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-02edc42e-1b43-466f-80af-1fbca16701fa None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:37:30.226464 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-02edc42e-1b43-466f-80af-1fbca16701fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:37:30.246623 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:30.297534 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 574/1155] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:37:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:37:30.321536 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03887576-639b-4272-9440-68c0a368ed5c None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:30.337501 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:30.432384 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03887576-639b-4272-9440-68c0a368ed5c None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:30.466821 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3885ce9-7f26-4c49-b155-583e018c72a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:30.467597 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3885ce9-7f26-4c49-b155-583e018c72a3 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:30.467875 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3885ce9-7f26-4c49-b155-583e018c72a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:30.468147 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3885ce9-7f26-4c49-b155-583e018c72a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:30.479389 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3885ce9-7f26-4c49-b155-583e018c72a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:37:30.486979 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-f3885ce9-7f26-4c49-b155-583e018c72a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:37:30.486979 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:37:30.486979 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:37:30.486979 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:37:30.486979 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:37:30.486979 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:37:30.486979 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:37:30.486979 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:37:30.486979 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:37:30.486979 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:37:30.486979 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:37:30.486979 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:37:30.486979 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:37:30.486979 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:37:30.486979 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:37:30.486979 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:37:30.488064 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:37:30.488064 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:37:30.488064 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:37:30.488064 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:37:30.488064 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:37:30.488064 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:37:30.488064 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:37:30.488064 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:37:30.488064 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:37:30.488064 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:37:30.488064 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:37:30.488064 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:37:30.488064 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:37:30.488064 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:37:30.488064 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:37:30.488064 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:37:30.489085 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:37:30.489085 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:37:30.489085 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:37:30.489085 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:37:30.489085 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:37:30.489085 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:37:30.489085 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:37:30.489085 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:37:30.489085 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:37:30.489085 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:37:30.489085 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:37:30.489085 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:37:30.489085 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 582/1156] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 5 20:37:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:37:30.495126 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02edc42e-1b43-466f-80af-1fbca16701fa None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:30.606485 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02edc42e-1b43-466f-80af-1fbca16701fa None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:30.644879 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b11a2-d710-4260-9ceb-f05c09de9f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:30.645951 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b11a2-d710-4260-9ceb-f05c09de9f16 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:30.646337 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b11a2-d710-4260-9ceb-f05c09de9f16 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:30.646742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b11a2-d710-4260-9ceb-f05c09de9f16 None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:30.647925 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9b11a2-d710-4260-9ceb-f05c09de9f16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:37:30.648380 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9b11a2-d710-4260-9ceb-f05c09de9f16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:30.650610 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9b11a2-d710-4260-9ceb-f05c09de9f16 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:30.663675 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 575/1157] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:37:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:30.669657 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3885ce9-7f26-4c49-b155-583e018c72a3 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:30.744478 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:30.787973 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3885ce9-7f26-4c49-b155-583e018c72a3 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:30.825149 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e56c7-b07d-4533-a1b1-9b395c95eac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:30.826034 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e56c7-b07d-4533-a1b1-9b395c95eac2 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:30.826322 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e56c7-b07d-4533-a1b1-9b395c95eac2 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:30.826593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e56c7-b07d-4533-a1b1-9b395c95eac2 None admin] PATH_INFO: `/v3/users/e588567040a948919b8fc52d23dd894b` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:30.827839 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e56c7-b07d-4533-a1b1-9b395c95eac2 None admin] RBAC: Authorizing `identity:get_user(user_id=e588567040a948919b8fc52d23dd894b)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:30.829265 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e56c7-b07d-4533-a1b1-9b395c95eac2 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:30.830929 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 583/1158] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:37:30 2022] GET /identity/v3/users/e588567040a948919b8fc52d23dd894b => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:30.837905 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b11a2-d710-4260-9ceb-f05c09de9f16 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:30.864941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:30.950245 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b11a2-d710-4260-9ceb-f05c09de9f16 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:30.984390 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375bc68-631f-4d11-aade-46f9854b9214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:30.985024 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375bc68-631f-4d11-aade-46f9854b9214 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:30.985299 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375bc68-631f-4d11-aade-46f9854b9214 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:30.985564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375bc68-631f-4d11-aade-46f9854b9214 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:31.055338 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d375bc68-631f-4d11-aade-46f9854b9214 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:31.056720 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d375bc68-631f-4d11-aade-46f9854b9214 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:31.075926 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:31.169970 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 576/1159] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:37:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 20:37:31.176678 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e56c7-b07d-4533-a1b1-9b395c95eac2 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:31.279524 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e56c7-b07d-4533-a1b1-9b395c95eac2 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:31.314948 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d145495-bc13-48be-8dd6-afe15b09071e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:31.315719 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d145495-bc13-48be-8dd6-afe15b09071e None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:31.315994 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d145495-bc13-48be-8dd6-afe15b09071e None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:31.316260 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d145495-bc13-48be-8dd6-afe15b09071e None admin] PATH_INFO: `/v3/projects/c842c78184a04a9ba9ec670ed7ad0e7a` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:31.317469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d145495-bc13-48be-8dd6-afe15b09071e None admin] RBAC: Authorizing `identity:get_project(project_id=c842c78184a04a9ba9ec670ed7ad0e7a)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:31.318932 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d145495-bc13-48be-8dd6-afe15b09071e None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:31.320643 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 584/1160] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:37:31 2022] GET /identity/v3/projects/c842c78184a04a9ba9ec670ed7ad0e7a => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:31.328174 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375bc68-631f-4d11-aade-46f9854b9214 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:31.452821 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375bc68-631f-4d11-aade-46f9854b9214 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:31.472534 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:31.491019 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712a92f-2de1-47dd-b3dc-3fc8a4cf1209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:31.491668 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712a92f-2de1-47dd-b3dc-3fc8a4cf1209 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:31.491949 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712a92f-2de1-47dd-b3dc-3fc8a4cf1209 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:31.492222 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712a92f-2de1-47dd-b3dc-3fc8a4cf1209 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:31.493080 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712a92f-2de1-47dd-b3dc-3fc8a4cf1209 None admin] RBAC: Adding query filter params (role.id=37ba4a62052348d4811b560c19a07e02, scope.project.id=c842c78184a04a9ba9ec670ed7ad0e7a, user.id=e588567040a948919b8fc52d23dd894b) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:37:31.493390 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712a92f-2de1-47dd-b3dc-3fc8a4cf1209 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:31.494856 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712a92f-2de1-47dd-b3dc-3fc8a4cf1209 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:31.500766 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 577/1161] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:37:31 2022] GET /identity/v3/role_assignments?user.id=e588567040a948919b8fc52d23dd894b&scope.project.id=c842c78184a04a9ba9ec670ed7ad0e7a&role.id=37ba4a62052348d4811b560c19a07e02 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:33.503591 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b7400-c4c3-413a-92a3-47b354fc8215 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:33.504112 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b7400-c4c3-413a-92a3-47b354fc8215 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:33.504112 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b7400-c4c3-413a-92a3-47b354fc8215 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:33.506202 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 585/1162] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:37:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:37:33.514034 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6fdfb-2a33-4f6c-bdd2-807a9c16bd4b None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:33.514469 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6fdfb-2a33-4f6c-bdd2-807a9c16bd4b None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:33.514579 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6fdfb-2a33-4f6c-bdd2-807a9c16bd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:33.540725 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-81f6fdfb-2a33-4f6c-bdd2-807a9c16bd4b None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:37:33.542692 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-81f6fdfb-2a33-4f6c-bdd2-807a9c16bd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:37:33.617975 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 578/1163] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:37:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 20:37:33.640358 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b7400-c4c3-413a-92a3-47b354fc8215 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:33.652907 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:33.762530 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b7400-c4c3-413a-92a3-47b354fc8215 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:33.805629 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f92e6-371f-42ed-919d-1e26ee013a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:33.806666 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f92e6-371f-42ed-919d-1e26ee013a98 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:33.807097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f92e6-371f-42ed-919d-1e26ee013a98 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:33.807550 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f92e6-371f-42ed-919d-1e26ee013a98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:33.891431 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f92e6-371f-42ed-919d-1e26ee013a98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:33.892896 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f92e6-371f-42ed-919d-1e26ee013a98 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:33.903783 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:33.996048 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 586/1164] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:37:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 20:37:34.002600 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6fdfb-2a33-4f6c-bdd2-807a9c16bd4b None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:34.108936 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6fdfb-2a33-4f6c-bdd2-807a9c16bd4b None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:34.123442 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:34.147121 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b796d76-c901-4398-b191-3c5ff52a42b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:34.147932 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b796d76-c901-4398-b191-3c5ff52a42b6 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:34.148214 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b796d76-c901-4398-b191-3c5ff52a42b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:34.148491 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b796d76-c901-4398-b191-3c5ff52a42b6 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:34.155766 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b796d76-c901-4398-b191-3c5ff52a42b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:34.157228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b796d76-c901-4398-b191-3c5ff52a42b6 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:34.171384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-2b796d76-c901-4398-b191-3c5ff52a42b6 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 05 20:37:34.171384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:37:34.171384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 05 20:37:34.171384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 05 20:37:34.171384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:37:34.171384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:37:34.171384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:37:34.171384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:37:34.171384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 05 20:37:34.171384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:37:34.171384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:37:34.171384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:37:34.171384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:37:34.171384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:37:34.171384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:37:34.171384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:37:34.171384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:37:34.172533 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:37:34.172533 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:37:34.172533 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:37:34.172533 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:37:34.172533 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:37:34.172533 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:37:34.172533 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:37:34.172533 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:37:34.172533 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:37:34.172533 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:37:34.172533 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:37:34.172533 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:37:34.172533 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:37:34.172533 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:37:34.172533 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:37:34.172533 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:37:34.173801 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:37:34.173801 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:37:34.173801 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:37:34.173801 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:37:34.173801 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:37:34.173801 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:37:34.173801 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:37:34.173801 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:37:34.173801 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:37:34.173801 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:37:34.173801 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 05 20:37:34.173801 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:37:34.173801 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 05 20:37:34.173801 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:37:34.173801 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 579/1165] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Jul 5 20:37:34 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:37:34.179102 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f92e6-371f-42ed-919d-1e26ee013a98 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:34.283393 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f92e6-371f-42ed-919d-1e26ee013a98 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:34.293308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:34.330954 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b2c14-2af3-474a-8f12-adcc1dfe2252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:34.331601 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b2c14-2af3-474a-8f12-adcc1dfe2252 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:34.331877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b2c14-2af3-474a-8f12-adcc1dfe2252 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:34.332146 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b2c14-2af3-474a-8f12-adcc1dfe2252 None admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:34.332856 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b2c14-2af3-474a-8f12-adcc1dfe2252 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:37:34.333150 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b2c14-2af3-474a-8f12-adcc1dfe2252 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:34.334549 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b2c14-2af3-474a-8f12-adcc1dfe2252 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:34.343671 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 587/1166] 10.222.0.27 () {56 vars in 1115 bytes} [Tue Jul 5 20:37:34 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:36.328755 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460ac24-59b7-46e8-93af-dee6d8de546a None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:36.329603 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460ac24-59b7-46e8-93af-dee6d8de546a None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:36.329714 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460ac24-59b7-46e8-93af-dee6d8de546a None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:36.331881 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 580/1167] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:37:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:37:36.337392 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0badbf-24d9-44f5-a368-a8d832adf78a None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:36.337861 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0badbf-24d9-44f5-a368-a8d832adf78a None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:36.337966 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0badbf-24d9-44f5-a368-a8d832adf78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:36.356473 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-9d0badbf-24d9-44f5-a368-a8d832adf78a None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:37:36.357654 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-9d0badbf-24d9-44f5-a368-a8d832adf78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:37:36.434452 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 588/1168] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:37:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:37:36.468891 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460ac24-59b7-46e8-93af-dee6d8de546a None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:36.580136 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460ac24-59b7-46e8-93af-dee6d8de546a None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:36.614173 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69ecea-94f6-4e32-82e9-e5f1a658fa14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:36.614805 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69ecea-94f6-4e32-82e9-e5f1a658fa14 None admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:36.615076 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69ecea-94f6-4e32-82e9-e5f1a658fa14 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:36.615342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69ecea-94f6-4e32-82e9-e5f1a658fa14 None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:36.616071 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c69ecea-94f6-4e32-82e9-e5f1a658fa14 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:36.617437 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c69ecea-94f6-4e32-82e9-e5f1a658fa14 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:36.635661 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 581/1169] 10.222.0.27 () {60 vars in 1138 bytes} [Tue Jul 5 20:37:36 2022] POST /identity/v3/domains => generated 267 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:37:38.657559 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ff9fb-4cc7-4fd8-b490-a4a550560967 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:38.658451 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ff9fb-4cc7-4fd8-b490-a4a550560967 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:38.658451 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ff9fb-4cc7-4fd8-b490-a4a550560967 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:38.660656 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 589/1170] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:37:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:37:38.667259 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5b730-5acf-45e7-a114-5eb484949b5d None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:38.667959 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5b730-5acf-45e7-a114-5eb484949b5d None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:38.668102 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5b730-5acf-45e7-a114-5eb484949b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:38.692571 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-0ca5b730-5acf-45e7-a114-5eb484949b5d None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:37:38.693761 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-0ca5b730-5acf-45e7-a114-5eb484949b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:37:38.721197 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:38.767104 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 582/1171] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:37:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:37:38.790694 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ff9fb-4cc7-4fd8-b490-a4a550560967 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:38.908898 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ff9fb-4cc7-4fd8-b490-a4a550560967 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:38.910558 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:38.944788 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183bf97-67fc-4c41-a1bc-6d95639d1094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:38.945640 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183bf97-67fc-4c41-a1bc-6d95639d1094 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:38.945941 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183bf97-67fc-4c41-a1bc-6d95639d1094 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:38.946209 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183bf97-67fc-4c41-a1bc-6d95639d1094 None admin] PATH_INFO: `/v3/domains/a8b90702847a4c99b89f4f9eb1376f64` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:38.958276 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183bf97-67fc-4c41-a1bc-6d95639d1094 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a8b90702847a4c99b89f4f9eb1376f64)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:38.959719 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183bf97-67fc-4c41-a1bc-6d95639d1094 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:38.961337 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 590/1172] 10.222.0.27 () {56 vars in 1183 bytes} [Tue Jul 5 20:37:38 2022] GET /identity/v3/domains/a8b90702847a4c99b89f4f9eb1376f64 => generated 267 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:38.970817 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5b730-5acf-45e7-a114-5eb484949b5d None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:39.076601 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5b730-5acf-45e7-a114-5eb484949b5d None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:39.111738 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2b102-29c6-461c-b366-240ef18423ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:39.112379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2b102-29c6-461c-b366-240ef18423ce None admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:39.112663 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2b102-29c6-461c-b366-240ef18423ce None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:39.112933 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2b102-29c6-461c-b366-240ef18423ce None admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:39.113634 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2b102-29c6-461c-b366-240ef18423ce None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:39.115121 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2b102-29c6-461c-b366-240ef18423ce None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:39.149361 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 583/1173] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Jul 5 20:37:38 2022] POST /identity/v3/projects => generated 361 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:37:41.196878 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6ea09-2550-489e-b0c1-51ec672887c3 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:41.197409 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6ea09-2550-489e-b0c1-51ec672887c3 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:41.197409 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6ea09-2550-489e-b0c1-51ec672887c3 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:41.198830 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 591/1174] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:37:41.207644 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944c8b7-8730-49bc-9590-461b8a2cf0b9 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:41.208338 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944c8b7-8730-49bc-9590-461b8a2cf0b9 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:41.208440 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944c8b7-8730-49bc-9590-461b8a2cf0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:41.234006 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-4944c8b7-8730-49bc-9590-461b8a2cf0b9 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:37:41.235198 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-4944c8b7-8730-49bc-9590-461b8a2cf0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:37:41.244917 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:41.309507 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 584/1175] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:37:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:37:41.334901 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6ea09-2550-489e-b0c1-51ec672887c3 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:41.447244 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6ea09-2550-489e-b0c1-51ec672887c3 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:41.491617 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02245fa3-5f6c-49d3-b065-1bb76836a3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:41.492481 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02245fa3-5f6c-49d3-b065-1bb76836a3c5 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:41.492763 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02245fa3-5f6c-49d3-b065-1bb76836a3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:41.493039 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02245fa3-5f6c-49d3-b065-1bb76836a3c5 None admin] PATH_INFO: `/v3/domains/a8b90702847a4c99b89f4f9eb1376f64` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:41.494380 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02245fa3-5f6c-49d3-b065-1bb76836a3c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a8b90702847a4c99b89f4f9eb1376f64)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:41.495839 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02245fa3-5f6c-49d3-b065-1bb76836a3c5 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:41.497575 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 592/1176] 10.222.0.27 () {56 vars in 1183 bytes} [Tue Jul 5 20:37:41 2022] GET /identity/v3/domains/a8b90702847a4c99b89f4f9eb1376f64 => generated 267 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:41.507254 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944c8b7-8730-49bc-9590-461b8a2cf0b9 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:41.628777 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944c8b7-8730-49bc-9590-461b8a2cf0b9 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:41.664816 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d45fa-5f60-44a3-8bd2-8029c1ac453f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:41.665539 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d45fa-5f60-44a3-8bd2-8029c1ac453f None admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:41.665824 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d45fa-5f60-44a3-8bd2-8029c1ac453f None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:41.666129 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d45fa-5f60-44a3-8bd2-8029c1ac453f None admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:41.666928 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d45fa-5f60-44a3-8bd2-8029c1ac453f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:41.668465 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d45fa-5f60-44a3-8bd2-8029c1ac453f None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:41.689312 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:41.694510 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 585/1177] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Jul 5 20:37:41 2022] POST /identity/v3/users => generated 311 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:37:43.709470 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0248b17-d98b-4fe0-9cc5-e17a1b385994 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:43.710038 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0248b17-d98b-4fe0-9cc5-e17a1b385994 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:43.710160 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0248b17-d98b-4fe0-9cc5-e17a1b385994 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:43.712197 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 593/1178] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:37:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:37:43.719671 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684761ea-9a7b-490b-9fc0-7976441d0568 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:43.720063 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684761ea-9a7b-490b-9fc0-7976441d0568 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:43.720265 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684761ea-9a7b-490b-9fc0-7976441d0568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:43.757298 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-684761ea-9a7b-490b-9fc0-7976441d0568 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:37:43.758530 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-684761ea-9a7b-490b-9fc0-7976441d0568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:37:43.828330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 586/1179] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:37:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:37:43.857019 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0248b17-d98b-4fe0-9cc5-e17a1b385994 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:43.895400 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:43.974294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0248b17-d98b-4fe0-9cc5-e17a1b385994 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:44.009343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51839d80-ab99-4ddd-ba9f-2f966efcc63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:44.010146 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51839d80-ab99-4ddd-ba9f-2f966efcc63c None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:44.010424 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51839d80-ab99-4ddd-ba9f-2f966efcc63c None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:44.010702 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51839d80-ab99-4ddd-ba9f-2f966efcc63c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:44.022228 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51839d80-ab99-4ddd-ba9f-2f966efcc63c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:37:44.029763 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-51839d80-ab99-4ddd-ba9f-2f966efcc63c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:37:44.029763 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:37:44.029763 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:37:44.029763 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:37:44.029763 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:37:44.029763 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:37:44.029763 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:37:44.029763 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:37:44.029763 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:37:44.029763 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:37:44.029763 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:37:44.029763 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:37:44.029763 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:37:44.029763 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:37:44.029763 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:37:44.029763 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:37:44.030920 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:37:44.030920 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:37:44.030920 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:37:44.030920 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:37:44.030920 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:37:44.030920 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:37:44.030920 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:37:44.030920 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:37:44.030920 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:37:44.030920 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:37:44.030920 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:37:44.030920 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:37:44.030920 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:37:44.030920 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:37:44.030920 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:37:44.030920 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:37:44.031888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:37:44.031888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:37:44.031888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:37:44.031888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:37:44.031888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:37:44.031888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:37:44.031888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:37:44.031888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:37:44.031888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:37:44.031888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:37:44.031888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:37:44.031888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:37:44.031888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 594/1180] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 5 20:37:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:37:44.039288 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684761ea-9a7b-490b-9fc0-7976441d0568 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:44.141273 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684761ea-9a7b-490b-9fc0-7976441d0568 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:44.172349 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:44.180429 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e9801-fc17-4d8c-a92c-bbe19ef720b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:44.181107 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e9801-fc17-4d8c-a92c-bbe19ef720b4 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:44.181389 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e9801-fc17-4d8c-a92c-bbe19ef720b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:44.181657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e9801-fc17-4d8c-a92c-bbe19ef720b4 None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:44.182444 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e9801-fc17-4d8c-a92c-bbe19ef720b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:37:44.182750 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e9801-fc17-4d8c-a92c-bbe19ef720b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:44.184153 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e9801-fc17-4d8c-a92c-bbe19ef720b4 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:44.192943 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 587/1181] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:37:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:44.199170 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51839d80-ab99-4ddd-ba9f-2f966efcc63c None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:44.295713 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:44.306959 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51839d80-ab99-4ddd-ba9f-2f966efcc63c None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:44.342314 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a841b-1216-4740-8629-7d1ebf04625d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:44.343178 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a841b-1216-4740-8629-7d1ebf04625d None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:44.343459 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a841b-1216-4740-8629-7d1ebf04625d None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:44.343732 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a841b-1216-4740-8629-7d1ebf04625d None admin] PATH_INFO: `/v3/users/f6faee953af74f9fa32df002182f69b0` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:44.357254 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a841b-1216-4740-8629-7d1ebf04625d None admin] RBAC: Authorizing `identity:get_user(user_id=f6faee953af74f9fa32df002182f69b0)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:44.358745 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a841b-1216-4740-8629-7d1ebf04625d None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:44.360398 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 595/1182] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:37:44 2022] GET /identity/v3/users/f6faee953af74f9fa32df002182f69b0 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:44.366453 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e9801-fc17-4d8c-a92c-bbe19ef720b4 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:44.474251 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e9801-fc17-4d8c-a92c-bbe19ef720b4 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:44.510323 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5b9a9-f358-47b7-80a1-817ce2b97b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:44.510971 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5b9a9-f358-47b7-80a1-817ce2b97b7a None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:44.511253 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5b9a9-f358-47b7-80a1-817ce2b97b7a None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:44.511662 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5b9a9-f358-47b7-80a1-817ce2b97b7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:44.572050 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:44.582198 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5b9a9-f358-47b7-80a1-817ce2b97b7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:44.583673 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5b9a9-f358-47b7-80a1-817ce2b97b7a None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:44.684001 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 588/1183] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:37:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 20:37:44.690733 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a841b-1216-4740-8629-7d1ebf04625d None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:44.809950 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a841b-1216-4740-8629-7d1ebf04625d None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:44.845647 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85807b-c546-4410-9732-f753331cf312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:44.846534 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85807b-c546-4410-9732-f753331cf312 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:44.846811 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85807b-c546-4410-9732-f753331cf312 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:44.847085 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85807b-c546-4410-9732-f753331cf312 None admin] PATH_INFO: `/v3/projects/edbfd9e530df4fa084d64737320e348c` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:44.848392 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da85807b-c546-4410-9732-f753331cf312 None admin] RBAC: Authorizing `identity:get_project(project_id=edbfd9e530df4fa084d64737320e348c)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:44.849897 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da85807b-c546-4410-9732-f753331cf312 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:44.851672 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 596/1184] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:37:44 2022] GET /identity/v3/projects/edbfd9e530df4fa084d64737320e348c => generated 361 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:44.857880 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5b9a9-f358-47b7-80a1-817ce2b97b7a None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:44.950638 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:44.961410 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5b9a9-f358-47b7-80a1-817ce2b97b7a None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:44.998942 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87f51a-83ba-4945-a428-4d267685b5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:44.999595 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87f51a-83ba-4945-a428-4d267685b5c3 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:44.999878 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87f51a-83ba-4945-a428-4d267685b5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:45.000155 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87f51a-83ba-4945-a428-4d267685b5c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:45.000998 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87f51a-83ba-4945-a428-4d267685b5c3 None admin] RBAC: Adding query filter params (role.id=37ba4a62052348d4811b560c19a07e02, scope.project.id=edbfd9e530df4fa084d64737320e348c, user.id=f6faee953af74f9fa32df002182f69b0) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:37:45.001357 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87f51a-83ba-4945-a428-4d267685b5c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:45.002843 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87f51a-83ba-4945-a428-4d267685b5c3 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:45.009078 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 589/1185] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:37:44 2022] GET /identity/v3/role_assignments?user.id=f6faee953af74f9fa32df002182f69b0&scope.project.id=edbfd9e530df4fa084d64737320e348c&role.id=37ba4a62052348d4811b560c19a07e02 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:47.014069 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdccdaa-847f-4bd2-a30e-21a79978f2b8 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:47.014957 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdccdaa-847f-4bd2-a30e-21a79978f2b8 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:47.014957 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdccdaa-847f-4bd2-a30e-21a79978f2b8 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:47.017144 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 597/1186] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:37:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:37:47.022628 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e095022-2fc6-4db7-9a13-c2af5237972d None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:47.023073 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e095022-2fc6-4db7-9a13-c2af5237972d None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:47.023177 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e095022-2fc6-4db7-9a13-c2af5237972d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:47.042265 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-3e095022-2fc6-4db7-9a13-c2af5237972d None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:37:47.043591 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-3e095022-2fc6-4db7-9a13-c2af5237972d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:37:47.126240 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 590/1187] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:37:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:37:47.152417 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdccdaa-847f-4bd2-a30e-21a79978f2b8 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:47.171907 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:47.261234 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdccdaa-847f-4bd2-a30e-21a79978f2b8 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:47.304142 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da74649-d2cf-4be0-a123-3da271b8c865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:47.304865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da74649-d2cf-4be0-a123-3da271b8c865 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:47.305136 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da74649-d2cf-4be0-a123-3da271b8c865 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:47.305401 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da74649-d2cf-4be0-a123-3da271b8c865 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:47.316116 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da74649-d2cf-4be0-a123-3da271b8c865 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:37:47.323568 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-0da74649-d2cf-4be0-a123-3da271b8c865 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:37:47.323568 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:37:47.323568 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:37:47.323568 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:37:47.323568 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:37:47.323568 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:37:47.323568 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:37:47.323568 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:37:47.323568 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:37:47.323568 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:37:47.323568 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:37:47.323568 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:37:47.323568 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:37:47.323568 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:37:47.323568 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:37:47.323568 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:37:47.324665 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:37:47.324665 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:37:47.324665 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:37:47.324665 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:37:47.324665 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:37:47.324665 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:37:47.324665 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:37:47.324665 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:37:47.324665 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:37:47.324665 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:37:47.324665 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:37:47.324665 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:37:47.324665 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:37:47.324665 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:37:47.324665 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:37:47.324665 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:37:47.325754 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:37:47.325754 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:37:47.325754 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:37:47.325754 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:37:47.325754 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:37:47.325754 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:37:47.325754 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:37:47.325754 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:37:47.325754 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:37:47.325754 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:37:47.325754 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:37:47.325754 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:37:47.325754 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 598/1188] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 5 20:37:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:37:47.332979 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e095022-2fc6-4db7-9a13-c2af5237972d None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:47.418470 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:47.435273 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e095022-2fc6-4db7-9a13-c2af5237972d None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:47.470037 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543b7ef-99f9-4579-9214-11b873117547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:47.470691 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543b7ef-99f9-4579-9214-11b873117547 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:47.470967 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543b7ef-99f9-4579-9214-11b873117547 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:47.471232 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543b7ef-99f9-4579-9214-11b873117547 None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:47.471972 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8543b7ef-99f9-4579-9214-11b873117547 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:37:47.472277 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8543b7ef-99f9-4579-9214-11b873117547 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:47.473637 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8543b7ef-99f9-4579-9214-11b873117547 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:47.481818 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 591/1189] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:37:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:37:47.487883 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da74649-d2cf-4be0-a123-3da271b8c865 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:47.572037 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:47.599009 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da74649-d2cf-4be0-a123-3da271b8c865 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:47.633325 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e74a9-b4cb-45ad-9600-87dd21eba79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:47.634218 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e74a9-b4cb-45ad-9600-87dd21eba79e None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:47.634491 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e74a9-b4cb-45ad-9600-87dd21eba79e None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:47.634741 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e74a9-b4cb-45ad-9600-87dd21eba79e None admin] PATH_INFO: `/v3/users/f6faee953af74f9fa32df002182f69b0` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:47.635933 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30e74a9-b4cb-45ad-9600-87dd21eba79e None admin] RBAC: Authorizing `identity:get_user(user_id=f6faee953af74f9fa32df002182f69b0)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:47.637362 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30e74a9-b4cb-45ad-9600-87dd21eba79e None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:47.639032 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 599/1190] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:37:47 2022] GET /identity/v3/users/f6faee953af74f9fa32df002182f69b0 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:47.648213 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543b7ef-99f9-4579-9214-11b873117547 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:47.754510 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543b7ef-99f9-4579-9214-11b873117547 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:47.791903 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4913de-1b58-4f34-ac77-cdc5039ea25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:47.793220 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4913de-1b58-4f34-ac77-cdc5039ea25c None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:47.793626 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4913de-1b58-4f34-ac77-cdc5039ea25c None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:47.793941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4913de-1b58-4f34-ac77-cdc5039ea25c None admin] PATH_INFO: `/v3/projects/edbfd9e530df4fa084d64737320e348c` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:47.795152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4913de-1b58-4f34-ac77-cdc5039ea25c None admin] RBAC: Authorizing `identity:get_project(project_id=edbfd9e530df4fa084d64737320e348c)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:47.796599 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4913de-1b58-4f34-ac77-cdc5039ea25c None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:47.798645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 592/1191] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:37:47 2022] GET /identity/v3/projects/edbfd9e530df4fa084d64737320e348c => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:47.805459 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e74a9-b4cb-45ad-9600-87dd21eba79e None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:47.929230 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e74a9-b4cb-45ad-9600-87dd21eba79e None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:47.966303 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00849feb-1e40-4a7d-a80d-6a1f442a0054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:47.967191 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00849feb-1e40-4a7d-a80d-6a1f442a0054 None admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:47.967468 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00849feb-1e40-4a7d-a80d-6a1f442a0054 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:47.967746 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00849feb-1e40-4a7d-a80d-6a1f442a0054 None admin] PATH_INFO: `/v3/projects/edbfd9e530df4fa084d64737320e348c/users/f6faee953af74f9fa32df002182f69b0/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:47.969810 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00849feb-1e40-4a7d-a80d-6a1f442a0054 None admin] RBAC: Authorizing `identity:create_grant(project_id=edbfd9e530df4fa084d64737320e348c, user_id=f6faee953af74f9fa32df002182f69b0, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:47.971301 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00849feb-1e40-4a7d-a80d-6a1f442a0054 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:47.986735 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 600/1192] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 5 20:37:47 2022] PUT /identity/v3/projects/edbfd9e530df4fa084d64737320e348c/users/f6faee953af74f9fa32df002182f69b0/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:37:49.944315 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea4629-b91b-4bd6-a3d9-b8aafca4802c None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:49.945183 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea4629-b91b-4bd6-a3d9-b8aafca4802c None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:49.945183 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea4629-b91b-4bd6-a3d9-b8aafca4802c None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:49.947475 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 593/1193] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:37:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:37:49.953074 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88958890-f4a2-45a7-a6a5-a8b521257c94 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:49.953520 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88958890-f4a2-45a7-a6a5-a8b521257c94 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:49.953611 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88958890-f4a2-45a7-a6a5-a8b521257c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:49.960340 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:49.972344 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-88958890-f4a2-45a7-a6a5-a8b521257c94 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:37:49.973744 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-88958890-f4a2-45a7-a6a5-a8b521257c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:37:50.046205 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 601/1194] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:37:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:37:50.081187 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea4629-b91b-4bd6-a3d9-b8aafca4802c None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:50.101864 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:50.189528 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea4629-b91b-4bd6-a3d9-b8aafca4802c None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:50.235011 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03af1a-4828-4d65-bf30-a28d8d7cfa26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:50.235743 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03af1a-4828-4d65-bf30-a28d8d7cfa26 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:50.236017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03af1a-4828-4d65-bf30-a28d8d7cfa26 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:50.236290 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c03af1a-4828-4d65-bf30-a28d8d7cfa26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:50.246461 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c03af1a-4828-4d65-bf30-a28d8d7cfa26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:37:50.254140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-6c03af1a-4828-4d65-bf30-a28d8d7cfa26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:37:50.254140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:37:50.254140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:37:50.254140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:37:50.254140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:37:50.254140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:37:50.254140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:37:50.254140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:37:50.254140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:37:50.254140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:37:50.254140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:37:50.254140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:37:50.254140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:37:50.254140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:37:50.254140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:37:50.254140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:37:50.255254 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:37:50.255254 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:37:50.255254 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:37:50.255254 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:37:50.255254 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:37:50.255254 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:37:50.255254 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:37:50.255254 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:37:50.255254 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:37:50.255254 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:37:50.255254 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:37:50.255254 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:37:50.255254 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:37:50.255254 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:37:50.255254 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:37:50.255254 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:37:50.256419 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:37:50.256419 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:37:50.256419 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:37:50.256419 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:37:50.256419 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:37:50.256419 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:37:50.256419 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:37:50.256419 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:37:50.256419 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:37:50.256419 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:37:50.256419 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:37:50.256419 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:37:50.256419 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 594/1195] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 5 20:37:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:37:50.261538 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88958890-f4a2-45a7-a6a5-a8b521257c94 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:50.367321 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88958890-f4a2-45a7-a6a5-a8b521257c94 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:50.402833 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1760c-90d5-4ce1-86f2-385cf99d2809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:50.403538 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1760c-90d5-4ce1-86f2-385cf99d2809 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:50.403814 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1760c-90d5-4ce1-86f2-385cf99d2809 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:50.404088 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1760c-90d5-4ce1-86f2-385cf99d2809 None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:50.404838 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1760c-90d5-4ce1-86f2-385cf99d2809 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:37:50.405142 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1760c-90d5-4ce1-86f2-385cf99d2809 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:50.406550 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1760c-90d5-4ce1-86f2-385cf99d2809 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:50.407932 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:50.415730 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 602/1196] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:37:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:37:50.421574 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03af1a-4828-4d65-bf30-a28d8d7cfa26 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:50.509190 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:50.544185 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c03af1a-4828-4d65-bf30-a28d8d7cfa26 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:50.580946 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d2c79-1a6a-4a6c-b1fd-2d0f4a3e00f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:50.581870 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d2c79-1a6a-4a6c-b1fd-2d0f4a3e00f5 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:50.582147 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d2c79-1a6a-4a6c-b1fd-2d0f4a3e00f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:50.582421 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d2c79-1a6a-4a6c-b1fd-2d0f4a3e00f5 None admin] PATH_INFO: `/v3/users/f6faee953af74f9fa32df002182f69b0` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:50.583643 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d2c79-1a6a-4a6c-b1fd-2d0f4a3e00f5 None admin] RBAC: Authorizing `identity:get_user(user_id=f6faee953af74f9fa32df002182f69b0)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:50.585084 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d2c79-1a6a-4a6c-b1fd-2d0f4a3e00f5 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:50.586737 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 595/1197] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 5 20:37:50 2022] GET /identity/v3/users/f6faee953af74f9fa32df002182f69b0 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:50.595421 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1760c-90d5-4ce1-86f2-385cf99d2809 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:50.728059 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1760c-90d5-4ce1-86f2-385cf99d2809 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:50.763149 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d8edb-4a12-4b7c-a0c7-d97b1bee28d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:50.763718 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d8edb-4a12-4b7c-a0c7-d97b1bee28d0 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:50.763995 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d8edb-4a12-4b7c-a0c7-d97b1bee28d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:50.764270 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d8edb-4a12-4b7c-a0c7-d97b1bee28d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:50.828705 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:50.836582 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d8edb-4a12-4b7c-a0c7-d97b1bee28d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:50.838077 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d8edb-4a12-4b7c-a0c7-d97b1bee28d0 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:50.940413 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 603/1198] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:37:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 20:37:50.950075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d2c79-1a6a-4a6c-b1fd-2d0f4a3e00f5 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:51.057027 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d2c79-1a6a-4a6c-b1fd-2d0f4a3e00f5 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:51.091720 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8949954-2664-4a98-874b-a06a1c74bdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:51.092576 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8949954-2664-4a98-874b-a06a1c74bdd5 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:51.092854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8949954-2664-4a98-874b-a06a1c74bdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:51.093123 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8949954-2664-4a98-874b-a06a1c74bdd5 None admin] PATH_INFO: `/v3/projects/edbfd9e530df4fa084d64737320e348c` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:51.094371 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8949954-2664-4a98-874b-a06a1c74bdd5 None admin] RBAC: Authorizing `identity:get_project(project_id=edbfd9e530df4fa084d64737320e348c)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:51.095816 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8949954-2664-4a98-874b-a06a1c74bdd5 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:51.097496 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 596/1199] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 5 20:37:50 2022] GET /identity/v3/projects/edbfd9e530df4fa084d64737320e348c => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:37:51.104318 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d8edb-4a12-4b7c-a0c7-d97b1bee28d0 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:37:51.206856 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:37:51.213872 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d8edb-4a12-4b7c-a0c7-d97b1bee28d0 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:37:51.248906 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c86b2-12c5-4064-b1ba-30ed13817a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:37:51.249545 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c86b2-12c5-4064-b1ba-30ed13817a26 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:37:51.249817 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c86b2-12c5-4064-b1ba-30ed13817a26 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:37:51.250118 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c86b2-12c5-4064-b1ba-30ed13817a26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:37:51.250951 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c86b2-12c5-4064-b1ba-30ed13817a26 None admin] RBAC: Adding query filter params (role.id=37ba4a62052348d4811b560c19a07e02, scope.project.id=edbfd9e530df4fa084d64737320e348c, user.id=f6faee953af74f9fa32df002182f69b0) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:37:51.251254 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c86b2-12c5-4064-b1ba-30ed13817a26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:37:51.252687 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c86b2-12c5-4064-b1ba-30ed13817a26 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:37:51.258720 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 604/1200] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:37:51 2022] GET /identity/v3/role_assignments?user.id=f6faee953af74f9fa32df002182f69b0&scope.project.id=edbfd9e530df4fa084d64737320e348c&role.id=37ba4a62052348d4811b560c19a07e02 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:38:01.086791 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=94 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:38:01.255943 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=20 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:38:46.341907 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80178b59-800c-4d99-b967-be72ac6b45f7 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:46.342515 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80178b59-800c-4d99-b967-be72ac6b45f7 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:46.342813 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80178b59-800c-4d99-b967-be72ac6b45f7 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:46.344905 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 597/1201] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:38:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:38:46.352426 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801edb09-e69c-406c-8bc2-cf9efcdcd0ad None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:46.352426 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801edb09-e69c-406c-8bc2-cf9efcdcd0ad None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:46.352426 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801edb09-e69c-406c-8bc2-cf9efcdcd0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:46.368977 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-801edb09-e69c-406c-8bc2-cf9efcdcd0ad None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:38:46.370343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-801edb09-e69c-406c-8bc2-cf9efcdcd0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:38:46.460464 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 605/1202] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:38:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:38:46.484939 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80178b59-800c-4d99-b967-be72ac6b45f7 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:38:46.593039 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80178b59-800c-4d99-b967-be72ac6b45f7 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:38:46.635423 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6fb3bc-bf0f-4137-bf68-1eeae4a8d1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:38:46.636232 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fb3bc-bf0f-4137-bf68-1eeae4a8d1e4 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:46.636546 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fb3bc-bf0f-4137-bf68-1eeae4a8d1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:46.636793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fb3bc-bf0f-4137-bf68-1eeae4a8d1e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:46.652799 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6fb3bc-bf0f-4137-bf68-1eeae4a8d1e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:38:46.652799 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6fb3bc-bf0f-4137-bf68-1eeae4a8d1e4 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:38:46.673717 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-da6fb3bc-bf0f-4137-bf68-1eeae4a8d1e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:38:46.673717 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:38:46.673717 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:38:46.673717 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:38:46.673717 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:38:46.673717 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:38:46.673717 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:38:46.673717 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:38:46.673717 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:38:46.673717 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:38:46.673717 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:38:46.673717 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:38:46.673717 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:38:46.673717 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:38:46.673717 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:38:46.674982 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:38:46.674982 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:38:46.674982 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:38:46.674982 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:38:46.674982 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:38:46.674982 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:38:46.674982 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:38:46.674982 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:38:46.674982 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:38:46.674982 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:38:46.674982 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:38:46.674982 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:38:46.674982 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:38:46.674982 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:38:46.674982 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:38:46.674982 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:38:46.674982 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:38:46.676029 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:38:46.676029 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:38:46.676029 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:38:46.676029 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:38:46.676029 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 598/1203] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:38:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:38:46.681177 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801edb09-e69c-406c-8bc2-cf9efcdcd0ad None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:38:46.810314 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801edb09-e69c-406c-8bc2-cf9efcdcd0ad None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:38:46.847965 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:38:46.855261 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e04a7f-ba81-4ace-98d0-00af6cd18146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:38:46.855965 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e04a7f-ba81-4ace-98d0-00af6cd18146 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:46.856240 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e04a7f-ba81-4ace-98d0-00af6cd18146 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:46.856808 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e04a7f-ba81-4ace-98d0-00af6cd18146 None admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:46.857920 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e04a7f-ba81-4ace-98d0-00af6cd18146 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:38:46.858232 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e04a7f-ba81-4ace-98d0-00af6cd18146 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:38:46.859811 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e04a7f-ba81-4ace-98d0-00af6cd18146 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:38:46.874511 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 606/1204] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:38:46.880302 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6fb3bc-bf0f-4137-bf68-1eeae4a8d1e4 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:38:46.952260 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:38:47.011346 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6fb3bc-bf0f-4137-bf68-1eeae4a8d1e4 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:38:47.056260 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8d80b-427b-484d-b7fd-c1c71a89809b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:38:47.056943 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8d80b-427b-484d-b7fd-c1c71a89809b None admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:47.057230 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8d80b-427b-484d-b7fd-c1c71a89809b None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:47.057502 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8d80b-427b-484d-b7fd-c1c71a89809b None admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:47.058242 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8d80b-427b-484d-b7fd-c1c71a89809b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:38:47.059759 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8d80b-427b-484d-b7fd-c1c71a89809b None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:38:47.083808 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 599/1205] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Jul 5 20:38:46 2022] POST /identity/v3/users => generated 251 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:38:49.334075 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4801efd-35b2-446f-bae3-fb7c513dfce9 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:49.334075 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4801efd-35b2-446f-bae3-fb7c513dfce9 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:49.334075 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4801efd-35b2-446f-bae3-fb7c513dfce9 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:49.334075 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 607/1206] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:38:49.340093 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37360c6d-0531-47a7-8cf6-501aea28566a None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:49.340557 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37360c6d-0531-47a7-8cf6-501aea28566a None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:49.340829 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37360c6d-0531-47a7-8cf6-501aea28566a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:49.358804 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-37360c6d-0531-47a7-8cf6-501aea28566a None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:38:49.359998 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-37360c6d-0531-47a7-8cf6-501aea28566a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:38:49.435630 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 600/1207] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:38:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:38:49.459450 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4801efd-35b2-446f-bae3-fb7c513dfce9 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:38:49.573160 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4801efd-35b2-446f-bae3-fb7c513dfce9 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:38:49.610908 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a9e9a-4bee-4df9-b1af-b433d1ae0664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:38:49.611806 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a9e9a-4bee-4df9-b1af-b433d1ae0664 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:49.612086 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a9e9a-4bee-4df9-b1af-b433d1ae0664 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:49.612346 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a9e9a-4bee-4df9-b1af-b433d1ae0664 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:49.624977 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a9e9a-4bee-4df9-b1af-b433d1ae0664 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:38:49.632765 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-3f8a9e9a-4bee-4df9-b1af-b433d1ae0664 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:38:49.632765 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:38:49.632765 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:38:49.632765 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:38:49.632765 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:38:49.632765 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:38:49.632765 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:38:49.632765 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:38:49.632765 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:38:49.632765 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:38:49.632765 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:38:49.632765 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:38:49.632765 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:38:49.632765 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:38:49.632765 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:38:49.632765 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:38:49.634077 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:38:49.634077 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:38:49.634077 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:38:49.634077 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:38:49.634077 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:38:49.634077 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:38:49.634077 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:38:49.634077 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:38:49.634077 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:38:49.634077 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:38:49.634077 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:38:49.634077 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:38:49.634077 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:38:49.634077 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:38:49.634077 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:38:49.634077 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:38:49.635294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:38:49.635294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:38:49.635294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:38:49.635294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:38:49.635294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:38:49.635294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:38:49.635294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:38:49.635294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:38:49.635294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:38:49.635294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:38:49.635294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:38:49.635294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:38:49.638000 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 608/1208] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 5 20:38:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:38:49.641260 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37360c6d-0531-47a7-8cf6-501aea28566a None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:38:49.686269 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:38:49.755365 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37360c6d-0531-47a7-8cf6-501aea28566a None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:38:49.793982 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f1f81-4dfc-452f-90da-daf20c3281e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:38:49.794659 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f1f81-4dfc-452f-90da-daf20c3281e4 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:49.794940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f1f81-4dfc-452f-90da-daf20c3281e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:49.795561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f1f81-4dfc-452f-90da-daf20c3281e4 None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:49.796275 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f1f81-4dfc-452f-90da-daf20c3281e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:38:49.796581 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f1f81-4dfc-452f-90da-daf20c3281e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:38:49.797986 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f1f81-4dfc-452f-90da-daf20c3281e4 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:38:49.807926 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 601/1209] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 5 20:38:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:38:49.813623 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a9e9a-4bee-4df9-b1af-b433d1ae0664 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:38:49.870090 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:38:49.927366 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a9e9a-4bee-4df9-b1af-b433d1ae0664 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:38:49.969497 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef98f0-b0b2-4c43-9c18-daa0f7705159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:38:49.970246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef98f0-b0b2-4c43-9c18-daa0f7705159 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:49.970512 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef98f0-b0b2-4c43-9c18-daa0f7705159 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:49.970784 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef98f0-b0b2-4c43-9c18-daa0f7705159 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:49.981459 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef98f0-b0b2-4c43-9c18-daa0f7705159 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:38:49.982990 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef98f0-b0b2-4c43-9c18-daa0f7705159 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:38:50.003284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-06ef98f0-b0b2-4c43-9c18-daa0f7705159 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:38:50.003284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:38:50.003284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:38:50.003284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:38:50.003284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:38:50.003284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:38:50.003284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:38:50.003284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:38:50.003284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:38:50.003284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:38:50.003284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:38:50.003284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:38:50.003284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:38:50.003284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:38:50.003284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:38:50.004335 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:38:50.004335 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:38:50.004335 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:38:50.004335 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:38:50.004335 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:38:50.004335 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:38:50.004335 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:38:50.004335 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:38:50.004335 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:38:50.004335 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:38:50.004335 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:38:50.004335 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:38:50.004335 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:38:50.004335 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:38:50.004335 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:38:50.004335 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:38:50.004335 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:38:50.005551 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:38:50.005551 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:38:50.005551 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:38:50.005551 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:38:50.005551 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 609/1210] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:38:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:38:50.011689 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f1f81-4dfc-452f-90da-daf20c3281e4 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:38:50.132477 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:38:50.135646 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f1f81-4dfc-452f-90da-daf20c3281e4 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:38:50.183247 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3b393-28ce-4bda-87c0-5a38593740a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:38:50.184003 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3b393-28ce-4bda-87c0-5a38593740a0 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:50.184305 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3b393-28ce-4bda-87c0-5a38593740a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:50.184652 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3b393-28ce-4bda-87c0-5a38593740a0 None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:50.185439 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3b393-28ce-4bda-87c0-5a38593740a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:38:50.185744 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3b393-28ce-4bda-87c0-5a38593740a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:38:50.187271 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3b393-28ce-4bda-87c0-5a38593740a0 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:38:50.201024 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 602/1211] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:38:50.206956 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef98f0-b0b2-4c43-9c18-daa0f7705159 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:38:50.341240 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef98f0-b0b2-4c43-9c18-daa0f7705159 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:38:50.343129 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:38:50.388562 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b74c1-a271-41f5-941d-58efa52a91e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:38:50.389431 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b74c1-a271-41f5-941d-58efa52a91e5 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:50.389709 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b74c1-a271-41f5-941d-58efa52a91e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:50.390019 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b74c1-a271-41f5-941d-58efa52a91e5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:50.398493 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b74c1-a271-41f5-941d-58efa52a91e5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:38:50.400045 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b74c1-a271-41f5-941d-58efa52a91e5 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:38:50.416132 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-c80b74c1-a271-41f5-941d-58efa52a91e5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 20:38:50.416132 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:38:50.416132 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:38:50.416132 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:38:50.416132 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:38:50.416132 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:38:50.416132 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:38:50.416132 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:38:50.416132 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:38:50.416132 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:38:50.416132 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:38:50.416132 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:38:50.416132 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:38:50.416132 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:38:50.416132 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:38:50.416132 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:38:50.417445 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:38:50.417445 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:38:50.417445 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:38:50.417445 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:38:50.417445 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:38:50.417445 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:38:50.417445 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:38:50.417445 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:38:50.417445 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:38:50.417445 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:38:50.417445 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:38:50.417445 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:38:50.417445 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:38:50.417445 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:38:50.417445 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:38:50.417445 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:38:50.417445 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:38:50.417445 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:38:50.418632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:38:50.418632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:38:50.418632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:38:50.418632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:38:50.418632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:38:50.418632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:38:50.418632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:38:50.418632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:38:50.418632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 20:38:50.418632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:38:50.418632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 610/1212] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:38:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:38:50.423808 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3b393-28ce-4bda-87c0-5a38593740a0 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:38:50.541312 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3b393-28ce-4bda-87c0-5a38593740a0 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:38:50.580785 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a690f19-1d2a-427f-a413-b4e5fa87aaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:38:50.581472 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a690f19-1d2a-427f-a413-b4e5fa87aaf1 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:50.582737 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a690f19-1d2a-427f-a413-b4e5fa87aaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:50.582737 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a690f19-1d2a-427f-a413-b4e5fa87aaf1 None admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:50.582917 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a690f19-1d2a-427f-a413-b4e5fa87aaf1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:38:50.583180 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a690f19-1d2a-427f-a413-b4e5fa87aaf1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:38:50.584656 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a690f19-1d2a-427f-a413-b4e5fa87aaf1 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:38:50.605583 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 603/1213] 10.222.0.27 () {56 vars in 1143 bytes} [Tue Jul 5 20:38:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:38:50.611135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b74c1-a271-41f5-941d-58efa52a91e5 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:38:50.730973 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b74c1-a271-41f5-941d-58efa52a91e5 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:38:50.776192 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a363d2-ebf5-455c-9924-062207fe3de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:38:50.776843 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a363d2-ebf5-455c-9924-062207fe3de5 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:50.777141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a363d2-ebf5-455c-9924-062207fe3de5 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:50.777469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a363d2-ebf5-455c-9924-062207fe3de5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:50.811017 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:38:50.856060 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a363d2-ebf5-455c-9924-062207fe3de5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:38:50.856060 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a363d2-ebf5-455c-9924-062207fe3de5 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:38:50.968327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 611/1214] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:38:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 20:38:50.969652 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a690f19-1d2a-427f-a413-b4e5fa87aaf1 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:38:50.990665 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:38:51.084234 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a690f19-1d2a-427f-a413-b4e5fa87aaf1 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:38:51.121978 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a147d97-edda-49dd-982c-27bd0f867997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:38:51.122655 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a147d97-edda-49dd-982c-27bd0f867997 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:51.122938 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a147d97-edda-49dd-982c-27bd0f867997 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:51.123205 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a147d97-edda-49dd-982c-27bd0f867997 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:51.134149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a147d97-edda-49dd-982c-27bd0f867997 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:38:51.135624 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a147d97-edda-49dd-982c-27bd0f867997 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:38:51.157922 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-1a147d97-edda-49dd-982c-27bd0f867997 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:38:51.157922 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:38:51.157922 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:38:51.157922 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:38:51.157922 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:38:51.157922 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:38:51.157922 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:38:51.157922 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:38:51.157922 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:38:51.157922 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:38:51.157922 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:38:51.157922 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:38:51.157922 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:38:51.157922 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:38:51.157922 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:38:51.158920 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:38:51.158920 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:38:51.158920 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:38:51.158920 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:38:51.158920 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:38:51.158920 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:38:51.158920 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:38:51.158920 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:38:51.158920 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:38:51.158920 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:38:51.158920 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:38:51.158920 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:38:51.158920 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:38:51.158920 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:38:51.158920 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:38:51.158920 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:38:51.158920 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:38:51.159838 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:38:51.159838 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:38:51.159838 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:38:51.159838 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:38:51.159838 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 604/1215] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:38:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:38:51.165264 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a363d2-ebf5-455c-9924-062207fe3de5 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:38:51.231312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:38:51.277475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a363d2-ebf5-455c-9924-062207fe3de5 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:38:51.320183 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036d7b4-72c5-44e0-91bc-fc3d85a289a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:38:51.320954 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036d7b4-72c5-44e0-91bc-fc3d85a289a3 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:51.321236 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036d7b4-72c5-44e0-91bc-fc3d85a289a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:51.321508 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036d7b4-72c5-44e0-91bc-fc3d85a289a3 None admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:51.322338 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8036d7b4-72c5-44e0-91bc-fc3d85a289a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:38:51.322641 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8036d7b4-72c5-44e0-91bc-fc3d85a289a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:38:51.324327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8036d7b4-72c5-44e0-91bc-fc3d85a289a3 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:38:51.341292 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 612/1216] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:38:51.348438 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a147d97-edda-49dd-982c-27bd0f867997 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:38:51.424745 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:38:51.459372 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a147d97-edda-49dd-982c-27bd0f867997 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:38:51.498465 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36951f24-b892-434f-b7c5-a108fd8cda0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:38:51.499275 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36951f24-b892-434f-b7c5-a108fd8cda0c None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:51.499557 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36951f24-b892-434f-b7c5-a108fd8cda0c None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:51.499836 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36951f24-b892-434f-b7c5-a108fd8cda0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:51.507346 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36951f24-b892-434f-b7c5-a108fd8cda0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:38:51.508864 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36951f24-b892-434f-b7c5-a108fd8cda0c None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:38:51.525401 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-36951f24-b892-434f-b7c5-a108fd8cda0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:38:51.525401 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:38:51.525401 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:38:51.525401 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:38:51.525401 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:38:51.525401 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:38:51.525401 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:38:51.525401 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:38:51.525401 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:38:51.525401 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:38:51.525401 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:38:51.525401 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:38:51.525401 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:38:51.525401 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:38:51.525401 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:38:51.526645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:38:51.526645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:38:51.526645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:38:51.526645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:38:51.526645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:38:51.526645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:38:51.526645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:38:51.526645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:38:51.526645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:38:51.526645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:38:51.526645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:38:51.526645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:38:51.526645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:38:51.526645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:38:51.526645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:38:51.526645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:38:51.526645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:38:51.531087 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:38:51.531087 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:38:51.531087 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:38:51.531087 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:38:51.531087 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:38:51.531087 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:38:51.531087 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:38:51.531087 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:38:51.531087 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 605/1217] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:38:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:38:51.534778 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036d7b4-72c5-44e0-91bc-fc3d85a289a3 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:38:51.647709 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036d7b4-72c5-44e0-91bc-fc3d85a289a3 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:38:51.679168 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:38:51.692928 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbc6ac-e93d-4bce-af8e-8e398837e22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:38:51.693586 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbc6ac-e93d-4bce-af8e-8e398837e22b None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:51.693856 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbc6ac-e93d-4bce-af8e-8e398837e22b None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:51.694168 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbc6ac-e93d-4bce-af8e-8e398837e22b None admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:51.694956 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dbc6ac-e93d-4bce-af8e-8e398837e22b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:38:51.695264 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dbc6ac-e93d-4bce-af8e-8e398837e22b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:38:51.696702 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dbc6ac-e93d-4bce-af8e-8e398837e22b None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:38:51.714773 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 613/1218] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 5 20:38:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:38:51.716290 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36951f24-b892-434f-b7c5-a108fd8cda0c None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:38:51.833471 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36951f24-b892-434f-b7c5-a108fd8cda0c None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:38:51.870853 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:38:51.879172 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839be049-b857-4879-90c8-99549f20023e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:38:51.880106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839be049-b857-4879-90c8-99549f20023e None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:51.880616 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839be049-b857-4879-90c8-99549f20023e None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:51.881177 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839be049-b857-4879-90c8-99549f20023e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:51.882083 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839be049-b857-4879-90c8-99549f20023e None admin] RBAC: Adding query filter params (role.id=4f5057900b094e6fb792884693177cd3, scope.project.id=b321588ec1f14bcb94a184310cf72856, user.id=16662dd5e2e74163b6aa2e1e7ef07524) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:38:51.882449 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839be049-b857-4879-90c8-99549f20023e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:38:51.884043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839be049-b857-4879-90c8-99549f20023e None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:38:51.898099 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 606/1219] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:38:51 2022] GET /identity/v3/role_assignments?user.id=16662dd5e2e74163b6aa2e1e7ef07524&scope.project.id=b321588ec1f14bcb94a184310cf72856&role.id=4f5057900b094e6fb792884693177cd3 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:38:53.991216 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f96288-b4a3-420f-ab82-fece4e387d26 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:53.991775 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f96288-b4a3-420f-ab82-fece4e387d26 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:53.991775 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f96288-b4a3-420f-ab82-fece4e387d26 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:53.993150 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 614/1220] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:38:53.998952 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68822f3f-a10f-4d14-b1da-5ede6129db4d None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:53.999446 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68822f3f-a10f-4d14-b1da-5ede6129db4d None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:53.999556 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68822f3f-a10f-4d14-b1da-5ede6129db4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:54.019697 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-68822f3f-a10f-4d14-b1da-5ede6129db4d None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:38:54.021020 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-68822f3f-a10f-4d14-b1da-5ede6129db4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:38:54.096429 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 607/1221] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:38:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:38:54.119108 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f96288-b4a3-420f-ab82-fece4e387d26 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:38:54.229868 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f96288-b4a3-420f-ab82-fece4e387d26 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:38:54.266325 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22350af4-578e-48a2-bcc9-9d1ddee9f11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:38:54.267130 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22350af4-578e-48a2-bcc9-9d1ddee9f11b None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:54.267398 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22350af4-578e-48a2-bcc9-9d1ddee9f11b None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:54.267688 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22350af4-578e-48a2-bcc9-9d1ddee9f11b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:54.279376 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22350af4-578e-48a2-bcc9-9d1ddee9f11b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:38:54.287021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-22350af4-578e-48a2-bcc9-9d1ddee9f11b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:38:54.287021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:38:54.287021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:38:54.287021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:38:54.287021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:38:54.287021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:38:54.287021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:38:54.287021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:38:54.287021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:38:54.287021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:38:54.287021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:38:54.287021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:38:54.287021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:38:54.287021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:38:54.287021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:38:54.287021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:38:54.288163 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:38:54.288163 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:38:54.288163 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:38:54.288163 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:38:54.288163 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:38:54.288163 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:38:54.288163 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:38:54.288163 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:38:54.288163 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:38:54.288163 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:38:54.288163 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:38:54.288163 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:38:54.288163 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:38:54.288163 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:38:54.288163 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:38:54.288163 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:38:54.289226 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:38:54.289226 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:38:54.289226 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:38:54.289226 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:38:54.289226 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:38:54.289226 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:38:54.289226 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:38:54.289226 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:38:54.289226 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:38:54.289226 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:38:54.289226 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:38:54.289226 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:38:54.291257 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 615/1222] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 5 20:38:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:38:54.297988 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68822f3f-a10f-4d14-b1da-5ede6129db4d None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:38:54.408085 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68822f3f-a10f-4d14-b1da-5ede6129db4d None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:38:54.432348 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:38:54.444690 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9da8d-816d-4c75-b1d9-cd92ad1e406f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:38:54.445360 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9da8d-816d-4c75-b1d9-cd92ad1e406f None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:54.445641 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9da8d-816d-4c75-b1d9-cd92ad1e406f None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:54.445947 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9da8d-816d-4c75-b1d9-cd92ad1e406f None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:54.446693 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9da8d-816d-4c75-b1d9-cd92ad1e406f None admin] RBAC: Adding query filter params (name=service) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:38:54.447010 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9da8d-816d-4c75-b1d9-cd92ad1e406f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:38:54.448376 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9da8d-816d-4c75-b1d9-cd92ad1e406f None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:38:54.456450 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 608/1223] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 5 20:38:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:38:54.462393 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22350af4-578e-48a2-bcc9-9d1ddee9f11b None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:38:54.511010 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:38:54.574238 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22350af4-578e-48a2-bcc9-9d1ddee9f11b None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:38:54.608732 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0bf31-4acd-45d9-8471-868c08fcdcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:38:54.609521 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0bf31-4acd-45d9-8471-868c08fcdcbb None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:54.609797 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0bf31-4acd-45d9-8471-868c08fcdcbb None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:54.610097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0bf31-4acd-45d9-8471-868c08fcdcbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:54.620924 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0bf31-4acd-45d9-8471-868c08fcdcbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:38:54.622595 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0bf31-4acd-45d9-8471-868c08fcdcbb None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:38:54.639805 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-f4a0bf31-4acd-45d9-8471-868c08fcdcbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:38:54.639805 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:38:54.639805 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:38:54.639805 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:38:54.639805 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:38:54.639805 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:38:54.639805 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:38:54.639805 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:38:54.639805 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:38:54.639805 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:38:54.639805 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:38:54.639805 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:38:54.639805 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:38:54.639805 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:38:54.639805 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:38:54.640940 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:38:54.640940 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:38:54.640940 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:38:54.640940 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:38:54.640940 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:38:54.640940 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:38:54.640940 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:38:54.640940 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:38:54.640940 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:38:54.640940 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:38:54.640940 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:38:54.640940 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:38:54.640940 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:38:54.640940 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:38:54.640940 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:38:54.640940 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:38:54.640940 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:38:54.647681 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:38:54.647681 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:38:54.647681 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:38:54.647681 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:38:54.647681 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 616/1224] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:38:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:38:54.648079 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9da8d-816d-4c75-b1d9-cd92ad1e406f None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:38:54.752049 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9da8d-816d-4c75-b1d9-cd92ad1e406f None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:38:54.789776 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35514559-1857-490b-8c3f-74d1f6778242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:38:54.790552 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35514559-1857-490b-8c3f-74d1f6778242 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:54.790859 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35514559-1857-490b-8c3f-74d1f6778242 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:54.791130 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35514559-1857-490b-8c3f-74d1f6778242 None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:54.791998 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35514559-1857-490b-8c3f-74d1f6778242 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:38:54.792359 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35514559-1857-490b-8c3f-74d1f6778242 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:38:54.793887 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35514559-1857-490b-8c3f-74d1f6778242 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:38:54.808112 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 609/1225] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:38:54.814244 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0bf31-4acd-45d9-8471-868c08fcdcbb None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:38:54.918892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:38:54.928112 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0bf31-4acd-45d9-8471-868c08fcdcbb None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:38:54.965590 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad978626-2ec8-470c-bfbf-5415a1ff0490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:38:54.966543 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad978626-2ec8-470c-bfbf-5415a1ff0490 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:54.966864 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad978626-2ec8-470c-bfbf-5415a1ff0490 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:54.967116 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad978626-2ec8-470c-bfbf-5415a1ff0490 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:54.975681 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad978626-2ec8-470c-bfbf-5415a1ff0490 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:38:54.977213 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad978626-2ec8-470c-bfbf-5415a1ff0490 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:38:54.995047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-ad978626-2ec8-470c-bfbf-5415a1ff0490 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 20:38:54.995047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:38:54.995047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:38:54.995047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:38:54.995047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:38:54.995047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:38:54.995047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:38:54.995047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:38:54.995047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:38:54.995047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:38:54.995047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:38:54.995047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:38:54.995047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:38:54.995047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:38:54.995047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:38:54.995047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:38:54.996593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:38:54.996593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:38:54.996593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:38:54.996593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:38:54.996593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:38:54.996593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:38:54.996593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:38:54.996593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:38:54.996593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:38:54.996593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:38:54.996593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:38:54.996593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:38:54.996593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:38:54.996593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:38:54.996593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:38:54.996593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:38:54.996593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:38:54.996593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:38:54.997740 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:38:54.997740 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:38:54.997740 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:38:54.997740 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:38:54.997740 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:38:54.997740 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:38:54.997740 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:38:54.997740 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:38:54.997740 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 20:38:54.997740 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:38:54.997740 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 617/1226] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:38:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:38:55.002797 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35514559-1857-490b-8c3f-74d1f6778242 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:38:55.057123 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:38:55.110082 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35514559-1857-490b-8c3f-74d1f6778242 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:38:55.146288 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da191d9-be68-41eb-b547-0521a2eb8472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:38:55.146959 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da191d9-be68-41eb-b547-0521a2eb8472 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:55.147235 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da191d9-be68-41eb-b547-0521a2eb8472 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:55.147504 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da191d9-be68-41eb-b547-0521a2eb8472 None admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:55.148341 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da191d9-be68-41eb-b547-0521a2eb8472 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:38:55.148649 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da191d9-be68-41eb-b547-0521a2eb8472 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:38:55.150100 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da191d9-be68-41eb-b547-0521a2eb8472 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:38:55.170424 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 610/1227] 10.222.0.27 () {56 vars in 1143 bytes} [Tue Jul 5 20:38:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:38:55.176244 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad978626-2ec8-470c-bfbf-5415a1ff0490 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:38:55.293759 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad978626-2ec8-470c-bfbf-5415a1ff0490 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:38:55.330610 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a3f34-7481-4dbb-8ffd-13940faa375d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:38:55.331450 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a3f34-7481-4dbb-8ffd-13940faa375d None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:55.331825 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a3f34-7481-4dbb-8ffd-13940faa375d None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:55.332088 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a3f34-7481-4dbb-8ffd-13940faa375d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:55.343571 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a3f34-7481-4dbb-8ffd-13940faa375d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:38:55.345136 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a3f34-7481-4dbb-8ffd-13940faa375d None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:38:55.363891 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-650a3f34-7481-4dbb-8ffd-13940faa375d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:38:55.363891 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:38:55.363891 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:38:55.363891 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:38:55.363891 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:38:55.363891 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:38:55.363891 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:38:55.363891 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:38:55.363891 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:38:55.363891 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:38:55.363891 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:38:55.363891 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:38:55.363891 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:38:55.363891 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:38:55.363891 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:38:55.365025 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:38:55.365025 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:38:55.365025 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:38:55.365025 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:38:55.365025 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:38:55.365025 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:38:55.365025 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:38:55.365025 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:38:55.365025 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:38:55.365025 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:38:55.365025 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:38:55.365025 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:38:55.365025 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:38:55.365025 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:38:55.365025 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:38:55.365025 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:38:55.365025 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:38:55.365992 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:38:55.365992 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:38:55.365992 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:38:55.365992 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:38:55.365992 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 618/1228] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:38:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:38:55.370997 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da191d9-be68-41eb-b547-0521a2eb8472 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:38:55.481063 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da191d9-be68-41eb-b547-0521a2eb8472 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:38:55.483637 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:38:55.518891 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a5bca-f499-4713-98b6-ac07a251bb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:38:55.519582 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a5bca-f499-4713-98b6-ac07a251bb0b None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:55.519866 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a5bca-f499-4713-98b6-ac07a251bb0b None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:55.520214 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a5bca-f499-4713-98b6-ac07a251bb0b None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:55.520939 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637a5bca-f499-4713-98b6-ac07a251bb0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:38:55.521245 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637a5bca-f499-4713-98b6-ac07a251bb0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:38:55.522660 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637a5bca-f499-4713-98b6-ac07a251bb0b None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:38:55.535717 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 611/1229] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:38:55.541930 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a3f34-7481-4dbb-8ffd-13940faa375d None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:38:55.552496 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:38:55.656875 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a3f34-7481-4dbb-8ffd-13940faa375d None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:38:55.695210 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d4046-61b0-41c3-8bdc-60d935d844b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:38:55.696131 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d4046-61b0-41c3-8bdc-60d935d844b7 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:55.696436 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d4046-61b0-41c3-8bdc-60d935d844b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:55.696843 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d4046-61b0-41c3-8bdc-60d935d844b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:55.704188 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d4046-61b0-41c3-8bdc-60d935d844b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:38:55.705779 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d4046-61b0-41c3-8bdc-60d935d844b7 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:38:55.721107 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-123d4046-61b0-41c3-8bdc-60d935d844b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:38:55.721107 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:38:55.721107 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:38:55.721107 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:38:55.721107 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:38:55.721107 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:38:55.721107 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:38:55.721107 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:38:55.721107 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:38:55.721107 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:38:55.721107 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:38:55.721107 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:38:55.721107 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:38:55.721107 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:38:55.721107 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:38:55.722288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:38:55.722288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:38:55.722288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:38:55.722288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:38:55.722288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:38:55.722288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:38:55.722288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:38:55.722288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:38:55.722288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:38:55.722288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:38:55.722288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:38:55.722288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:38:55.722288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:38:55.722288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:38:55.722288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:38:55.722288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:38:55.722288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:38:55.723342 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:38:55.723342 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:38:55.723342 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:38:55.723342 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:38:55.723342 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:38:55.723342 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:38:55.723342 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:38:55.723342 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:38:55.723821 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 619/1230] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:38:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:38:55.729832 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a5bca-f499-4713-98b6-ac07a251bb0b None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:38:55.839113 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a5bca-f499-4713-98b6-ac07a251bb0b None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:38:55.875016 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3766273-4c37-4df2-bb34-f2cbfdc5a992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:38:55.875763 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3766273-4c37-4df2-bb34-f2cbfdc5a992 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:55.876075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3766273-4c37-4df2-bb34-f2cbfdc5a992 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:55.876395 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3766273-4c37-4df2-bb34-f2cbfdc5a992 None admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:55.877204 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3766273-4c37-4df2-bb34-f2cbfdc5a992 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:38:55.877531 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3766273-4c37-4df2-bb34-f2cbfdc5a992 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:38:55.879250 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3766273-4c37-4df2-bb34-f2cbfdc5a992 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:38:55.892677 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 612/1231] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 5 20:38:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:38:55.899540 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d4046-61b0-41c3-8bdc-60d935d844b7 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:38:55.974940 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:38:56.010955 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d4046-61b0-41c3-8bdc-60d935d844b7 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:38:56.064972 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42358c-9d44-4424-a15d-c6433d87a92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:38:56.066065 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42358c-9d44-4424-a15d-c6433d87a92b None admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:56.066414 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42358c-9d44-4424-a15d-c6433d87a92b None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:56.066793 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42358c-9d44-4424-a15d-c6433d87a92b None admin] PATH_INFO: `/v3/projects/b321588ec1f14bcb94a184310cf72856/users/16662dd5e2e74163b6aa2e1e7ef07524/roles/4f5057900b094e6fb792884693177cd3` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:56.083670 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d42358c-9d44-4424-a15d-c6433d87a92b None admin] RBAC: Authorizing `identity:create_grant(project_id=b321588ec1f14bcb94a184310cf72856, user_id=16662dd5e2e74163b6aa2e1e7ef07524, role_id=4f5057900b094e6fb792884693177cd3)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:38:56.085311 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d42358c-9d44-4424-a15d-c6433d87a92b None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:38:56.098249 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 620/1232] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 5 20:38:55 2022] PUT /identity/v3/projects/b321588ec1f14bcb94a184310cf72856/users/16662dd5e2e74163b6aa2e1e7ef07524/roles/4f5057900b094e6fb792884693177cd3 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:38:58.325607 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d90de-43d7-497c-83d5-2d1ae7b5d125 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:58.326205 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d90de-43d7-497c-83d5-2d1ae7b5d125 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:58.326205 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d90de-43d7-497c-83d5-2d1ae7b5d125 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:58.327552 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 613/1233] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:38:58.332998 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f83358-97b1-4817-b96e-22e42540e157 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:58.333409 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f83358-97b1-4817-b96e-22e42540e157 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:58.333556 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f83358-97b1-4817-b96e-22e42540e157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:58.351595 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-68f83358-97b1-4817-b96e-22e42540e157 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:38:58.352806 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-68f83358-97b1-4817-b96e-22e42540e157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:38:58.438751 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 621/1234] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:38:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:38:58.464787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d90de-43d7-497c-83d5-2d1ae7b5d125 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:38:58.491476 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:38:58.573315 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d90de-43d7-497c-83d5-2d1ae7b5d125 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:38:58.611254 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e7060-9b84-4846-9781-fc3aa222ed69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:38:58.612399 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e7060-9b84-4846-9781-fc3aa222ed69 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:58.612775 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e7060-9b84-4846-9781-fc3aa222ed69 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:58.613215 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e7060-9b84-4846-9781-fc3aa222ed69 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:58.625369 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e7060-9b84-4846-9781-fc3aa222ed69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:38:58.633409 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-e58e7060-9b84-4846-9781-fc3aa222ed69 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:38:58.633409 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:38:58.633409 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:38:58.633409 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:38:58.633409 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:38:58.633409 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:38:58.633409 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:38:58.633409 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:38:58.633409 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:38:58.633409 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:38:58.633409 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:38:58.633409 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:38:58.633409 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:38:58.633409 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:38:58.633409 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:38:58.633409 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:38:58.634554 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:38:58.634554 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:38:58.634554 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:38:58.634554 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:38:58.634554 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:38:58.634554 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:38:58.634554 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:38:58.634554 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:38:58.634554 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:38:58.634554 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:38:58.634554 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:38:58.634554 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:38:58.634554 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:38:58.634554 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:38:58.634554 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:38:58.634554 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:38:58.635651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:38:58.635651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:38:58.635651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:38:58.635651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:38:58.635651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:38:58.635651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:38:58.635651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:38:58.635651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:38:58.635651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:38:58.635651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:38:58.635651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 05 20:38:58.635651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:38:58.638019 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 614/1235] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 5 20:38:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:38:58.640871 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f83358-97b1-4817-b96e-22e42540e157 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:38:58.690057 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:38:58.753394 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f83358-97b1-4817-b96e-22e42540e157 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:38:58.790253 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3deaa-00e6-4ef2-a05c-d6ea93aa5f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:38:58.790996 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3deaa-00e6-4ef2-a05c-d6ea93aa5f0c None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:58.791272 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3deaa-00e6-4ef2-a05c-d6ea93aa5f0c None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:58.791570 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3deaa-00e6-4ef2-a05c-d6ea93aa5f0c None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:58.792389 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da3deaa-00e6-4ef2-a05c-d6ea93aa5f0c None admin] RBAC: Adding query filter params (name=service) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:38:58.792691 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da3deaa-00e6-4ef2-a05c-d6ea93aa5f0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:38:58.794154 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da3deaa-00e6-4ef2-a05c-d6ea93aa5f0c None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:38:58.804017 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 622/1236] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 5 20:38:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:38:58.810154 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e7060-9b84-4846-9781-fc3aa222ed69 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:38:58.903094 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:38:58.923337 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e7060-9b84-4846-9781-fc3aa222ed69 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:38:58.967044 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd864e-2761-4be2-9d27-b61d11bd1d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:38:58.967846 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd864e-2761-4be2-9d27-b61d11bd1d0c None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:58.968133 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd864e-2761-4be2-9d27-b61d11bd1d0c None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:58.968441 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd864e-2761-4be2-9d27-b61d11bd1d0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:58.980628 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd864e-2761-4be2-9d27-b61d11bd1d0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:38:58.982195 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd864e-2761-4be2-9d27-b61d11bd1d0c None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:38:59.001476 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-79fd864e-2761-4be2-9d27-b61d11bd1d0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:38:59.001476 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:38:59.001476 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:38:59.001476 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:38:59.001476 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:38:59.001476 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:38:59.001476 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:38:59.001476 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:38:59.001476 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:38:59.001476 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:38:59.001476 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:38:59.001476 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:38:59.001476 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:38:59.001476 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:38:59.001476 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:38:59.002647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:38:59.002647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:38:59.002647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:38:59.002647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:38:59.002647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:38:59.002647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:38:59.002647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:38:59.002647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:38:59.002647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:38:59.002647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:38:59.002647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:38:59.002647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:38:59.002647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:38:59.002647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:38:59.002647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:38:59.002647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:38:59.002647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:38:59.003864 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:38:59.003864 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:38:59.003864 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:38:59.003864 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:38:59.003864 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 615/1237] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:38:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:38:59.008587 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3deaa-00e6-4ef2-a05c-d6ea93aa5f0c None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:38:59.118832 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3deaa-00e6-4ef2-a05c-d6ea93aa5f0c None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:38:59.128918 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:38:59.158067 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd67640-d8e3-4378-a568-25814b4937ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:38:59.158776 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd67640-d8e3-4378-a568-25814b4937ae None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:59.159056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd67640-d8e3-4378-a568-25814b4937ae None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:59.159329 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd67640-d8e3-4378-a568-25814b4937ae None admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:59.160288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd67640-d8e3-4378-a568-25814b4937ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:38:59.160709 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd67640-d8e3-4378-a568-25814b4937ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:38:59.162118 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd67640-d8e3-4378-a568-25814b4937ae None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:38:59.174490 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 623/1238] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:38:59.180688 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd864e-2761-4be2-9d27-b61d11bd1d0c None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:38:59.300270 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd864e-2761-4be2-9d27-b61d11bd1d0c None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:38:59.337267 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db572757-aebe-4a2f-b553-7eb9fbb111e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:38:59.338169 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db572757-aebe-4a2f-b553-7eb9fbb111e8 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:59.338447 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db572757-aebe-4a2f-b553-7eb9fbb111e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:59.338712 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db572757-aebe-4a2f-b553-7eb9fbb111e8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:59.341467 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:38:59.347578 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db572757-aebe-4a2f-b553-7eb9fbb111e8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:38:59.349182 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db572757-aebe-4a2f-b553-7eb9fbb111e8 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:38:59.363599 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-db572757-aebe-4a2f-b553-7eb9fbb111e8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 20:38:59.363599 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:38:59.363599 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:38:59.363599 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:38:59.363599 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:38:59.363599 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:38:59.363599 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:38:59.363599 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:38:59.363599 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:38:59.363599 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:38:59.363599 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:38:59.363599 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:38:59.363599 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:38:59.363599 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:38:59.363599 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:38:59.363599 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:38:59.364980 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:38:59.364980 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:38:59.364980 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:38:59.364980 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:38:59.364980 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:38:59.364980 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:38:59.364980 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:38:59.364980 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:38:59.364980 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:38:59.364980 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:38:59.364980 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:38:59.364980 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:38:59.364980 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:38:59.364980 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:38:59.364980 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:38:59.364980 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:38:59.364980 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:38:59.364980 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:38:59.366058 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:38:59.366058 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:38:59.366058 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:38:59.366058 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:38:59.366058 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:38:59.366058 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:38:59.366058 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:38:59.366058 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:38:59.366058 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 20:38:59.366058 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:38:59.366058 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 616/1239] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:38:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:38:59.370688 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd67640-d8e3-4378-a568-25814b4937ae None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:38:59.480294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd67640-d8e3-4378-a568-25814b4937ae None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:38:59.517469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6bd971-34c8-47f4-a98d-c0bb86cd3d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:38:59.518264 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bd971-34c8-47f4-a98d-c0bb86cd3d62 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:59.518550 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bd971-34c8-47f4-a98d-c0bb86cd3d62 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:59.518851 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6bd971-34c8-47f4-a98d-c0bb86cd3d62 None admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:59.519763 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6bd971-34c8-47f4-a98d-c0bb86cd3d62 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:38:59.520066 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6bd971-34c8-47f4-a98d-c0bb86cd3d62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:38:59.521834 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6bd971-34c8-47f4-a98d-c0bb86cd3d62 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:38:59.540710 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 624/1240] 10.222.0.27 () {56 vars in 1143 bytes} [Tue Jul 5 20:38:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:38:59.547068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db572757-aebe-4a2f-b553-7eb9fbb111e8 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:38:59.654701 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db572757-aebe-4a2f-b553-7eb9fbb111e8 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:38:59.692621 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945e4fa-540f-4ba8-ba28-9eb8b37130bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:38:59.693278 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945e4fa-540f-4ba8-ba28-9eb8b37130bc None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:38:59.693577 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945e4fa-540f-4ba8-ba28-9eb8b37130bc None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:38:59.693857 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945e4fa-540f-4ba8-ba28-9eb8b37130bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:38:59.766040 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:38:59.773699 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945e4fa-540f-4ba8-ba28-9eb8b37130bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:38:59.775241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945e4fa-540f-4ba8-ba28-9eb8b37130bc None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:38:59.894083 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 617/1241] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:38:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 20:38:59.895371 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6bd971-34c8-47f4-a98d-c0bb86cd3d62 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:38:59.927197 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:00.013926 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6bd971-34c8-47f4-a98d-c0bb86cd3d62 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:00.051791 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56bf54-92dd-4061-84d7-84c84664eaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:00.052585 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56bf54-92dd-4061-84d7-84c84664eaae None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:00.052861 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56bf54-92dd-4061-84d7-84c84664eaae None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:00.053132 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56bf54-92dd-4061-84d7-84c84664eaae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:00.064818 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56bf54-92dd-4061-84d7-84c84664eaae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:00.066808 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56bf54-92dd-4061-84d7-84c84664eaae None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:00.089664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-7c56bf54-92dd-4061-84d7-84c84664eaae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:39:00.089664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:39:00.089664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:39:00.089664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:39:00.089664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:39:00.089664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:39:00.089664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:39:00.089664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:39:00.089664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:39:00.089664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:39:00.089664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:39:00.089664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:39:00.089664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:39:00.089664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:39:00.089664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:39:00.090841 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:39:00.090841 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:39:00.090841 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:39:00.090841 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:39:00.090841 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:39:00.090841 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:39:00.090841 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:39:00.090841 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:39:00.090841 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:39:00.090841 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:39:00.090841 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:39:00.090841 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:39:00.090841 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:39:00.090841 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:39:00.090841 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:39:00.090841 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:39:00.090841 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:39:00.091789 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:39:00.091789 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:39:00.091789 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:39:00.091789 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:39:00.091789 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 625/1242] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:38:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:39:00.097824 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945e4fa-540f-4ba8-ba28-9eb8b37130bc None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:00.198185 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:00.204417 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945e4fa-540f-4ba8-ba28-9eb8b37130bc None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:00.243282 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f09bb1-56f2-40fe-a6db-8e3ef892ce89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:00.244205 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f09bb1-56f2-40fe-a6db-8e3ef892ce89 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:00.244494 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f09bb1-56f2-40fe-a6db-8e3ef892ce89 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:00.244920 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f09bb1-56f2-40fe-a6db-8e3ef892ce89 None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:00.245890 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f09bb1-56f2-40fe-a6db-8e3ef892ce89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:39:00.246381 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f09bb1-56f2-40fe-a6db-8e3ef892ce89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:00.248005 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f09bb1-56f2-40fe-a6db-8e3ef892ce89 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:00.262204 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 618/1243] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:39:00.269251 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56bf54-92dd-4061-84d7-84c84664eaae None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:00.358610 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:00.382061 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56bf54-92dd-4061-84d7-84c84664eaae None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:00.418552 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3e996-9b1a-45c3-9ebe-05dc3310fec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:00.419380 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3e996-9b1a-45c3-9ebe-05dc3310fec5 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:00.419964 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3e996-9b1a-45c3-9ebe-05dc3310fec5 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:00.420364 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3e996-9b1a-45c3-9ebe-05dc3310fec5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:00.430631 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3e996-9b1a-45c3-9ebe-05dc3310fec5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:00.432241 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3e996-9b1a-45c3-9ebe-05dc3310fec5 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:00.449593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-8ec3e996-9b1a-45c3-9ebe-05dc3310fec5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:39:00.449593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:39:00.449593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:39:00.449593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:39:00.449593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:39:00.449593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:39:00.449593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:39:00.449593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:39:00.449593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:39:00.449593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:39:00.449593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:39:00.449593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:39:00.449593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:39:00.449593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:39:00.449593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:39:00.450904 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:39:00.450904 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:39:00.450904 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:39:00.450904 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:39:00.450904 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:39:00.450904 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:39:00.450904 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:39:00.450904 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:39:00.450904 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:39:00.450904 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:39:00.450904 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:39:00.450904 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:39:00.450904 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:39:00.450904 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:39:00.450904 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:39:00.450904 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:39:00.450904 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:39:00.451975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:39:00.451975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:39:00.451975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:39:00.451975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:39:00.451975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:39:00.451975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:39:00.451975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:39:00.451975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:39:00.451975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 626/1244] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:39:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:39:00.457226 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f09bb1-56f2-40fe-a6db-8e3ef892ce89 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:00.566948 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f09bb1-56f2-40fe-a6db-8e3ef892ce89 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:00.603161 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd64f7e-2c2f-4968-bec5-958540d6200a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:00.603852 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd64f7e-2c2f-4968-bec5-958540d6200a None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:00.604142 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd64f7e-2c2f-4968-bec5-958540d6200a None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:00.604448 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd64f7e-2c2f-4968-bec5-958540d6200a None admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:00.605266 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd64f7e-2c2f-4968-bec5-958540d6200a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:39:00.605637 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd64f7e-2c2f-4968-bec5-958540d6200a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:00.607300 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd64f7e-2c2f-4968-bec5-958540d6200a None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:00.620741 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 619/1245] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 5 20:39:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:39:00.627844 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3e996-9b1a-45c3-9ebe-05dc3310fec5 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:00.740056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3e996-9b1a-45c3-9ebe-05dc3310fec5 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:00.782865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d797b-2dd2-4245-899c-d6ff3e98ccca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:00.783489 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d797b-2dd2-4245-899c-d6ff3e98ccca None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:00.783813 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d797b-2dd2-4245-899c-d6ff3e98ccca None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:00.784070 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d797b-2dd2-4245-899c-d6ff3e98ccca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:00.784980 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7d797b-2dd2-4245-899c-d6ff3e98ccca None admin] RBAC: Adding query filter params (role.id=4f5057900b094e6fb792884693177cd3, scope.project.id=b321588ec1f14bcb94a184310cf72856, user.id=16662dd5e2e74163b6aa2e1e7ef07524) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:39:00.785289 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7d797b-2dd2-4245-899c-d6ff3e98ccca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:00.786790 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7d797b-2dd2-4245-899c-d6ff3e98ccca None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:00.793995 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 627/1246] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:39:00 2022] GET /identity/v3/role_assignments?user.id=16662dd5e2e74163b6aa2e1e7ef07524&scope.project.id=b321588ec1f14bcb94a184310cf72856&role.id=4f5057900b094e6fb792884693177cd3 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:39:02.983378 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bbbb7-3e83-4e08-b81d-6ea311f3d18d None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:02.983944 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bbbb7-3e83-4e08-b81d-6ea311f3d18d None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:02.984075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bbbb7-3e83-4e08-b81d-6ea311f3d18d None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:02.985566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 620/1247] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:39:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:39:02.990988 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e2500-8fb0-425a-8632-b9c6cea689dc None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:02.991448 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e2500-8fb0-425a-8632-b9c6cea689dc None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:02.991587 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e2500-8fb0-425a-8632-b9c6cea689dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:02.996815 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:03.009959 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-9f9e2500-8fb0-425a-8632-b9c6cea689dc None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:39:03.011761 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-9f9e2500-8fb0-425a-8632-b9c6cea689dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:39:03.087359 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 628/1248] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:39:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 05 20:39:03.110804 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536bbbb7-3e83-4e08-b81d-6ea311f3d18d None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:03.134800 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:03.245054 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536bbbb7-3e83-4e08-b81d-6ea311f3d18d None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:03.287842 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd8ef89-4b6b-4c42-be88-9ab1b274c68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:03.288785 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8ef89-4b6b-4c42-be88-9ab1b274c68b None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:03.289068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8ef89-4b6b-4c42-be88-9ab1b274c68b None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:03.289336 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8ef89-4b6b-4c42-be88-9ab1b274c68b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:03.302280 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd8ef89-4b6b-4c42-be88-9ab1b274c68b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:39:03.311479 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-7bd8ef89-4b6b-4c42-be88-9ab1b274c68b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:39:03.311479 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:39:03.311479 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:39:03.311479 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:39:03.311479 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:39:03.311479 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:39:03.311479 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:39:03.311479 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:39:03.311479 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:39:03.311479 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:39:03.311479 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:39:03.311479 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:39:03.311479 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:39:03.311479 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:39:03.311479 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:39:03.311479 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:39:03.312885 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:39:03.312885 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:39:03.312885 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:39:03.312885 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:39:03.312885 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:39:03.312885 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:39:03.312885 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:39:03.312885 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:39:03.312885 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:39:03.312885 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:39:03.312885 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:39:03.312885 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:39:03.312885 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:39:03.312885 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:39:03.312885 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:39:03.312885 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:39:03.313958 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:39:03.313958 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:39:03.313958 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:39:03.313958 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:39:03.313958 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:39:03.313958 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:39:03.313958 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:39:03.313958 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:39:03.313958 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:39:03.313958 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:39:03.313958 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:39:03.313958 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:39:03.313958 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 621/1249] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 5 20:39:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:39:03.322035 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e2500-8fb0-425a-8632-b9c6cea689dc None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:03.437048 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e2500-8fb0-425a-8632-b9c6cea689dc None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:03.470118 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:03.475923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384da0a3-3e4a-46b3-8d74-0d351ae35971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:03.476762 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384da0a3-3e4a-46b3-8d74-0d351ae35971 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:03.477205 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384da0a3-3e4a-46b3-8d74-0d351ae35971 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:03.477515 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384da0a3-3e4a-46b3-8d74-0d351ae35971 None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:03.478391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384da0a3-3e4a-46b3-8d74-0d351ae35971 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:39:03.478656 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384da0a3-3e4a-46b3-8d74-0d351ae35971 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:03.480164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384da0a3-3e4a-46b3-8d74-0d351ae35971 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:03.488898 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 629/1250] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:39:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:39:03.494795 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd8ef89-4b6b-4c42-be88-9ab1b274c68b None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:03.581159 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:03.607549 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd8ef89-4b6b-4c42-be88-9ab1b274c68b None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:03.645517 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50972f1-ad89-4bcf-a3a2-2fc3b73640ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:03.646432 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50972f1-ad89-4bcf-a3a2-2fc3b73640ca None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:03.646680 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50972f1-ad89-4bcf-a3a2-2fc3b73640ca None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:03.646996 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50972f1-ad89-4bcf-a3a2-2fc3b73640ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:03.659006 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50972f1-ad89-4bcf-a3a2-2fc3b73640ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:03.660469 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50972f1-ad89-4bcf-a3a2-2fc3b73640ca None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:03.678248 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-d50972f1-ad89-4bcf-a3a2-2fc3b73640ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:39:03.678248 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:39:03.678248 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:39:03.678248 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:39:03.678248 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:39:03.678248 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:39:03.678248 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:39:03.678248 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:39:03.678248 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:39:03.678248 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:39:03.678248 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:39:03.678248 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:39:03.678248 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:39:03.678248 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:39:03.678248 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:39:03.679149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:39:03.679149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:39:03.679149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:39:03.679149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:39:03.679149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:39:03.679149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:39:03.679149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:39:03.679149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:39:03.679149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:39:03.679149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:39:03.679149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:39:03.679149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:39:03.679149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:39:03.679149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:39:03.679149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:39:03.679149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:39:03.679149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:39:03.680066 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:39:03.680066 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:39:03.680066 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:39:03.680066 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:39:03.680066 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 622/1251] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:39:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:39:03.685899 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384da0a3-3e4a-46b3-8d74-0d351ae35971 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:03.804726 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384da0a3-3e4a-46b3-8d74-0d351ae35971 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:03.841586 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f88eab-f05d-44e6-826b-34e5d41f89a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:03.842296 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f88eab-f05d-44e6-826b-34e5d41f89a0 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:03.842612 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f88eab-f05d-44e6-826b-34e5d41f89a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:03.842873 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f88eab-f05d-44e6-826b-34e5d41f89a0 None admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:03.843680 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f88eab-f05d-44e6-826b-34e5d41f89a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:39:03.844029 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f88eab-f05d-44e6-826b-34e5d41f89a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:03.845483 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f88eab-f05d-44e6-826b-34e5d41f89a0 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:03.857991 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 630/1252] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:39:03.864025 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50972f1-ad89-4bcf-a3a2-2fc3b73640ca None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:03.980954 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50972f1-ad89-4bcf-a3a2-2fc3b73640ca None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:04.010110 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:04.019952 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717ab87-f118-41ba-bc12-ee9d3d435785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:04.020801 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717ab87-f118-41ba-bc12-ee9d3d435785 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:04.021080 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717ab87-f118-41ba-bc12-ee9d3d435785 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:04.021350 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717ab87-f118-41ba-bc12-ee9d3d435785 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:04.030308 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a717ab87-f118-41ba-bc12-ee9d3d435785 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:04.031886 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a717ab87-f118-41ba-bc12-ee9d3d435785 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:04.048298 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-a717ab87-f118-41ba-bc12-ee9d3d435785 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 20:39:04.048298 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:39:04.048298 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:39:04.048298 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:39:04.048298 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:39:04.048298 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:39:04.048298 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:39:04.048298 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:39:04.048298 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:39:04.048298 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:39:04.048298 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:39:04.048298 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:39:04.048298 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:39:04.048298 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:39:04.048298 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:39:04.048298 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:39:04.049606 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:39:04.049606 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:39:04.049606 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:39:04.049606 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:39:04.049606 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:39:04.049606 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:39:04.049606 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:39:04.049606 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:39:04.049606 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:39:04.049606 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:39:04.049606 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:39:04.049606 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:39:04.049606 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:39:04.049606 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:39:04.049606 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:39:04.049606 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:39:04.049606 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:39:04.049606 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:39:04.050773 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:39:04.050773 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:39:04.050773 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:39:04.050773 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:39:04.050773 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:39:04.050773 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:39:04.050773 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:39:04.050773 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:39:04.050773 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 20:39:04.050773 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:39:04.054558 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 623/1253] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:39:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:39:04.055812 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f88eab-f05d-44e6-826b-34e5d41f89a0 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:04.118044 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:04.166968 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f88eab-f05d-44e6-826b-34e5d41f89a0 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:04.203290 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb19b5d-3e43-4766-ab8f-394974b477a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:04.204079 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb19b5d-3e43-4766-ab8f-394974b477a7 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:04.204359 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb19b5d-3e43-4766-ab8f-394974b477a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:04.204631 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb19b5d-3e43-4766-ab8f-394974b477a7 None admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:04.205511 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb19b5d-3e43-4766-ab8f-394974b477a7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:39:04.205863 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb19b5d-3e43-4766-ab8f-394974b477a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:04.207328 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb19b5d-3e43-4766-ab8f-394974b477a7 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:04.226047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 631/1254] 10.222.0.27 () {56 vars in 1143 bytes} [Tue Jul 5 20:39:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:39:04.231938 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717ab87-f118-41ba-bc12-ee9d3d435785 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:04.341448 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717ab87-f118-41ba-bc12-ee9d3d435785 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:04.378366 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c8e92-1b86-4e53-b1e3-4626ccdb66d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:04.378959 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c8e92-1b86-4e53-b1e3-4626ccdb66d6 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:04.379234 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c8e92-1b86-4e53-b1e3-4626ccdb66d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:04.379569 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c8e92-1b86-4e53-b1e3-4626ccdb66d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:04.447489 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:04.464963 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c8e92-1b86-4e53-b1e3-4626ccdb66d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:04.466790 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c8e92-1b86-4e53-b1e3-4626ccdb66d6 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:04.579072 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 624/1255] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:39:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 05 20:39:04.585785 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb19b5d-3e43-4766-ab8f-394974b477a7 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:04.711836 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb19b5d-3e43-4766-ab8f-394974b477a7 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:04.726949 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:04.752175 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00a286-901a-4aa6-8b22-685bd003be9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:04.753050 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00a286-901a-4aa6-8b22-685bd003be9b None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:04.753330 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00a286-901a-4aa6-8b22-685bd003be9b None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:04.753584 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00a286-901a-4aa6-8b22-685bd003be9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:04.765204 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00a286-901a-4aa6-8b22-685bd003be9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:04.766676 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00a286-901a-4aa6-8b22-685bd003be9b None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:04.787878 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-7f00a286-901a-4aa6-8b22-685bd003be9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:39:04.787878 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:39:04.787878 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:39:04.787878 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:39:04.787878 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:39:04.787878 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:39:04.787878 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:39:04.787878 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:39:04.787878 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:39:04.787878 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:39:04.787878 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:39:04.787878 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:39:04.787878 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:39:04.787878 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:39:04.787878 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:39:04.788959 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:39:04.788959 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:39:04.788959 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:39:04.788959 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:39:04.788959 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:39:04.788959 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:39:04.788959 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:39:04.788959 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:39:04.788959 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:39:04.788959 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:39:04.788959 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:39:04.788959 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:39:04.788959 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:39:04.788959 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:39:04.788959 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:39:04.788959 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:39:04.788959 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:39:04.790162 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:39:04.790162 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:39:04.790162 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:39:04.790162 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:39:04.790162 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 632/1256] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:39:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:39:04.795953 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c8e92-1b86-4e53-b1e3-4626ccdb66d6 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:04.905982 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:04.920614 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c8e92-1b86-4e53-b1e3-4626ccdb66d6 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:04.964283 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6239c0-6d5c-4b86-a5fd-ad0bdfca5351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:04.965112 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6239c0-6d5c-4b86-a5fd-ad0bdfca5351 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:04.965402 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6239c0-6d5c-4b86-a5fd-ad0bdfca5351 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:04.965714 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6239c0-6d5c-4b86-a5fd-ad0bdfca5351 None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:04.966587 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6239c0-6d5c-4b86-a5fd-ad0bdfca5351 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:39:04.966899 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6239c0-6d5c-4b86-a5fd-ad0bdfca5351 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:04.968403 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6239c0-6d5c-4b86-a5fd-ad0bdfca5351 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:04.981743 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 625/1257] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:39:04.987501 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00a286-901a-4aa6-8b22-685bd003be9b None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:05.093746 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00a286-901a-4aa6-8b22-685bd003be9b None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:05.130394 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa8215-ca69-444c-a33d-bc57434f81ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:05.131283 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa8215-ca69-444c-a33d-bc57434f81ed None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:05.131647 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa8215-ca69-444c-a33d-bc57434f81ed None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:05.131973 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa8215-ca69-444c-a33d-bc57434f81ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:05.144242 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa8215-ca69-444c-a33d-bc57434f81ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:05.146004 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa8215-ca69-444c-a33d-bc57434f81ed None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:05.162641 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-b0fa8215-ca69-444c-a33d-bc57434f81ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:39:05.162641 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:39:05.162641 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:39:05.162641 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:39:05.162641 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:39:05.162641 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:39:05.162641 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:39:05.162641 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:39:05.162641 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:39:05.162641 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:39:05.162641 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:39:05.162641 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:39:05.162641 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:39:05.162641 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:39:05.162641 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:39:05.163843 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:39:05.163843 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:39:05.163843 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:39:05.163843 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:39:05.163843 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:39:05.163843 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:39:05.163843 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:39:05.163843 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:39:05.163843 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:39:05.163843 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:39:05.163843 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:39:05.163843 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:39:05.163843 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:39:05.163843 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:39:05.163843 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:39:05.163843 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:39:05.163843 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:39:05.164903 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:39:05.164903 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:39:05.164903 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:39:05.164903 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:39:05.164903 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:39:05.164903 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:39:05.164903 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:39:05.164903 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:39:05.164903 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 633/1258] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:39:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:39:05.169987 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6239c0-6d5c-4b86-a5fd-ad0bdfca5351 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:05.279007 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6239c0-6d5c-4b86-a5fd-ad0bdfca5351 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:05.314687 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffc283-ec78-46f3-ad27-827176a455f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:05.315353 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffc283-ec78-46f3-ad27-827176a455f8 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:05.315631 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffc283-ec78-46f3-ad27-827176a455f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:05.315906 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffc283-ec78-46f3-ad27-827176a455f8 None admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:05.316698 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffc283-ec78-46f3-ad27-827176a455f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:39:05.317056 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffc283-ec78-46f3-ad27-827176a455f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:05.318716 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffc283-ec78-46f3-ad27-827176a455f8 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:05.333377 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 626/1259] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 5 20:39:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:39:05.339660 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa8215-ca69-444c-a33d-bc57434f81ed None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:05.367479 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:05.448883 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa8215-ca69-444c-a33d-bc57434f81ed None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:05.486891 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855d901-3e54-48b2-aad5-23e940074300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:05.487542 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855d901-3e54-48b2-aad5-23e940074300 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:05.487814 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855d901-3e54-48b2-aad5-23e940074300 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:05.488081 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855d901-3e54-48b2-aad5-23e940074300 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:05.489048 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855d901-3e54-48b2-aad5-23e940074300 None admin] RBAC: Adding query filter params (role.id=37ba4a62052348d4811b560c19a07e02, scope.project.id=b321588ec1f14bcb94a184310cf72856, user.id=16662dd5e2e74163b6aa2e1e7ef07524) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:39:05.489366 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855d901-3e54-48b2-aad5-23e940074300 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:05.490910 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855d901-3e54-48b2-aad5-23e940074300 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:05.497219 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 634/1260] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:39:05 2022] GET /identity/v3/role_assignments?user.id=16662dd5e2e74163b6aa2e1e7ef07524&scope.project.id=b321588ec1f14bcb94a184310cf72856&role.id=37ba4a62052348d4811b560c19a07e02 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:39:07.524995 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d4177-a232-49e7-9105-628b749332be None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:07.525791 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d4177-a232-49e7-9105-628b749332be None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:07.525791 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d4177-a232-49e7-9105-628b749332be None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:07.527934 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 627/1261] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:39:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:39:07.536939 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b74a6-97b1-498d-bec9-8ec00d6d41dc None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:07.537623 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b74a6-97b1-498d-bec9-8ec00d6d41dc None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:07.537820 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b74a6-97b1-498d-bec9-8ec00d6d41dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:07.558781 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-f71b74a6-97b1-498d-bec9-8ec00d6d41dc None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:39:07.559994 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-f71b74a6-97b1-498d-bec9-8ec00d6d41dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:39:07.642384 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 635/1262] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:39:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:39:07.674436 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d4177-a232-49e7-9105-628b749332be None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:07.686958 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:07.790318 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d4177-a232-49e7-9105-628b749332be None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:07.827282 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044dca9b-3c74-4685-a9e2-363135f5a0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:07.828077 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044dca9b-3c74-4685-a9e2-363135f5a0e2 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:07.828358 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044dca9b-3c74-4685-a9e2-363135f5a0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:07.828627 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044dca9b-3c74-4685-a9e2-363135f5a0e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:07.839680 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044dca9b-3c74-4685-a9e2-363135f5a0e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:39:07.847176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-044dca9b-3c74-4685-a9e2-363135f5a0e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:39:07.847176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:39:07.847176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:39:07.847176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:39:07.847176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:39:07.847176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:39:07.847176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:39:07.847176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:39:07.847176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:39:07.847176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:39:07.847176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:39:07.847176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:39:07.847176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:39:07.847176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:39:07.847176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:39:07.847176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:39:07.848260 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:39:07.848260 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:39:07.848260 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:39:07.848260 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:39:07.848260 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:39:07.848260 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:39:07.848260 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:39:07.848260 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:39:07.848260 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:39:07.848260 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:39:07.848260 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:39:07.848260 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:39:07.848260 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:39:07.848260 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:39:07.848260 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:39:07.848260 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:39:07.849788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:39:07.849788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:39:07.849788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:39:07.849788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:39:07.849788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:39:07.849788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:39:07.849788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:39:07.849788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:39:07.849788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:39:07.849788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:39:07.849788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:39:07.849788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:39:07.849788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 628/1263] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 5 20:39:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:39:07.858535 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b74a6-97b1-498d-bec9-8ec00d6d41dc None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:07.886869 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:07.981968 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b74a6-97b1-498d-bec9-8ec00d6d41dc None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:08.017865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba1d5c-5ca8-4c83-a19a-be170b678304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:08.018545 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba1d5c-5ca8-4c83-a19a-be170b678304 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:08.018824 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba1d5c-5ca8-4c83-a19a-be170b678304 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:08.019093 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba1d5c-5ca8-4c83-a19a-be170b678304 None admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:08.019831 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba1d5c-5ca8-4c83-a19a-be170b678304 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:39:08.020137 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba1d5c-5ca8-4c83-a19a-be170b678304 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:08.021506 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba1d5c-5ca8-4c83-a19a-be170b678304 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:08.029953 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 636/1264] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:39:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:39:08.038133 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044dca9b-3c74-4685-a9e2-363135f5a0e2 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:08.115101 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:08.155386 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044dca9b-3c74-4685-a9e2-363135f5a0e2 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:08.192050 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221c10b-6268-4907-a99a-7528f8ae0ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:08.192871 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221c10b-6268-4907-a99a-7528f8ae0ed9 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:08.193152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221c10b-6268-4907-a99a-7528f8ae0ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:08.193418 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221c10b-6268-4907-a99a-7528f8ae0ed9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:08.204456 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6221c10b-6268-4907-a99a-7528f8ae0ed9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:08.205929 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6221c10b-6268-4907-a99a-7528f8ae0ed9 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:08.224020 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-6221c10b-6268-4907-a99a-7528f8ae0ed9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:39:08.224020 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:39:08.224020 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:39:08.224020 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:39:08.224020 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:39:08.224020 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:39:08.224020 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:39:08.224020 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:39:08.224020 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:39:08.224020 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:39:08.224020 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:39:08.224020 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:39:08.224020 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:39:08.224020 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:39:08.224020 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:39:08.225075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:39:08.225075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:39:08.225075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:39:08.225075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:39:08.225075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:39:08.225075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:39:08.225075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:39:08.225075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:39:08.225075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:39:08.225075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:39:08.225075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:39:08.225075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:39:08.225075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:39:08.225075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:39:08.225075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:39:08.225075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:39:08.225075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:39:08.226107 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:39:08.226107 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:39:08.226107 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:39:08.226107 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:39:08.226107 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 629/1265] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:39:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:39:08.231702 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba1d5c-5ca8-4c83-a19a-be170b678304 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:08.321982 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:08.344439 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba1d5c-5ca8-4c83-a19a-be170b678304 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:08.379600 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb5597-5c51-4a29-853c-a4fcbedafc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:08.380184 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb5597-5c51-4a29-853c-a4fcbedafc10 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:08.380458 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb5597-5c51-4a29-853c-a4fcbedafc10 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:08.380725 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb5597-5c51-4a29-853c-a4fcbedafc10 None admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:08.381442 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb5597-5c51-4a29-853c-a4fcbedafc10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:39:08.381745 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb5597-5c51-4a29-853c-a4fcbedafc10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:08.383168 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb5597-5c51-4a29-853c-a4fcbedafc10 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:08.396052 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 637/1266] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:39:08.405062 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221c10b-6268-4907-a99a-7528f8ae0ed9 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:08.508453 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221c10b-6268-4907-a99a-7528f8ae0ed9 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:08.528234 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:08.550323 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4016b9-f850-47af-bc2a-34685b18eda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:08.551124 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4016b9-f850-47af-bc2a-34685b18eda7 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:08.551405 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4016b9-f850-47af-bc2a-34685b18eda7 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:08.551681 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4016b9-f850-47af-bc2a-34685b18eda7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:08.559722 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4016b9-f850-47af-bc2a-34685b18eda7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:08.561171 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4016b9-f850-47af-bc2a-34685b18eda7 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:08.576090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-1d4016b9-f850-47af-bc2a-34685b18eda7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 20:39:08.576090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:39:08.576090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:39:08.576090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:39:08.576090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:39:08.576090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:39:08.576090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:39:08.576090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:39:08.576090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:39:08.576090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:39:08.576090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:39:08.576090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:39:08.576090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:39:08.576090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:39:08.576090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:39:08.576090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:39:08.577921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:39:08.577921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:39:08.577921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:39:08.577921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:39:08.577921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:39:08.577921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:39:08.577921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:39:08.577921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:39:08.577921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:39:08.577921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:39:08.577921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:39:08.577921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:39:08.577921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:39:08.577921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:39:08.577921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:39:08.577921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:39:08.577921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:39:08.577921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:39:08.579560 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:39:08.579560 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:39:08.579560 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:39:08.579560 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:39:08.579560 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:39:08.579560 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:39:08.579560 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:39:08.579560 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:39:08.579560 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 20:39:08.579560 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:39:08.579560 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 630/1267] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:39:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:39:08.583396 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb5597-5c51-4a29-853c-a4fcbedafc10 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:08.698554 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb5597-5c51-4a29-853c-a4fcbedafc10 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:08.741389 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d32801-f220-419a-bb61-ea14551a546a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:08.742482 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d32801-f220-419a-bb61-ea14551a546a None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:08.742911 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d32801-f220-419a-bb61-ea14551a546a None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:08.743354 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d32801-f220-419a-bb61-ea14551a546a None admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:08.744693 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d32801-f220-419a-bb61-ea14551a546a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:39:08.745183 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d32801-f220-419a-bb61-ea14551a546a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:08.746934 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d32801-f220-419a-bb61-ea14551a546a None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:08.755801 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:08.764820 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 638/1268] 10.222.0.27 () {56 vars in 1143 bytes} [Tue Jul 5 20:39:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:39:08.770777 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4016b9-f850-47af-bc2a-34685b18eda7 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:08.877154 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4016b9-f850-47af-bc2a-34685b18eda7 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:08.917991 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d2090-925f-48b6-9331-e09b5661de78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:08.919630 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d2090-925f-48b6-9331-e09b5661de78 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:08.920014 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d2090-925f-48b6-9331-e09b5661de78 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:08.920490 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d2090-925f-48b6-9331-e09b5661de78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:08.937875 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d2090-925f-48b6-9331-e09b5661de78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:08.939695 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d2090-925f-48b6-9331-e09b5661de78 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:08.961197 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-e31d2090-925f-48b6-9331-e09b5661de78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:39:08.961197 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:39:08.961197 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:39:08.961197 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:39:08.961197 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:39:08.961197 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:39:08.961197 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:39:08.961197 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:39:08.961197 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:39:08.961197 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:39:08.961197 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:39:08.961197 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:39:08.961197 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:39:08.961197 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:39:08.961197 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:39:08.962607 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:39:08.962607 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:39:08.962607 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:39:08.962607 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:39:08.962607 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:39:08.962607 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:39:08.962607 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:39:08.962607 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:39:08.962607 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:39:08.962607 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:39:08.962607 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:39:08.962607 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:39:08.962607 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:39:08.962607 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:39:08.962607 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:39:08.962607 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:39:08.962607 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:39:08.963842 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:39:08.963842 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:39:08.963842 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:39:08.963842 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:39:08.963842 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 631/1269] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:39:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:39:08.970349 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d32801-f220-419a-bb61-ea14551a546a None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:09.072585 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d32801-f220-419a-bb61-ea14551a546a None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:09.108192 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0053a5-1471-4c8a-bd70-92238081627b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:09.108828 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0053a5-1471-4c8a-bd70-92238081627b None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:09.109103 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0053a5-1471-4c8a-bd70-92238081627b None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:09.109369 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0053a5-1471-4c8a-bd70-92238081627b None admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:09.110112 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0053a5-1471-4c8a-bd70-92238081627b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:39:09.110407 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0053a5-1471-4c8a-bd70-92238081627b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:09.111789 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0053a5-1471-4c8a-bd70-92238081627b None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:09.123080 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 639/1270] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:39:09.131045 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d2090-925f-48b6-9331-e09b5661de78 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:09.167246 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:09.236822 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d2090-925f-48b6-9331-e09b5661de78 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:09.271767 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9487b-6d0b-431b-ba7f-93d843837e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:09.272548 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9487b-6d0b-431b-ba7f-93d843837e89 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:09.272828 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9487b-6d0b-431b-ba7f-93d843837e89 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:09.273100 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9487b-6d0b-431b-ba7f-93d843837e89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:09.280351 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9487b-6d0b-431b-ba7f-93d843837e89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:09.281814 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9487b-6d0b-431b-ba7f-93d843837e89 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:09.296569 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-63e9487b-6d0b-431b-ba7f-93d843837e89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:39:09.296569 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:39:09.296569 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:39:09.296569 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:39:09.296569 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:39:09.296569 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:39:09.296569 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:39:09.296569 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:39:09.296569 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:39:09.296569 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:39:09.296569 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:39:09.296569 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:39:09.296569 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:39:09.296569 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:39:09.296569 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:39:09.297559 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:39:09.297559 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:39:09.297559 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:39:09.297559 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:39:09.297559 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:39:09.297559 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:39:09.297559 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:39:09.297559 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:39:09.297559 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:39:09.297559 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:39:09.297559 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:39:09.297559 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:39:09.297559 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:39:09.297559 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:39:09.297559 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:39:09.297559 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:39:09.297559 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:39:09.298725 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:39:09.298725 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:39:09.298725 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:39:09.298725 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:39:09.298725 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:39:09.298725 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:39:09.298725 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:39:09.298725 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:39:09.298725 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 632/1271] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:39:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 05 20:39:09.303779 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0053a5-1471-4c8a-bd70-92238081627b None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:09.372889 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:09.418235 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0053a5-1471-4c8a-bd70-92238081627b None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:09.453405 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b002a62-504e-4521-92c8-20d57e67d555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:09.454119 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b002a62-504e-4521-92c8-20d57e67d555 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:09.454395 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b002a62-504e-4521-92c8-20d57e67d555 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:09.454665 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b002a62-504e-4521-92c8-20d57e67d555 None admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:09.455439 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b002a62-504e-4521-92c8-20d57e67d555 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:39:09.455744 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b002a62-504e-4521-92c8-20d57e67d555 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:09.457172 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b002a62-504e-4521-92c8-20d57e67d555 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:09.470269 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 640/1272] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 5 20:39:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:39:09.479433 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9487b-6d0b-431b-ba7f-93d843837e89 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:09.590168 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:09.600297 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9487b-6d0b-431b-ba7f-93d843837e89 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:09.635851 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0bf75-92ed-47d7-b557-9921d98b0e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:09.636728 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0bf75-92ed-47d7-b557-9921d98b0e59 None admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:09.637005 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0bf75-92ed-47d7-b557-9921d98b0e59 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:09.637281 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0bf75-92ed-47d7-b557-9921d98b0e59 None admin] PATH_INFO: `/v3/projects/b321588ec1f14bcb94a184310cf72856/users/16662dd5e2e74163b6aa2e1e7ef07524/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:09.639374 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0bf75-92ed-47d7-b557-9921d98b0e59 None admin] RBAC: Authorizing `identity:create_grant(project_id=b321588ec1f14bcb94a184310cf72856, user_id=16662dd5e2e74163b6aa2e1e7ef07524, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:09.640845 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0bf75-92ed-47d7-b557-9921d98b0e59 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:09.657793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 633/1273] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 5 20:39:09 2022] PUT /identity/v3/projects/b321588ec1f14bcb94a184310cf72856/users/16662dd5e2e74163b6aa2e1e7ef07524/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:39:11.645098 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8eb535-9e7d-47d3-ac13-35cd55644d12 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:11.646039 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8eb535-9e7d-47d3-ac13-35cd55644d12 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:11.646039 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8eb535-9e7d-47d3-ac13-35cd55644d12 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:11.648273 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 641/1274] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:39:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:39:11.653587 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b58e07-15c9-49f8-9df9-3b5d84405f11 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:11.654055 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b58e07-15c9-49f8-9df9-3b5d84405f11 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:11.654160 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b58e07-15c9-49f8-9df9-3b5d84405f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:11.673172 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-c5b58e07-15c9-49f8-9df9-3b5d84405f11 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:39:11.674424 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-c5b58e07-15c9-49f8-9df9-3b5d84405f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:39:11.745217 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 634/1275] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:39:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:39:11.769081 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8eb535-9e7d-47d3-ac13-35cd55644d12 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:11.889336 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8eb535-9e7d-47d3-ac13-35cd55644d12 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:11.907299 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:11.927679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ce2cc-9b9c-46bd-befd-7fb01ac2b61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:11.928549 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ce2cc-9b9c-46bd-befd-7fb01ac2b61c None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:11.928833 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ce2cc-9b9c-46bd-befd-7fb01ac2b61c None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:11.929141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ce2cc-9b9c-46bd-befd-7fb01ac2b61c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:11.941742 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ce2cc-9b9c-46bd-befd-7fb01ac2b61c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 05 20:39:11.950434 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-6d9ce2cc-9b9c-46bd-befd-7fb01ac2b61c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:39:11.950434 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:39:11.950434 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:39:11.950434 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:39:11.950434 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:39:11.950434 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:39:11.950434 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:39:11.950434 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:39:11.950434 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:39:11.950434 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:39:11.950434 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:39:11.950434 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:39:11.950434 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 05 20:39:11.950434 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 05 20:39:11.950434 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 05 20:39:11.950434 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 05 20:39:11.951570 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 05 20:39:11.951570 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 05 20:39:11.951570 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 05 20:39:11.951570 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 05 20:39:11.951570 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:39:11.951570 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:39:11.951570 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:39:11.951570 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:39:11.951570 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:39:11.951570 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:39:11.951570 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:39:11.951570 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:39:11.951570 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:39:11.951570 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:39:11.951570 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:39:11.951570 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:39:11.952686 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:39:11.952686 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:39:11.952686 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:39:11.952686 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:39:11.952686 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 05 20:39:11.952686 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 05 20:39:11.952686 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 05 20:39:11.952686 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 05 20:39:11.952686 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 05 20:39:11.952686 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 05 20:39:11.952686 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 05 20:39:11.952686 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:39:11.952686 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 642/1276] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 5 20:39:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:39:11.957801 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b58e07-15c9-49f8-9df9-3b5d84405f11 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:12.038695 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:12.058208 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b58e07-15c9-49f8-9df9-3b5d84405f11 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:12.090168 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6372ab0-6c4a-4fde-b68f-70c7ab0e9122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:12.090833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6372ab0-6c4a-4fde-b68f-70c7ab0e9122 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:12.091110 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6372ab0-6c4a-4fde-b68f-70c7ab0e9122 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:12.091378 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6372ab0-6c4a-4fde-b68f-70c7ab0e9122 None admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:12.092118 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6372ab0-6c4a-4fde-b68f-70c7ab0e9122 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:39:12.092417 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6372ab0-6c4a-4fde-b68f-70c7ab0e9122 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:12.093784 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6372ab0-6c4a-4fde-b68f-70c7ab0e9122 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:12.101710 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 635/1277] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 5 20:39:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:39:12.107685 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ce2cc-9b9c-46bd-befd-7fb01ac2b61c None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:12.215369 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ce2cc-9b9c-46bd-befd-7fb01ac2b61c None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:12.248405 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf65ee-e0a2-4ac8-86d2-00f180df8ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:12.249171 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf65ee-e0a2-4ac8-86d2-00f180df8ebc None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:12.249448 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf65ee-e0a2-4ac8-86d2-00f180df8ebc None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:12.249675 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf65ee-e0a2-4ac8-86d2-00f180df8ebc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:12.259885 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaf65ee-e0a2-4ac8-86d2-00f180df8ebc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:12.261461 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaf65ee-e0a2-4ac8-86d2-00f180df8ebc None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:12.279312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-bfaf65ee-e0a2-4ac8-86d2-00f180df8ebc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:39:12.279312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:39:12.279312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:39:12.279312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:39:12.279312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:39:12.279312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:39:12.279312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:39:12.279312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:39:12.279312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:39:12.279312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:39:12.279312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:39:12.279312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:39:12.279312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:39:12.279312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:39:12.279312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:39:12.280381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:39:12.280381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:39:12.280381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:39:12.280381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:39:12.280381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:39:12.280381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:39:12.280381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:39:12.280381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:39:12.280381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:39:12.280381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:39:12.280381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:39:12.280381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:39:12.280381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:39:12.280381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:39:12.280381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:39:12.280381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:39:12.280381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:39:12.281608 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:39:12.281608 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:39:12.281608 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:39:12.281608 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:39:12.281608 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 643/1278] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:39:12.286525 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6372ab0-6c4a-4fde-b68f-70c7ab0e9122 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:12.393486 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6372ab0-6c4a-4fde-b68f-70c7ab0e9122 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:12.428854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b6f95-0d70-4aa3-98ea-635d8148cd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:12.429504 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b6f95-0d70-4aa3-98ea-635d8148cd31 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:12.429787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b6f95-0d70-4aa3-98ea-635d8148cd31 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:12.430095 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b6f95-0d70-4aa3-98ea-635d8148cd31 None admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:12.430826 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b6f95-0d70-4aa3-98ea-635d8148cd31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:39:12.431138 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b6f95-0d70-4aa3-98ea-635d8148cd31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:12.432522 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b6f95-0d70-4aa3-98ea-635d8148cd31 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:12.444465 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 636/1279] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:39:12.450079 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf65ee-e0a2-4ac8-86d2-00f180df8ebc None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:12.483477 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:12.555236 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf65ee-e0a2-4ac8-86d2-00f180df8ebc None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:12.590804 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ed5ef-7df4-4562-9bcb-20dd27d1456d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:12.591580 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ed5ef-7df4-4562-9bcb-20dd27d1456d None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:12.591866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ed5ef-7df4-4562-9bcb-20dd27d1456d None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:12.592139 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ed5ef-7df4-4562-9bcb-20dd27d1456d None admin] PATH_INFO: `/v3/users/placement` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:12.599901 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ed5ef-7df4-4562-9bcb-20dd27d1456d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:12.601351 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ed5ef-7df4-4562-9bcb-20dd27d1456d None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:12.615848 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-ba9ed5ef-7df4-4562-9bcb-20dd27d1456d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 05 20:39:12.615848 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:39:12.615848 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:39:12.615848 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:39:12.615848 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:39:12.615848 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:39:12.615848 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:39:12.615848 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:39:12.615848 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:39:12.615848 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:39:12.615848 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:39:12.615848 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:39:12.615848 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 05 20:39:12.615848 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 05 20:39:12.615848 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 05 20:39:12.615848 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 05 20:39:12.616830 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:39:12.616830 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:39:12.616830 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 05 20:39:12.616830 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:39:12.616830 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 05 20:39:12.616830 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 05 20:39:12.616830 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:39:12.616830 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:39:12.616830 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:39:12.616830 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:39:12.616830 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:39:12.616830 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:39:12.616830 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:39:12.616830 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:39:12.616830 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:39:12.616830 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:39:12.616830 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:39:12.616830 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:39:12.617805 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:39:12.617805 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:39:12.617805 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 05 20:39:12.617805 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 05 20:39:12.617805 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 05 20:39:12.617805 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 05 20:39:12.617805 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 05 20:39:12.617805 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 05 20:39:12.617805 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 05 20:39:12.617805 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:39:12.617805 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 644/1280] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:39:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:39:12.623154 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b6f95-0d70-4aa3-98ea-635d8148cd31 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:12.627287 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:12.736362 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b6f95-0d70-4aa3-98ea-635d8148cd31 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:12.771291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73bca2-4738-4387-a682-e951fb36f867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:12.771950 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73bca2-4738-4387-a682-e951fb36f867 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:12.772225 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73bca2-4738-4387-a682-e951fb36f867 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:12.772494 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73bca2-4738-4387-a682-e951fb36f867 None admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:12.773320 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73bca2-4738-4387-a682-e951fb36f867 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:39:12.773629 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73bca2-4738-4387-a682-e951fb36f867 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:12.775090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73bca2-4738-4387-a682-e951fb36f867 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:12.792077 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 637/1281] 10.222.0.27 () {56 vars in 1143 bytes} [Tue Jul 5 20:39:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:39:12.798631 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ed5ef-7df4-4562-9bcb-20dd27d1456d None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:12.902987 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:12.913529 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ed5ef-7df4-4562-9bcb-20dd27d1456d None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:12.951279 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837a3c0-3520-4679-a926-e3c0acea6627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:12.951917 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837a3c0-3520-4679-a926-e3c0acea6627 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:12.952194 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837a3c0-3520-4679-a926-e3c0acea6627 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:12.952461 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837a3c0-3520-4679-a926-e3c0acea6627 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:13.020268 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837a3c0-3520-4679-a926-e3c0acea6627 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:13.021643 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837a3c0-3520-4679-a926-e3c0acea6627 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:13.111108 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:13.122357 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 645/1282] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 5 20:39:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 05 20:39:13.128505 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73bca2-4738-4387-a682-e951fb36f867 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:13.192944 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:13.234588 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73bca2-4738-4387-a682-e951fb36f867 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:13.269295 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08bcc2-2ddd-4201-8cbe-7e4cb1cabce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:13.270237 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08bcc2-2ddd-4201-8cbe-7e4cb1cabce8 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:13.270596 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08bcc2-2ddd-4201-8cbe-7e4cb1cabce8 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:13.270849 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08bcc2-2ddd-4201-8cbe-7e4cb1cabce8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:13.281603 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08bcc2-2ddd-4201-8cbe-7e4cb1cabce8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:13.283116 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08bcc2-2ddd-4201-8cbe-7e4cb1cabce8 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:13.304502 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-3c08bcc2-2ddd-4201-8cbe-7e4cb1cabce8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:39:13.304502 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:39:13.304502 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:39:13.304502 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:39:13.304502 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:39:13.304502 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:39:13.304502 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:39:13.304502 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:39:13.304502 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:39:13.304502 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:39:13.304502 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:39:13.304502 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:39:13.304502 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 05 20:39:13.304502 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 05 20:39:13.304502 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 05 20:39:13.305656 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 05 20:39:13.305656 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:39:13.305656 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:39:13.305656 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:39:13.305656 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:39:13.305656 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:39:13.305656 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:39:13.305656 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:39:13.305656 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:39:13.305656 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:39:13.305656 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:39:13.305656 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:39:13.305656 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:39:13.305656 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:39:13.305656 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:39:13.305656 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:39:13.305656 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:39:13.306818 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 05 20:39:13.306818 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 05 20:39:13.306818 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 05 20:39:13.306818 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:39:13.306818 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 638/1283] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:39:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:39:13.313401 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837a3c0-3520-4679-a926-e3c0acea6627 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:13.433454 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837a3c0-3520-4679-a926-e3c0acea6627 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:13.469202 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba7936-e9a9-4921-818c-90a473a9dfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:13.469875 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba7936-e9a9-4921-818c-90a473a9dfbb None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:13.470160 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba7936-e9a9-4921-818c-90a473a9dfbb None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:13.470433 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba7936-e9a9-4921-818c-90a473a9dfbb None admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:13.471155 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba7936-e9a9-4921-818c-90a473a9dfbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:39:13.471456 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba7936-e9a9-4921-818c-90a473a9dfbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:13.472852 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba7936-e9a9-4921-818c-90a473a9dfbb None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:13.484643 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 646/1284] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 5 20:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:39:13.493353 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08bcc2-2ddd-4201-8cbe-7e4cb1cabce8 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:13.600542 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08bcc2-2ddd-4201-8cbe-7e4cb1cabce8 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:13.615120 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:13.636680 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304d180-f33f-4b3b-8460-3f5d0ddcd8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:13.637462 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304d180-f33f-4b3b-8460-3f5d0ddcd8ec None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:13.637744 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304d180-f33f-4b3b-8460-3f5d0ddcd8ec None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:13.638052 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304d180-f33f-4b3b-8460-3f5d0ddcd8ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:13.645028 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7304d180-f33f-4b3b-8460-3f5d0ddcd8ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:13.646522 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7304d180-f33f-4b3b-8460-3f5d0ddcd8ec None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:13.660491 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application [None req-7304d180-f33f-4b3b-8460-3f5d0ddcd8ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:39:13.660491 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:39:13.660491 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:39:13.660491 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:39:13.660491 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:39:13.660491 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:39:13.660491 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:39:13.660491 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:39:13.660491 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:39:13.660491 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:39:13.660491 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:39:13.660491 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:39:13.660491 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 05 20:39:13.660491 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 05 20:39:13.660491 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 05 20:39:13.661523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 05 20:39:13.661523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:39:13.661523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:39:13.661523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:39:13.661523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:39:13.661523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:39:13.661523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:39:13.661523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:39:13.661523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application with Lock( Jul 05 20:39:13.661523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:39:13.661523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:39:13.661523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:39:13.661523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:39:13.661523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:39:13.661523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:39:13.661523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:39:13.661523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:39:13.662489 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 05 20:39:13.662489 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 05 20:39:13.662489 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 05 20:39:13.662489 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 05 20:39:13.662489 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 05 20:39:13.662489 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 05 20:39:13.662489 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 05 20:39:13.662489 dv-cinder-797608-49-smb devstack@keystone.service[87151]: ERROR keystone.server.flask.application Jul 05 20:39:13.662489 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 639/1285] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 5 20:39:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:39:13.667769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba7936-e9a9-4921-818c-90a473a9dfbb None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:13.720757 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:13.772065 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba7936-e9a9-4921-818c-90a473a9dfbb None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:13.807307 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc0142-672b-463e-bd7e-2655e7a95ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:13.807989 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc0142-672b-463e-bd7e-2655e7a95ed9 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:13.808267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc0142-672b-463e-bd7e-2655e7a95ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:13.808537 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc0142-672b-463e-bd7e-2655e7a95ed9 None admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:13.809327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc0142-672b-463e-bd7e-2655e7a95ed9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:39:13.809638 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc0142-672b-463e-bd7e-2655e7a95ed9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:13.811127 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc0142-672b-463e-bd7e-2655e7a95ed9 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:13.824340 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 647/1286] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 5 20:39:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:39:13.830637 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304d180-f33f-4b3b-8460-3f5d0ddcd8ec None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:13.966585 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304d180-f33f-4b3b-8460-3f5d0ddcd8ec None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:14.000220 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cafa9-79ea-4481-bd1e-86495be1967f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:14.000863 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cafa9-79ea-4481-bd1e-86495be1967f None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:14.001146 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cafa9-79ea-4481-bd1e-86495be1967f None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:14.001419 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cafa9-79ea-4481-bd1e-86495be1967f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:14.002277 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926cafa9-79ea-4481-bd1e-86495be1967f None admin] RBAC: Adding query filter params (role.id=37ba4a62052348d4811b560c19a07e02, scope.project.id=b321588ec1f14bcb94a184310cf72856, user.id=16662dd5e2e74163b6aa2e1e7ef07524) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:39:14.002589 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926cafa9-79ea-4481-bd1e-86495be1967f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:14.004038 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926cafa9-79ea-4481-bd1e-86495be1967f None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:14.010062 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 640/1287] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 5 20:39:13 2022] GET /identity/v3/role_assignments?user.id=16662dd5e2e74163b6aa2e1e7ef07524&scope.project.id=b321588ec1f14bcb94a184310cf72856&role.id=37ba4a62052348d4811b560c19a07e02 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:39:16.022490 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4b333-d986-4fe2-a9cf-ca97d5264ef9 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:16.023158 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4b333-d986-4fe2-a9cf-ca97d5264ef9 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:16.023158 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4b333-d986-4fe2-a9cf-ca97d5264ef9 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:16.025110 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 648/1288] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:39:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:39:16.034317 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a82ea-38fe-4681-8b2d-32b7184a93f1 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:16.034755 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a82ea-38fe-4681-8b2d-32b7184a93f1 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:16.034900 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a82ea-38fe-4681-8b2d-32b7184a93f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:16.056936 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-b58a82ea-38fe-4681-8b2d-32b7184a93f1 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:39:16.058183 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-b58a82ea-38fe-4681-8b2d-32b7184a93f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:39:16.091908 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:16.134073 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 641/1289] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:39:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:39:16.156332 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d4b333-d986-4fe2-a9cf-ca97d5264ef9 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:16.268137 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d4b333-d986-4fe2-a9cf-ca97d5264ef9 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:16.279065 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:16.316157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c57fe-7944-4c0a-afd8-7bee5de287bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:16.316949 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c57fe-7944-4c0a-afd8-7bee5de287bd None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:16.317228 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c57fe-7944-4c0a-afd8-7bee5de287bd None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:16.317476 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c57fe-7944-4c0a-afd8-7bee5de287bd None admin] PATH_INFO: `/v3/services/placement` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:16.318185 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c57fe-7944-4c0a-afd8-7bee5de287bd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:16.319561 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c57fe-7944-4c0a-afd8-7bee5de287bd None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:16.332006 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-0c8c57fe-7944-4c0a-afd8-7bee5de287bd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 20:39:16.332006 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:39:16.332006 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:39:16.332006 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:39:16.332006 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:39:16.332006 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:39:16.332006 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:39:16.332006 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:39:16.332006 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 20:39:16.332006 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:39:16.332006 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:39:16.332006 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:39:16.332006 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:39:16.332006 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:39:16.332006 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:39:16.332006 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:39:16.332006 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:39:16.333120 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:39:16.333120 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:39:16.333120 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:39:16.333120 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:39:16.333120 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:39:16.333120 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:39:16.333120 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:39:16.333120 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:39:16.333120 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:39:16.333120 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:39:16.333120 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:39:16.333120 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:39:16.333120 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:39:16.333120 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:39:16.333120 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:39:16.333120 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:39:16.334154 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:39:16.334154 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:39:16.334154 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:39:16.334154 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:39:16.334154 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:39:16.334154 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:39:16.334154 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:39:16.334154 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:39:16.334154 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:39:16.334154 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:39:16.334154 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:39:16.334154 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:39:16.334154 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 20:39:16.334154 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:39:16.334154 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 649/1290] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Jul 5 20:39:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:39:16.340172 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a82ea-38fe-4681-8b2d-32b7184a93f1 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:16.447218 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a82ea-38fe-4681-8b2d-32b7184a93f1 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:16.482522 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23039b-c507-43b3-b0b2-f301b6d99326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:16.483172 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23039b-c507-43b3-b0b2-f301b6d99326 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:16.483496 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23039b-c507-43b3-b0b2-f301b6d99326 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:16.483785 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23039b-c507-43b3-b0b2-f301b6d99326 None admin] PATH_INFO: `/v3/services` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:16.484526 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23039b-c507-43b3-b0b2-f301b6d99326 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:39:16.484828 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23039b-c507-43b3-b0b2-f301b6d99326 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:16.486232 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23039b-c507-43b3-b0b2-f301b6d99326 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:16.491209 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 642/1291] 10.222.0.27 () {56 vars in 1116 bytes} [Tue Jul 5 20:39:16 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:39:16.497894 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c57fe-7944-4c0a-afd8-7bee5de287bd None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:16.609465 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c57fe-7944-4c0a-afd8-7bee5de287bd None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:16.653740 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c7440-a00e-4e65-9478-67a22fc1625d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:16.655209 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c7440-a00e-4e65-9478-67a22fc1625d None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:16.655987 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c7440-a00e-4e65-9478-67a22fc1625d None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:16.656764 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c7440-a00e-4e65-9478-67a22fc1625d None admin] PATH_INFO: `/v3/services` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:16.658542 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c7440-a00e-4e65-9478-67a22fc1625d None admin] RBAC: Adding query filter params (type=placement) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:39:16.659470 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c7440-a00e-4e65-9478-67a22fc1625d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:16.662660 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c7440-a00e-4e65-9478-67a22fc1625d None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:16.670203 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 650/1292] 10.222.0.27 () {56 vars in 1116 bytes} [Tue Jul 5 20:39:16 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:39:18.643805 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7dc91-51fd-4d91-8bcf-2e43f6cdc90d None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:18.644668 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7dc91-51fd-4d91-8bcf-2e43f6cdc90d None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:18.644668 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7dc91-51fd-4d91-8bcf-2e43f6cdc90d None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:18.646941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 643/1293] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:39:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:39:18.653399 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c854d1-c277-4d4e-ae06-f0e2f70117d1 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:18.653894 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c854d1-c277-4d4e-ae06-f0e2f70117d1 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:18.654000 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c854d1-c277-4d4e-ae06-f0e2f70117d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:18.675984 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-d2c854d1-c277-4d4e-ae06-f0e2f70117d1 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:39:18.677156 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-d2c854d1-c277-4d4e-ae06-f0e2f70117d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:39:18.708438 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:18.749953 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 651/1294] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:39:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:39:18.773505 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7dc91-51fd-4d91-8bcf-2e43f6cdc90d None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:18.818358 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:18.897899 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7dc91-51fd-4d91-8bcf-2e43f6cdc90d None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:18.935171 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667ac24-a17d-4d51-b6ad-2d1d01eed6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:18.935834 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667ac24-a17d-4d51-b6ad-2d1d01eed6f1 None admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:18.936112 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667ac24-a17d-4d51-b6ad-2d1d01eed6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:18.936394 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667ac24-a17d-4d51-b6ad-2d1d01eed6f1 None admin] PATH_INFO: `/v3/services` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:18.937150 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667ac24-a17d-4d51-b6ad-2d1d01eed6f1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:18.938597 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1667ac24-a17d-4d51-b6ad-2d1d01eed6f1 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:18.955294 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 644/1295] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Jul 5 20:39:18 2022] POST /identity/v3/services => generated 246 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:39:20.934349 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba17374-fb91-48dc-a0f9-f854ffb63c6b None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:20.934934 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba17374-fb91-48dc-a0f9-f854ffb63c6b None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:20.934934 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba17374-fb91-48dc-a0f9-f854ffb63c6b None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:20.936257 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 652/1296] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:39:20.942628 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1f9f8-e910-4129-a4b5-d582208e1cc0 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:20.943089 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1f9f8-e910-4129-a4b5-d582208e1cc0 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:20.943189 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1f9f8-e910-4129-a4b5-d582208e1cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:20.963615 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-f7a1f9f8-e910-4129-a4b5-d582208e1cc0 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:39:20.964811 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-f7a1f9f8-e910-4129-a4b5-d582208e1cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:39:21.052482 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 645/1297] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:39:20 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:39:21.076055 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba17374-fb91-48dc-a0f9-f854ffb63c6b None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:21.201556 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba17374-fb91-48dc-a0f9-f854ffb63c6b None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:21.238306 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54bee6-53c4-4ffd-a055-6df67b17c9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:21.239567 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54bee6-53c4-4ffd-a055-6df67b17c9ae None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:21.240071 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54bee6-53c4-4ffd-a055-6df67b17c9ae None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:21.240862 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54bee6-53c4-4ffd-a055-6df67b17c9ae None admin] PATH_INFO: `/v3/services/placement` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:21.242903 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c54bee6-53c4-4ffd-a055-6df67b17c9ae None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:21.246589 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c54bee6-53c4-4ffd-a055-6df67b17c9ae None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:21.264777 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-1c54bee6-53c4-4ffd-a055-6df67b17c9ae None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 20:39:21.264777 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:39:21.264777 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:39:21.264777 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:39:21.264777 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:39:21.264777 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:39:21.264777 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:39:21.264777 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:39:21.264777 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 20:39:21.264777 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:39:21.264777 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:39:21.264777 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:39:21.264777 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:39:21.264777 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:39:21.264777 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:39:21.264777 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:39:21.264777 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:39:21.265875 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:39:21.265875 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:39:21.265875 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:39:21.265875 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:39:21.265875 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:39:21.265875 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:39:21.265875 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:39:21.265875 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:39:21.265875 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:39:21.265875 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:39:21.265875 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:39:21.265875 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:39:21.265875 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:39:21.265875 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:39:21.265875 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:39:21.265875 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:39:21.266866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:39:21.266866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:39:21.266866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:39:21.266866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:39:21.266866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:39:21.266866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:39:21.266866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:39:21.266866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:39:21.266866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:39:21.266866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:39:21.266866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:39:21.266866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:39:21.266866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 20:39:21.266866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:39:21.266866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 653/1298] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Jul 5 20:39:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:39:21.273231 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1f9f8-e910-4129-a4b5-d582208e1cc0 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:21.298309 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:21.382674 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1f9f8-e910-4129-a4b5-d582208e1cc0 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:21.418347 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc622559-6c96-443f-914b-e728d14923c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:21.419367 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc622559-6c96-443f-914b-e728d14923c1 None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:21.419644 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc622559-6c96-443f-914b-e728d14923c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:21.419919 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc622559-6c96-443f-914b-e728d14923c1 None admin] PATH_INFO: `/v3/services` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:21.420632 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc622559-6c96-443f-914b-e728d14923c1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:39:21.420938 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc622559-6c96-443f-914b-e728d14923c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:21.422350 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc622559-6c96-443f-914b-e728d14923c1 None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:21.427656 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 646/1299] 10.222.0.27 () {56 vars in 1116 bytes} [Tue Jul 5 20:39:21 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:39:21.435731 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54bee6-53c4-4ffd-a055-6df67b17c9ae None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:21.468418 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:21.536147 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54bee6-53c4-4ffd-a055-6df67b17c9ae None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:21.571920 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c03588-ee46-4f09-8c8c-2b3650fbcde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:21.572555 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c03588-ee46-4f09-8c8c-2b3650fbcde1 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:21.572844 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c03588-ee46-4f09-8c8c-2b3650fbcde1 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:21.573134 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c03588-ee46-4f09-8c8c-2b3650fbcde1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:21.573951 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c03588-ee46-4f09-8c8c-2b3650fbcde1 None admin] RBAC: Adding query filter params (interface=public, service_id=74e3bbfe3eac40f1a56cb9b4350ae550, region_id=RegionOne) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:39:21.574247 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c03588-ee46-4f09-8c8c-2b3650fbcde1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:21.575624 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c03588-ee46-4f09-8c8c-2b3650fbcde1 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:21.580900 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 654/1300] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Jul 5 20:39:21 2022] GET /identity/v3/endpoints?service_id=74e3bbfe3eac40f1a56cb9b4350ae550&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:39:21.589353 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc622559-6c96-443f-914b-e728d14923c1 None admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:21.675465 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:21.697880 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc622559-6c96-443f-914b-e728d14923c1 None admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:21.732035 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e70a9d-eb96-499c-935b-5aec4f0d535b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:21.732634 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e70a9d-eb96-499c-935b-5aec4f0d535b None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:21.732921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e70a9d-eb96-499c-935b-5aec4f0d535b None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:21.733194 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e70a9d-eb96-499c-935b-5aec4f0d535b None admin] PATH_INFO: `/v3/services` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:21.733888 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e70a9d-eb96-499c-935b-5aec4f0d535b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:21.735312 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e70a9d-eb96-499c-935b-5aec4f0d535b None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:21.742294 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 647/1301] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Jul 5 20:39:21 2022] GET /identity/v3/services => generated 2191 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:39:23.733151 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d42841-66ea-4372-8f55-e1cbddf7b03e None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:23.733717 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d42841-66ea-4372-8f55-e1cbddf7b03e None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:23.733717 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d42841-66ea-4372-8f55-e1cbddf7b03e None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:23.735111 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 655/1302] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:39:23.741354 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b7645-1b87-4161-9427-9dd74db92389 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:23.742101 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b7645-1b87-4161-9427-9dd74db92389 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:23.742261 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b7645-1b87-4161-9427-9dd74db92389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:23.762223 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-772b7645-1b87-4161-9427-9dd74db92389 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:39:23.763449 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-772b7645-1b87-4161-9427-9dd74db92389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:39:23.834601 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 648/1303] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:39:23 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 05 20:39:23.857395 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d42841-66ea-4372-8f55-e1cbddf7b03e None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:23.978062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:23.987211 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d42841-66ea-4372-8f55-e1cbddf7b03e None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:24.027657 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42b42c-9a55-4738-8fab-2c74c24e0e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:24.028502 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42b42c-9a55-4738-8fab-2c74c24e0e71 None admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:24.028781 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42b42c-9a55-4738-8fab-2c74c24e0e71 None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:24.029051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42b42c-9a55-4738-8fab-2c74c24e0e71 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:24.029703 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f42b42c-9a55-4738-8fab-2c74c24e0e71 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:24.031123 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f42b42c-9a55-4738-8fab-2c74c24e0e71 None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:24.043278 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application [None req-4f42b42c-9a55-4738-8fab-2c74c24e0e71 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 20:39:24.043278 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:39:24.043278 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 05 20:39:24.043278 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 05 20:39:24.043278 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 05 20:39:24.043278 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 05 20:39:24.043278 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 05 20:39:24.043278 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:39:24.043278 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 20:39:24.043278 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:39:24.043278 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 05 20:39:24.043278 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:39:24.043278 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 05 20:39:24.043278 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 05 20:39:24.043278 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 05 20:39:24.043278 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 05 20:39:24.043278 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 05 20:39:24.044769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 05 20:39:24.044769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 05 20:39:24.044769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 05 20:39:24.044769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 05 20:39:24.044769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 05 20:39:24.044769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 05 20:39:24.044769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 05 20:39:24.044769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 05 20:39:24.044769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 05 20:39:24.044769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 05 20:39:24.044769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 05 20:39:24.044769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 05 20:39:24.044769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 05 20:39:24.044769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 05 20:39:24.044769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 05 20:39:24.044769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.get_or_create( Jul 05 20:39:24.045615 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 05 20:39:24.045615 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application with Lock( Jul 05 20:39:24.045615 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 05 20:39:24.045615 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self._enter() Jul 05 20:39:24.045615 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 05 20:39:24.045615 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 05 20:39:24.045615 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 05 20:39:24.045615 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application return self.creator() Jul 05 20:39:24.045615 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 05 20:39:24.045615 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application created_value = creator( Jul 05 20:39:24.045615 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 05 20:39:24.045615 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 05 20:39:24.045615 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 05 20:39:24.045615 dv-cinder-797608-49-smb devstack@keystone.service[87152]: ERROR keystone.server.flask.application Jul 05 20:39:24.045615 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 656/1304] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Jul 5 20:39:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 05 20:39:24.051816 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b7645-1b87-4161-9427-9dd74db92389 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:24.140184 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:24.172896 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b7645-1b87-4161-9427-9dd74db92389 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:24.209799 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea476f9a-2324-46ef-ac74-bfd5d291137d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:24.210875 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea476f9a-2324-46ef-ac74-bfd5d291137d None admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:24.211316 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea476f9a-2324-46ef-ac74-bfd5d291137d None admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:24.211742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea476f9a-2324-46ef-ac74-bfd5d291137d None admin] PATH_INFO: `/v3/services` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:24.212898 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea476f9a-2324-46ef-ac74-bfd5d291137d None admin] RBAC: Adding query filter params (name=placement) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:39:24.213368 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea476f9a-2324-46ef-ac74-bfd5d291137d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:24.215671 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea476f9a-2324-46ef-ac74-bfd5d291137d None admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:24.224643 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 649/1305] 10.222.0.27 () {56 vars in 1116 bytes} [Tue Jul 5 20:39:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:39:24.230696 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42b42c-9a55-4738-8fab-2c74c24e0e71 None admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:39:24.348769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42b42c-9a55-4738-8fab-2c74c24e0e71 None admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:39:24.383910 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59edb93-0616-4d57-9095-7de1f0d500df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:39:24.384553 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59edb93-0616-4d57-9095-7de1f0d500df None admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:39:24.384831 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59edb93-0616-4d57-9095-7de1f0d500df None admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:39:24.385104 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59edb93-0616-4d57-9095-7de1f0d500df None admin] PATH_INFO: `/v3/endpoints` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:39:24.385835 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59edb93-0616-4d57-9095-7de1f0d500df None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:39:24.387238 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59edb93-0616-4d57-9095-7de1f0d500df None admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:39:24.409010 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 657/1306] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Jul 5 20:39:24 2022] POST /identity/v3/endpoints => generated 331 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:39:34.218906 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=30 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:39:34.405081 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:26.991439 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f97e32-c20f-45eb-ada2-fbeef316e33c None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:26.992001 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f97e32-c20f-45eb-ada2-fbeef316e33c None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:26.992001 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f97e32-c20f-45eb-ada2-fbeef316e33c None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:26.993657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 650/1307] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:40:26.998784 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da556954-c9c3-47e7-bd1c-b9e88134f1cb None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:26.999254 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da556954-c9c3-47e7-bd1c-b9e88134f1cb None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:26.999337 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da556954-c9c3-47e7-bd1c-b9e88134f1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:27.172767 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-da556954-c9c3-47e7-bd1c-b9e88134f1cb None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:40:27.174035 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-da556954-c9c3-47e7-bd1c-b9e88134f1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:27.396043 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 658/1308] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:40:27.461492 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979e6ea-8d5a-4c39-8281-177c3abe7730 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:27.461890 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979e6ea-8d5a-4c39-8281-177c3abe7730 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:27.462137 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979e6ea-8d5a-4c39-8281-177c3abe7730 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:27.463888 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 651/1309] 10.222.0.27 () {54 vars in 964 bytes} [Tue Jul 5 20:40:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:40:27.478187 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddb895-42c4-4850-8ea0-f91f7b55c8fb None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:27.478578 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddb895-42c4-4850-8ea0-f91f7b55c8fb None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:27.478751 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddb895-42c4-4850-8ea0-f91f7b55c8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:27.567721 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-e2ddb895-42c4-4850-8ea0-f91f7b55c8fb None None] MFA Rules not processed for user `157a258bcff642cb91a0a474f8f50941`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:40:27.569800 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-e2ddb895-42c4-4850-8ea0-f91f7b55c8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:27.594063 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:27.653680 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 659/1310] 10.222.0.27 () {58 vars in 1061 bytes} [Tue Jul 5 20:40:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:40:27.663042 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979e6ea-8d5a-4c39-8281-177c3abe7730 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:27.665577 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-a979e6ea-8d5a-4c39-8281-177c3abe7730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:27.813612 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979e6ea-8d5a-4c39-8281-177c3abe7730 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:27.901226 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e0bbf-aa2e-4011-9bcd-6c99767dd378 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:27.901964 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e0bbf-aa2e-4011-9bcd-6c99767dd378 service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:27.902198 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e0bbf-aa2e-4011-9bcd-6c99767dd378 service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:27.902598 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e0bbf-aa2e-4011-9bcd-6c99767dd378 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:27.904282 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-6c3e0bbf-aa2e-4011-9bcd-6c99767dd378 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:27.969594 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:28.034450 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e0bbf-aa2e-4011-9bcd-6c99767dd378 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:28.036016 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e0bbf-aa2e-4011-9bcd-6c99767dd378 service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:28.059460 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 652/1311] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:40:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:40:30.413545 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f58006-b8a6-4341-a5b3-6c7174116ba6 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:30.414133 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f58006-b8a6-4341-a5b3-6c7174116ba6 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:30.414133 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f58006-b8a6-4341-a5b3-6c7174116ba6 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:30.415781 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 660/1312] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:40:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:40:30.421108 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b45bc6-40f0-46f9-9dcb-fbb8e18a986c None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:30.421533 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b45bc6-40f0-46f9-9dcb-fbb8e18a986c None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:30.421640 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b45bc6-40f0-46f9-9dcb-fbb8e18a986c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:30.497588 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-21b45bc6-40f0-46f9-9dcb-fbb8e18a986c None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:40:30.498841 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-21b45bc6-40f0-46f9-9dcb-fbb8e18a986c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:30.600929 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 653/1313] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:40:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:40:30.639821 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f58006-b8a6-4341-a5b3-6c7174116ba6 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:30.641409 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-c2f58006-b8a6-4341-a5b3-6c7174116ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:30.758012 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f58006-b8a6-4341-a5b3-6c7174116ba6 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:30.831264 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:30.834179 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126d51e-2979-4c53-9260-cb02d9de5be9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:30.834894 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126d51e-2979-4c53-9260-cb02d9de5be9 service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:30.835196 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126d51e-2979-4c53-9260-cb02d9de5be9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:30.835497 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126d51e-2979-4c53-9260-cb02d9de5be9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:30.838057 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-6126d51e-2979-4c53-9260-cb02d9de5be9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:30.953114 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6126d51e-2979-4c53-9260-cb02d9de5be9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:30.954607 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6126d51e-2979-4c53-9260-cb02d9de5be9 service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:30.974298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 661/1314] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:40:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:40:33.311436 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11f6bd-189a-4122-a5b1-53d0243f7f90 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:33.311970 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11f6bd-189a-4122-a5b1-53d0243f7f90 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:33.311970 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e11f6bd-189a-4122-a5b1-53d0243f7f90 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:33.313284 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 654/1315] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:40:33.318790 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066e52e-7ac7-4c2a-a98b-5d7bcbecdbf9 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:33.319206 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066e52e-7ac7-4c2a-a98b-5d7bcbecdbf9 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:33.319318 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a066e52e-7ac7-4c2a-a98b-5d7bcbecdbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:33.394579 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-a066e52e-7ac7-4c2a-a98b-5d7bcbecdbf9 None None] MFA Rules not processed for user `0c42d09008734d94bf2a1073bbdfb052`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:40:33.395794 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-a066e52e-7ac7-4c2a-a98b-5d7bcbecdbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:33.453813 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:33.504676 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 662/1316] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:40:33 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:40:33.544340 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11f6bd-189a-4122-a5b1-53d0243f7f90 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:33.545963 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-4e11f6bd-189a-4122-a5b1-53d0243f7f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:33.556622 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:33.656935 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e11f6bd-189a-4122-a5b1-53d0243f7f90 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:33.733821 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933124d1-d8d2-4478-b4e0-bc34faa98fb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:33.734507 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933124d1-d8d2-4478-b4e0-bc34faa98fb8 service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:33.734782 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933124d1-d8d2-4478-b4e0-bc34faa98fb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:33.735054 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933124d1-d8d2-4478-b4e0-bc34faa98fb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:33.736689 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-933124d1-d8d2-4478-b4e0-bc34faa98fb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:33.802964 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:33.858380 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933124d1-d8d2-4478-b4e0-bc34faa98fb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:33.859828 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933124d1-d8d2-4478-b4e0-bc34faa98fb8 service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:33.878840 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 655/1317] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:40:33 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:40:36.445509 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408118e0-fc52-4bf1-b3e1-30c63ce9917e None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:36.446123 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408118e0-fc52-4bf1-b3e1-30c63ce9917e None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:36.446123 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408118e0-fc52-4bf1-b3e1-30c63ce9917e None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:36.447465 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 663/1318] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:40:36.452936 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45476e55-5d05-467b-9a11-6bfc14bd1682 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:36.453370 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45476e55-5d05-467b-9a11-6bfc14bd1682 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:36.453487 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45476e55-5d05-467b-9a11-6bfc14bd1682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:36.520943 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-45476e55-5d05-467b-9a11-6bfc14bd1682 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:40:36.522204 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-45476e55-5d05-467b-9a11-6bfc14bd1682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:36.627450 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 656/1319] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:40:36 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:40:36.674635 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408118e0-fc52-4bf1-b3e1-30c63ce9917e None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:36.676169 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-408118e0-fc52-4bf1-b3e1-30c63ce9917e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:36.791811 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408118e0-fc52-4bf1-b3e1-30c63ce9917e None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:36.877252 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49839ce9-a275-4783-a97e-352e64c0328f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:36.878200 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49839ce9-a275-4783-a97e-352e64c0328f service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:36.878545 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49839ce9-a275-4783-a97e-352e64c0328f service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:36.878932 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49839ce9-a275-4783-a97e-352e64c0328f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:36.881465 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-49839ce9-a275-4783-a97e-352e64c0328f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:36.889533 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:36.999407 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49839ce9-a275-4783-a97e-352e64c0328f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:37.000858 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49839ce9-a275-4783-a97e-352e64c0328f service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:37.019396 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 664/1320] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:40:36 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:40:39.746233 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d5045-429b-4c5e-a01c-306f5283aaf8 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:39.746799 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d5045-429b-4c5e-a01c-306f5283aaf8 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:39.746799 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d5045-429b-4c5e-a01c-306f5283aaf8 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:39.748168 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 657/1321] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:40:39.753687 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502d2ca-c2c5-422e-90d7-4b2e4c3c28dd None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:39.754103 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502d2ca-c2c5-422e-90d7-4b2e4c3c28dd None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:39.754274 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502d2ca-c2c5-422e-90d7-4b2e4c3c28dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:39.822367 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-8502d2ca-c2c5-422e-90d7-4b2e4c3c28dd None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:40:39.823697 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-8502d2ca-c2c5-422e-90d7-4b2e4c3c28dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:39.897158 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:39.944428 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 665/1322] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:40:39.980722 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d5045-429b-4c5e-a01c-306f5283aaf8 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:39.982340 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-4b5d5045-429b-4c5e-a01c-306f5283aaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:40.003410 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:40.090694 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d5045-429b-4c5e-a01c-306f5283aaf8 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:40.169811 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7fba4-0520-448a-8498-e3f4a1cea404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:40.170497 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7fba4-0520-448a-8498-e3f4a1cea404 service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:40.170778 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7fba4-0520-448a-8498-e3f4a1cea404 service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:40.171050 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7fba4-0520-448a-8498-e3f4a1cea404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:40.172876 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-90b7fba4-0520-448a-8498-e3f4a1cea404 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:40.249258 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:40.287730 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7fba4-0520-448a-8498-e3f4a1cea404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:40.289184 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7fba4-0520-448a-8498-e3f4a1cea404 service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:40.308201 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 658/1323] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:40:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:40:42.351725 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea32fcd-8858-4910-95a5-61dfce9a6b4b None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:42.352303 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea32fcd-8858-4910-95a5-61dfce9a6b4b None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:42.352303 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea32fcd-8858-4910-95a5-61dfce9a6b4b None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:42.353675 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 666/1324] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:40:42.358979 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef9545-065d-4136-b98d-bfd482f76696 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:42.359408 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef9545-065d-4136-b98d-bfd482f76696 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:42.359565 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef9545-065d-4136-b98d-bfd482f76696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:42.426704 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-55ef9545-065d-4136-b98d-bfd482f76696 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:40:42.427918 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-55ef9545-065d-4136-b98d-bfd482f76696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:42.529935 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 659/1325] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:40:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:40:42.580173 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffce889-86e6-4d50-a54c-0f5fb97bf839 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:42.580433 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffce889-86e6-4d50-a54c-0f5fb97bf839 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:42.580739 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffce889-86e6-4d50-a54c-0f5fb97bf839 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:42.582188 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 667/1326] 10.222.0.27 () {54 vars in 964 bytes} [Tue Jul 5 20:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:40:42.588493 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641054c-9dc9-4371-9210-de6a9aa91fbd None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:42.588855 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641054c-9dc9-4371-9210-de6a9aa91fbd None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:42.589217 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641054c-9dc9-4371-9210-de6a9aa91fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:42.621658 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:42.670887 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-f641054c-9dc9-4371-9210-de6a9aa91fbd None None] MFA Rules not processed for user `157a258bcff642cb91a0a474f8f50941`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:40:42.672126 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-f641054c-9dc9-4371-9210-de6a9aa91fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:42.752212 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 660/1327] 10.222.0.27 () {58 vars in 1061 bytes} [Tue Jul 5 20:40:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:40:42.761521 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffce889-86e6-4d50-a54c-0f5fb97bf839 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:42.763140 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-4ffce889-86e6-4d50-a54c-0f5fb97bf839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:42.876926 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffce889-86e6-4d50-a54c-0f5fb97bf839 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:42.955212 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a7e71-3bf3-4040-9af2-92fdc35300a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:42.955864 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a7e71-3bf3-4040-9af2-92fdc35300a8 service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:42.956147 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a7e71-3bf3-4040-9af2-92fdc35300a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:42.956418 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a7e71-3bf3-4040-9af2-92fdc35300a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:42.958115 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-d81a7e71-3bf3-4040-9af2-92fdc35300a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:42.976224 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:43.075145 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a7e71-3bf3-4040-9af2-92fdc35300a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:43.076606 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a7e71-3bf3-4040-9af2-92fdc35300a8 service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:43.094797 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 668/1328] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:40:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:40:45.355182 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca8e81-9d96-4794-99b0-95941e80b0e5 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:45.355687 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca8e81-9d96-4794-99b0-95941e80b0e5 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:45.355687 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca8e81-9d96-4794-99b0-95941e80b0e5 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:45.357125 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 661/1329] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:40:45.362424 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985fd66-9935-400b-9822-56b766ba5473 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:45.362876 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985fd66-9935-400b-9822-56b766ba5473 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:45.362974 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985fd66-9935-400b-9822-56b766ba5473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:45.441003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-c985fd66-9935-400b-9822-56b766ba5473 None None] MFA Rules not processed for user `0c42d09008734d94bf2a1073bbdfb052`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:40:45.442412 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-c985fd66-9935-400b-9822-56b766ba5473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:45.515757 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:45.549027 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 669/1330] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:40:45 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:40:45.587357 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca8e81-9d96-4794-99b0-95941e80b0e5 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:45.588898 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-3bca8e81-9d96-4794-99b0-95941e80b0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:45.697251 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca8e81-9d96-4794-99b0-95941e80b0e5 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:45.717905 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:45.776177 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac02304-118c-48a9-b44c-0d4cb4ce439c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:45.776848 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac02304-118c-48a9-b44c-0d4cb4ce439c service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:45.777132 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac02304-118c-48a9-b44c-0d4cb4ce439c service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:45.777414 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac02304-118c-48a9-b44c-0d4cb4ce439c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:45.779124 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-1ac02304-118c-48a9-b44c-0d4cb4ce439c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:45.893765 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac02304-118c-48a9-b44c-0d4cb4ce439c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:45.895258 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac02304-118c-48a9-b44c-0d4cb4ce439c service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:45.917816 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 662/1331] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:40:45 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:40:48.179675 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399f3cf-7ca7-48e1-b527-a5340687ca28 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:48.180331 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399f3cf-7ca7-48e1-b527-a5340687ca28 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:48.180331 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399f3cf-7ca7-48e1-b527-a5340687ca28 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:48.182297 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 670/1332] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:40:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:40:48.190038 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82913e-e550-4df3-9c02-dc09d4a834c2 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:48.190520 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82913e-e550-4df3-9c02-dc09d4a834c2 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:48.190653 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82913e-e550-4df3-9c02-dc09d4a834c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:48.252981 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:48.256823 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-8a82913e-e550-4df3-9c02-dc09d4a834c2 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:40:48.258642 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-8a82913e-e550-4df3-9c02-dc09d4a834c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:48.364875 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 663/1333] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:40:48.401209 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399f3cf-7ca7-48e1-b527-a5340687ca28 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:48.402823 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-4399f3cf-7ca7-48e1-b527-a5340687ca28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:48.530820 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399f3cf-7ca7-48e1-b527-a5340687ca28 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:48.611825 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7cf800-a63e-47a1-b163-26712b68a4d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:48.612716 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cf800-a63e-47a1-b163-26712b68a4d3 service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:48.613086 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cf800-a63e-47a1-b163-26712b68a4d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:48.613438 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cf800-a63e-47a1-b163-26712b68a4d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:48.615765 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-9a7cf800-a63e-47a1-b163-26712b68a4d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:48.644789 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:48.736296 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7cf800-a63e-47a1-b163-26712b68a4d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:48.738348 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7cf800-a63e-47a1-b163-26712b68a4d3 service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:48.758684 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 671/1334] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:40:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:40:50.816550 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebed16-d2ef-412f-9306-ce2b579922fd None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:50.817427 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebed16-d2ef-412f-9306-ce2b579922fd None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:50.817427 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebed16-d2ef-412f-9306-ce2b579922fd None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:50.819764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 664/1335] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:40:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:40:50.826104 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88994f41-f4f8-4335-bf82-725b070264e5 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:50.826843 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88994f41-f4f8-4335-bf82-725b070264e5 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:50.827002 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88994f41-f4f8-4335-bf82-725b070264e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:50.900783 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-88994f41-f4f8-4335-bf82-725b070264e5 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:40:50.902025 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-88994f41-f4f8-4335-bf82-725b070264e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:50.981647 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:51.005472 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 672/1336] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:40:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:40:51.047049 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ebed16-d2ef-412f-9306-ce2b579922fd None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:51.048600 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-32ebed16-d2ef-412f-9306-ce2b579922fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:51.169254 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ebed16-d2ef-412f-9306-ce2b579922fd None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:51.199010 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:51.248448 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de2a81-e246-4dae-8a50-8297d98d5827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:51.249104 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de2a81-e246-4dae-8a50-8297d98d5827 service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:51.249385 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de2a81-e246-4dae-8a50-8297d98d5827 service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:51.249653 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de2a81-e246-4dae-8a50-8297d98d5827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:51.251340 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-e5de2a81-e246-4dae-8a50-8297d98d5827 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:51.363776 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de2a81-e246-4dae-8a50-8297d98d5827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:51.365228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de2a81-e246-4dae-8a50-8297d98d5827 service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:51.393239 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 665/1337] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:40:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:40:54.023709 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0c2ca-1727-48b8-8528-9648d324a871 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:54.024260 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0c2ca-1727-48b8-8528-9648d324a871 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:54.024260 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0c2ca-1727-48b8-8528-9648d324a871 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:54.025685 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 673/1338] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:40:54.032698 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd082ee1-e56b-40dd-b829-29d1f56e1be6 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:54.033249 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd082ee1-e56b-40dd-b829-29d1f56e1be6 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:54.033249 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd082ee1-e56b-40dd-b829-29d1f56e1be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:54.109512 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-dd082ee1-e56b-40dd-b829-29d1f56e1be6 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:40:54.110773 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-dd082ee1-e56b-40dd-b829-29d1f56e1be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:54.119591 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:54.235765 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 666/1339] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:40:54 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:40:54.283325 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0c2ca-1727-48b8-8528-9648d324a871 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:54.284865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-b2e0c2ca-1727-48b8-8528-9648d324a871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:54.398220 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0c2ca-1727-48b8-8528-9648d324a871 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:54.472756 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa4b80-6532-4329-a5bc-95b9120b9454 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:54.473424 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa4b80-6532-4329-a5bc-95b9120b9454 service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:54.473699 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa4b80-6532-4329-a5bc-95b9120b9454 service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:54.474003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa4b80-6532-4329-a5bc-95b9120b9454 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:54.475638 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-caaa4b80-6532-4329-a5bc-95b9120b9454 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:54.512626 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:54.588483 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa4b80-6532-4329-a5bc-95b9120b9454 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:54.589942 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa4b80-6532-4329-a5bc-95b9120b9454 service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:54.608389 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 674/1340] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:40:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:40:58.710730 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498698b0-a020-4e93-b4f2-80e7ff3e4a40 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:58.711337 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498698b0-a020-4e93-b4f2-80e7ff3e4a40 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:58.711337 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498698b0-a020-4e93-b4f2-80e7ff3e4a40 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:58.712664 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 667/1341] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:40:58.717899 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57017fe-ab0b-477e-88c9-265ca27c6b69 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:58.718346 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57017fe-ab0b-477e-88c9-265ca27c6b69 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:58.718466 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57017fe-ab0b-477e-88c9-265ca27c6b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:58.794516 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-b57017fe-ab0b-477e-88c9-265ca27c6b69 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:40:58.795674 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-b57017fe-ab0b-477e-88c9-265ca27c6b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:58.890596 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:40:58.904563 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 675/1342] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:40:58.943197 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498698b0-a020-4e93-b4f2-80e7ff3e4a40 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:40:58.946386 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-498698b0-a020-4e93-b4f2-80e7ff3e4a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:40:59.053069 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498698b0-a020-4e93-b4f2-80e7ff3e4a40 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:40:59.057104 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f179c-3c02-4c75-9e5f-d357828dd124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:40:59.057768 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f179c-3c02-4c75-9e5f-d357828dd124 service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:40:59.058079 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f179c-3c02-4c75-9e5f-d357828dd124 service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:40:59.058366 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f179c-3c02-4c75-9e5f-d357828dd124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:40:59.068155 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f179c-3c02-4c75-9e5f-d357828dd124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:40:59.069644 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f179c-3c02-4c75-9e5f-d357828dd124 service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:40:59.079440 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 668/1343] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:40:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:41:01.696061 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d7a63-a9b2-454d-a95a-5bf5e0c655e2 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:01.696742 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d7a63-a9b2-454d-a95a-5bf5e0c655e2 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:01.696742 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d7a63-a9b2-454d-a95a-5bf5e0c655e2 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:01.698115 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 676/1344] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:01.703680 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f79438-bb4b-439b-8bf3-0f0330555701 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:01.704168 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f79438-bb4b-439b-8bf3-0f0330555701 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:01.704266 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f79438-bb4b-439b-8bf3-0f0330555701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:01.733080 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-87f79438-bb4b-439b-8bf3-0f0330555701 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:01.734346 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-87f79438-bb4b-439b-8bf3-0f0330555701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:01.763087 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:01.823052 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 669/1345] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:01 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:41:01.860594 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d7a63-a9b2-454d-a95a-5bf5e0c655e2 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:01.872521 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d7a63-a9b2-454d-a95a-5bf5e0c655e2 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:01.876288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7e0f2-9221-47fd-a319-d4686a21890b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:01.876942 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7e0f2-9221-47fd-a319-d4686a21890b service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:01.877221 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7e0f2-9221-47fd-a319-d4686a21890b service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:01.877477 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7e0f2-9221-47fd-a319-d4686a21890b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:01.887602 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae7e0f2-9221-47fd-a319-d4686a21890b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:01.889074 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae7e0f2-9221-47fd-a319-d4686a21890b service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:01.899868 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 677/1346] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:41:01 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:41:05.880937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788dc47b-deb9-4e27-958b-9d8c985a592a None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:05.881483 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788dc47b-deb9-4e27-958b-9d8c985a592a None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:05.881483 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788dc47b-deb9-4e27-958b-9d8c985a592a None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:05.882826 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 670/1347] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:05.888212 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3d3f1-780e-45b2-a894-70800963b382 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:05.888653 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3d3f1-780e-45b2-a894-70800963b382 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:05.888748 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3d3f1-780e-45b2-a894-70800963b382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:05.907611 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-0cd3d3f1-780e-45b2-a894-70800963b382 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:05.908842 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-0cd3d3f1-780e-45b2-a894-70800963b382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:05.917578 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 678/1348] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:41:05.958172 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788dc47b-deb9-4e27-958b-9d8c985a592a None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:05.970375 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788dc47b-deb9-4e27-958b-9d8c985a592a None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:05.973906 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071cbc5-6968-4beb-b477-b06eaf45ea3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:05.974668 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071cbc5-6968-4beb-b477-b06eaf45ea3b service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:05.975034 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071cbc5-6968-4beb-b477-b06eaf45ea3b service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:05.975368 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071cbc5-6968-4beb-b477-b06eaf45ea3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:05.984648 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1071cbc5-6968-4beb-b477-b06eaf45ea3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:05.986139 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1071cbc5-6968-4beb-b477-b06eaf45ea3b service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:05.995992 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 671/1349] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:41:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:41:11.028019 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20d57a-f234-405a-8042-6a2b6c1a652f None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:11.028019 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20d57a-f234-405a-8042-6a2b6c1a652f None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:11.028463 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20d57a-f234-405a-8042-6a2b6c1a652f None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:11.029623 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 679/1350] 10.222.0.27 () {54 vars in 921 bytes} [Tue Jul 5 20:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:11.037169 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac624d4-8917-46db-a5de-1581da344b7b None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:11.037625 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac624d4-8917-46db-a5de-1581da344b7b None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:11.037749 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac624d4-8917-46db-a5de-1581da344b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:11.114526 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-3ac624d4-8917-46db-a5de-1581da344b7b None None] MFA Rules not processed for user `16662dd5e2e74163b6aa2e1e7ef07524`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:11.115739 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-3ac624d4-8917-46db-a5de-1581da344b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:11.221483 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 672/1351] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Jul 5 20:41:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:41:15.407125 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9ecea-d4c6-4a45-bc93-c143fa8bed93 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:15.407677 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9ecea-d4c6-4a45-bc93-c143fa8bed93 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:15.407677 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9ecea-d4c6-4a45-bc93-c143fa8bed93 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:15.409312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 680/1352] 10.222.0.27 () {54 vars in 921 bytes} [Tue Jul 5 20:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:15.414795 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac09945-8f7f-462a-9f23-fa785e62ec7c None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:15.415238 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac09945-8f7f-462a-9f23-fa785e62ec7c None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:15.415554 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac09945-8f7f-462a-9f23-fa785e62ec7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:15.435025 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-4ac09945-8f7f-462a-9f23-fa785e62ec7c None None] MFA Rules not processed for user `16662dd5e2e74163b6aa2e1e7ef07524`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:15.436382 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-4ac09945-8f7f-462a-9f23-fa785e62ec7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:15.447015 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 673/1353] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Jul 5 20:41:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:41:15.902230 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=13 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:16.754307 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3df62-f0fa-4b26-a0db-c7c0937af53b None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:16.754911 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3df62-f0fa-4b26-a0db-c7c0937af53b None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:16.754911 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3df62-f0fa-4b26-a0db-c7c0937af53b None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:16.756336 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 681/1354] 10.222.0.27 () {54 vars in 921 bytes} [Tue Jul 5 20:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:16.761527 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf03a6-8bfa-4e41-ab91-83878ab97c08 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:16.762065 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf03a6-8bfa-4e41-ab91-83878ab97c08 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:16.762187 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf03a6-8bfa-4e41-ab91-83878ab97c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:16.780761 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-4caf03a6-8bfa-4e41-ab91-83878ab97c08 None None] MFA Rules not processed for user `16662dd5e2e74163b6aa2e1e7ef07524`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:16.781999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-4caf03a6-8bfa-4e41-ab91-83878ab97c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:16.790966 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 674/1355] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Jul 5 20:41:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:41:20.428138 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53ddb3-8f0d-414f-9b23-ae8e70a52c57 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:20.429139 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53ddb3-8f0d-414f-9b23-ae8e70a52c57 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:20.429633 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53ddb3-8f0d-414f-9b23-ae8e70a52c57 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:20.437011 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a03de-8f16-47ab-86a7-5e8696a4fe29 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:20.438140 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 682/1356] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:41:20 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:20.438379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a03de-8f16-47ab-86a7-5e8696a4fe29 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:20.438881 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a03de-8f16-47ab-86a7-5e8696a4fe29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:20.462466 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-9b6a03de-8f16-47ab-86a7-5e8696a4fe29 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:20.464106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-9b6a03de-8f16-47ab-86a7-5e8696a4fe29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:20.472819 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 675/1357] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:41:20.525474 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a721ba-6214-44d6-9b72-5dd52e6ef7e9 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:20.525781 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a721ba-6214-44d6-9b72-5dd52e6ef7e9 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:20.526495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a721ba-6214-44d6-9b72-5dd52e6ef7e9 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:20.527880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 683/1358] 10.222.0.27 () {54 vars in 961 bytes} [Tue Jul 5 20:41:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:20.536048 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e478e7-ede0-4c88-a31c-6fdf5bbabf1d None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:20.536561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e478e7-ede0-4c88-a31c-6fdf5bbabf1d None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:20.536840 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e478e7-ede0-4c88-a31c-6fdf5bbabf1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:20.585937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:20.594614 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-76e478e7-ede0-4c88-a31c-6fdf5bbabf1d None None] MFA Rules not processed for user `814b675b98b844a2a12a39890ee69d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:20.596065 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-76e478e7-ede0-4c88-a31c-6fdf5bbabf1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:20.680923 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 676/1359] 10.222.0.27 () {58 vars in 1058 bytes} [Tue Jul 5 20:41:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:41:20.688602 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a721ba-6214-44d6-9b72-5dd52e6ef7e9 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:20.704665 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a721ba-6214-44d6-9b72-5dd52e6ef7e9 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:20.711249 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8aef1-e976-4248-94ef-db209931e0e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:20.712290 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8aef1-e976-4248-94ef-db209931e0e1 service nova] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:20.712838 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8aef1-e976-4248-94ef-db209931e0e1 service nova] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:20.713273 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8aef1-e976-4248-94ef-db209931e0e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:20.723469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a8aef1-e976-4248-94ef-db209931e0e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:20.725262 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a8aef1-e976-4248-94ef-db209931e0e1 service nova] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:20.737482 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 684/1360] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:41:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:41:22.959032 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354f50b-bce6-4dbe-9f6d-ff254f62202b None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:22.959591 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354f50b-bce6-4dbe-9f6d-ff254f62202b None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:22.959591 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354f50b-bce6-4dbe-9f6d-ff254f62202b None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:22.961107 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 677/1361] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:22.966959 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a906c75-936f-4804-a374-b1bcb0d57682 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:22.967408 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a906c75-936f-4804-a374-b1bcb0d57682 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:22.967508 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a906c75-936f-4804-a374-b1bcb0d57682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:22.987081 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-7a906c75-936f-4804-a374-b1bcb0d57682 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:22.988315 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-7a906c75-936f-4804-a374-b1bcb0d57682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:22.997042 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 685/1362] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:41:23.041920 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354f50b-bce6-4dbe-9f6d-ff254f62202b None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:23.058294 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354f50b-bce6-4dbe-9f6d-ff254f62202b None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:23.063882 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdad358-489b-4345-8d56-fca3ab6f2bb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:23.064544 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdad358-489b-4345-8d56-fca3ab6f2bb2 service nova] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:23.064813 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdad358-489b-4345-8d56-fca3ab6f2bb2 service nova] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:23.065104 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdad358-489b-4345-8d56-fca3ab6f2bb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:23.074048 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdad358-489b-4345-8d56-fca3ab6f2bb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:23.075641 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdad358-489b-4345-8d56-fca3ab6f2bb2 service nova] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:23.090037 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 678/1363] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:41:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:41:25.415538 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee843a-75b3-4cf0-b80f-2eb741be71bc None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:25.416082 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee843a-75b3-4cf0-b80f-2eb741be71bc None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:25.416177 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee843a-75b3-4cf0-b80f-2eb741be71bc None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:25.417640 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 686/1364] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:41:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:25.422948 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24932751-6a9e-47f5-8802-09bcaf488fc3 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:25.423755 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24932751-6a9e-47f5-8802-09bcaf488fc3 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:25.424217 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24932751-6a9e-47f5-8802-09bcaf488fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:25.450210 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-24932751-6a9e-47f5-8802-09bcaf488fc3 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:25.452005 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-24932751-6a9e-47f5-8802-09bcaf488fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:25.471067 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 679/1365] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:41:25.509004 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da25f8-0c30-4e23-a7c4-1ffe97a8b8c4 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:25.509420 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da25f8-0c30-4e23-a7c4-1ffe97a8b8c4 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:25.509871 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da25f8-0c30-4e23-a7c4-1ffe97a8b8c4 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:25.511556 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 687/1366] 10.222.0.27 () {54 vars in 961 bytes} [Tue Jul 5 20:41:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:25.516874 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4258d-f2c0-46d2-98f2-20b615a2b1af None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:25.517164 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4258d-f2c0-46d2-98f2-20b615a2b1af None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:25.517441 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4258d-f2c0-46d2-98f2-20b615a2b1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:25.536396 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-91e4258d-f2c0-46d2-98f2-20b615a2b1af None None] MFA Rules not processed for user `814b675b98b844a2a12a39890ee69d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:25.537602 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-91e4258d-f2c0-46d2-98f2-20b615a2b1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:25.549163 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 680/1367] 10.222.0.27 () {58 vars in 1058 bytes} [Tue Jul 5 20:41:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:41:25.557070 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da25f8-0c30-4e23-a7c4-1ffe97a8b8c4 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:25.573082 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da25f8-0c30-4e23-a7c4-1ffe97a8b8c4 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:25.578910 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bca72-3a2c-4381-90f5-f0c116b804a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:25.579540 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bca72-3a2c-4381-90f5-f0c116b804a5 service nova] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:25.579801 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bca72-3a2c-4381-90f5-f0c116b804a5 service nova] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:25.580068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bca72-3a2c-4381-90f5-f0c116b804a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:25.588142 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19bca72-3a2c-4381-90f5-f0c116b804a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:25.589715 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19bca72-3a2c-4381-90f5-f0c116b804a5 service nova] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:25.599587 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 688/1368] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:41:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:41:27.687930 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0585d-f876-4a48-b65a-ddd2250e22cf None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:27.688517 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0585d-f876-4a48-b65a-ddd2250e22cf None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:27.688517 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0585d-f876-4a48-b65a-ddd2250e22cf None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:27.689785 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 681/1369] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:27.696096 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392af604-0a8f-4d2a-a6ba-b878937e31c9 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:27.697040 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392af604-0a8f-4d2a-a6ba-b878937e31c9 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:27.697586 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392af604-0a8f-4d2a-a6ba-b878937e31c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:27.717788 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-392af604-0a8f-4d2a-a6ba-b878937e31c9 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:27.719049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-392af604-0a8f-4d2a-a6ba-b878937e31c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:27.729086 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 689/1370] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:41:27.773278 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0585d-f876-4a48-b65a-ddd2250e22cf None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:27.787911 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0585d-f876-4a48-b65a-ddd2250e22cf None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:27.795444 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce59dc-c518-46fe-a4ec-a183a2d539ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:27.796596 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce59dc-c518-46fe-a4ec-a183a2d539ad service nova] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:27.797182 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce59dc-c518-46fe-a4ec-a183a2d539ad service nova] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:27.797660 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce59dc-c518-46fe-a4ec-a183a2d539ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:27.807723 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ce59dc-c518-46fe-a4ec-a183a2d539ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:27.809575 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ce59dc-c518-46fe-a4ec-a183a2d539ad service nova] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:27.819916 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 682/1371] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:41:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:41:28.392915 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d758603-254b-447c-bb89-d3bcca996615 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:28.393187 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d758603-254b-447c-bb89-d3bcca996615 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:28.393439 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d758603-254b-447c-bb89-d3bcca996615 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:28.395175 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 690/1372] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:28.400459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56ee84-ea20-4642-a7a2-ad052ee7e866 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:28.400748 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56ee84-ea20-4642-a7a2-ad052ee7e866 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:28.401025 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56ee84-ea20-4642-a7a2-ad052ee7e866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:28.420398 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-1f56ee84-ea20-4642-a7a2-ad052ee7e866 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:28.421614 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-1f56ee84-ea20-4642-a7a2-ad052ee7e866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:28.429657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 683/1373] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:41:28.770101 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952e4f9-2a0a-461b-9eee-be38a45cb4db None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:28.770101 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952e4f9-2a0a-461b-9eee-be38a45cb4db None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:28.770101 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952e4f9-2a0a-461b-9eee-be38a45cb4db None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:28.773003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 691/1374] 10.222.0.27 () {54 vars in 963 bytes} [Tue Jul 5 20:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:28.776506 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c0257-be20-4fcc-bfec-7a29d3645090 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:28.777031 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c0257-be20-4fcc-bfec-7a29d3645090 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:28.777031 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c0257-be20-4fcc-bfec-7a29d3645090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:28.828069 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-9f0c0257-be20-4fcc-bfec-7a29d3645090 None None] MFA Rules not processed for user `2141561d059043baa440e966a5e1c6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:28.829312 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-9f0c0257-be20-4fcc-bfec-7a29d3645090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:28.893206 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 684/1375] 10.222.0.27 () {58 vars in 1060 bytes} [Tue Jul 5 20:41:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:41:28.901700 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952e4f9-2a0a-461b-9eee-be38a45cb4db None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:28.914224 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952e4f9-2a0a-461b-9eee-be38a45cb4db None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:28.918670 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53fedc-be05-4069-826d-fc75571ef726 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:28.919567 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53fedc-be05-4069-826d-fc75571ef726 service cinder] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:28.920064 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53fedc-be05-4069-826d-fc75571ef726 service cinder] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:28.920539 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53fedc-be05-4069-826d-fc75571ef726 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:28.930884 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53fedc-be05-4069-826d-fc75571ef726 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:28.932793 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53fedc-be05-4069-826d-fc75571ef726 service cinder] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:28.944581 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 692/1376] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:41:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:41:29.872225 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52a262-880d-4ace-8c00-6575e8c3ccad None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:29.872779 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52a262-880d-4ace-8c00-6575e8c3ccad None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:29.872779 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52a262-880d-4ace-8c00-6575e8c3ccad None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:29.874068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 685/1377] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:29.879280 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0bdb8-8078-4931-baed-4a9e597ec2e5 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:29.879700 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0bdb8-8078-4931-baed-4a9e597ec2e5 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:29.879851 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0bdb8-8078-4931-baed-4a9e597ec2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:29.899312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-3af0bdb8-8078-4931-baed-4a9e597ec2e5 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:29.900562 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-3af0bdb8-8078-4931-baed-4a9e597ec2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:29.909660 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 693/1378] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:41:29.954291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52a262-880d-4ace-8c00-6575e8c3ccad None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:29.970820 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52a262-880d-4ace-8c00-6575e8c3ccad None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:29.976346 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5420b-a7fa-460d-ab31-286f81ae6b70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:29.977277 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5420b-a7fa-460d-ab31-286f81ae6b70 service nova] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:29.977565 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5420b-a7fa-460d-ab31-286f81ae6b70 service nova] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:29.977852 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5420b-a7fa-460d-ab31-286f81ae6b70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:29.987372 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5420b-a7fa-460d-ab31-286f81ae6b70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:29.989055 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5420b-a7fa-460d-ab31-286f81ae6b70 service nova] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:29.993205 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:30.000106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 686/1379] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:41:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:41:32.084749 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a0c9e-e2a4-4ac7-bfbd-5bc9691e56c8 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:32.085274 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a0c9e-e2a4-4ac7-bfbd-5bc9691e56c8 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:32.085274 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a0c9e-e2a4-4ac7-bfbd-5bc9691e56c8 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:32.086738 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 694/1380] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:32.092447 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871f3c5-5dc6-47bb-93d3-5efa7845f9ea None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:32.092896 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871f3c5-5dc6-47bb-93d3-5efa7845f9ea None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:32.092992 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871f3c5-5dc6-47bb-93d3-5efa7845f9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:32.112333 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-3871f3c5-5dc6-47bb-93d3-5efa7845f9ea None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:32.113557 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-3871f3c5-5dc6-47bb-93d3-5efa7845f9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:32.122524 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 687/1381] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:41:32.168685 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a0c9e-e2a4-4ac7-bfbd-5bc9691e56c8 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:32.185874 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a0c9e-e2a4-4ac7-bfbd-5bc9691e56c8 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:32.193157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a66f0-217c-4caf-92ef-6f39840a5719 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:32.193920 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a66f0-217c-4caf-92ef-6f39840a5719 service nova] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:32.194448 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a66f0-217c-4caf-92ef-6f39840a5719 service nova] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:32.194928 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a66f0-217c-4caf-92ef-6f39840a5719 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:32.204109 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a66f0-217c-4caf-92ef-6f39840a5719 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:32.205763 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a66f0-217c-4caf-92ef-6f39840a5719 service nova] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:32.215127 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 695/1382] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:41:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:41:34.277038 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b8093-73a1-45ed-81f3-1687bf26c229 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:34.277977 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b8093-73a1-45ed-81f3-1687bf26c229 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:34.278219 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b8093-73a1-45ed-81f3-1687bf26c229 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:34.279615 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 688/1383] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:41:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:34.285348 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eecb4e-b41c-461c-ac44-bc48a6fa4ca8 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:34.285891 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eecb4e-b41c-461c-ac44-bc48a6fa4ca8 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:34.285979 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eecb4e-b41c-461c-ac44-bc48a6fa4ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:34.304557 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-32eecb4e-b41c-461c-ac44-bc48a6fa4ca8 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:34.305759 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-32eecb4e-b41c-461c-ac44-bc48a6fa4ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:34.313827 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 696/1384] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:41:34.354584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b8093-73a1-45ed-81f3-1687bf26c229 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:34.369201 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b8093-73a1-45ed-81f3-1687bf26c229 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:34.374745 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eececadf-d6e9-41b0-94e7-a52880db5be9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:34.375395 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eececadf-d6e9-41b0-94e7-a52880db5be9 service nova] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:34.375671 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eececadf-d6e9-41b0-94e7-a52880db5be9 service nova] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:34.375946 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eececadf-d6e9-41b0-94e7-a52880db5be9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:34.384472 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eececadf-d6e9-41b0-94e7-a52880db5be9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:34.386320 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eececadf-d6e9-41b0-94e7-a52880db5be9 service nova] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:34.395944 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 689/1385] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:41:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:41:36.422582 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671306d-eb89-46e7-b578-ed25ac4a8309 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:36.423114 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671306d-eb89-46e7-b578-ed25ac4a8309 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:36.423114 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671306d-eb89-46e7-b578-ed25ac4a8309 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:36.424410 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 697/1386] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:41:36.429775 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708d254-060c-41db-bcda-5cd66813b3e1 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:36.430354 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708d254-060c-41db-bcda-5cd66813b3e1 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:36.430354 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708d254-060c-41db-bcda-5cd66813b3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:36.448450 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-d708d254-060c-41db-bcda-5cd66813b3e1 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:36.449662 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-d708d254-060c-41db-bcda-5cd66813b3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:36.457957 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 690/1387] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:41:36.504838 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671306d-eb89-46e7-b578-ed25ac4a8309 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:36.524474 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671306d-eb89-46e7-b578-ed25ac4a8309 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:36.531629 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f5389-595c-4e87-969f-fb181bd2ca1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:36.532286 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f5389-595c-4e87-969f-fb181bd2ca1d service nova] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:36.532618 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f5389-595c-4e87-969f-fb181bd2ca1d service nova] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:36.532875 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f5389-595c-4e87-969f-fb181bd2ca1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:36.542352 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f5389-595c-4e87-969f-fb181bd2ca1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:36.544054 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f5389-595c-4e87-969f-fb181bd2ca1d service nova] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:36.554333 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 698/1388] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:41:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:41:38.698773 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcd799-1f24-40f6-b293-724714683477 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:38.699364 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcd799-1f24-40f6-b293-724714683477 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:38.699364 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcd799-1f24-40f6-b293-724714683477 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:38.700870 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 691/1389] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:38.706511 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6db3a-feda-4413-b6ae-ce5424717a3d None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:38.706948 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6db3a-feda-4413-b6ae-ce5424717a3d None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:38.707204 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6db3a-feda-4413-b6ae-ce5424717a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:38.727335 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-c1f6db3a-feda-4413-b6ae-ce5424717a3d None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:38.728592 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-c1f6db3a-feda-4413-b6ae-ce5424717a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:38.736735 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 699/1390] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:41:38.783698 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcd799-1f24-40f6-b293-724714683477 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:38.801047 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcd799-1f24-40f6-b293-724714683477 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:38.807646 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99856f-c3bb-4716-8c1f-c4f54aa62acc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:38.808349 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99856f-c3bb-4716-8c1f-c4f54aa62acc service nova] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:38.808627 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99856f-c3bb-4716-8c1f-c4f54aa62acc service nova] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:38.808905 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99856f-c3bb-4716-8c1f-c4f54aa62acc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:38.817452 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99856f-c3bb-4716-8c1f-c4f54aa62acc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:38.819126 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99856f-c3bb-4716-8c1f-c4f54aa62acc service nova] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:38.828907 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 692/1391] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:41:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:41:41.543735 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c23b8e-d928-4d1f-8849-4be2cef6b6b5 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:41.544349 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c23b8e-d928-4d1f-8849-4be2cef6b6b5 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:41.544349 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c23b8e-d928-4d1f-8849-4be2cef6b6b5 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:41.546417 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 700/1392] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:41:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:41.553646 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016cf41-863c-4cc8-9651-4ceff8400d9b None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:41.554126 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016cf41-863c-4cc8-9651-4ceff8400d9b None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:41.554421 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016cf41-863c-4cc8-9651-4ceff8400d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:41.575019 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-e016cf41-863c-4cc8-9651-4ceff8400d9b None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:41.576285 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-e016cf41-863c-4cc8-9651-4ceff8400d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:41.585558 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 693/1393] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:41:41.629875 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c23b8e-d928-4d1f-8849-4be2cef6b6b5 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:41.648807 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c23b8e-d928-4d1f-8849-4be2cef6b6b5 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:41.656608 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8814b08-a70b-40f3-abb7-4691a0d3f6be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:41.657421 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8814b08-a70b-40f3-abb7-4691a0d3f6be service nova] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:41.657782 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8814b08-a70b-40f3-abb7-4691a0d3f6be service nova] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:41.658226 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8814b08-a70b-40f3-abb7-4691a0d3f6be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:41.669991 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8814b08-a70b-40f3-abb7-4691a0d3f6be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:41.672373 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8814b08-a70b-40f3-abb7-4691a0d3f6be service nova] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:41.685286 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 701/1394] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:41:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:41:43.774963 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acb5f0-bbcd-410e-9987-2fe25c367d97 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:43.775566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acb5f0-bbcd-410e-9987-2fe25c367d97 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:43.775566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acb5f0-bbcd-410e-9987-2fe25c367d97 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:43.777030 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 694/1395] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:43.782387 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749d3d1-f843-4174-af53-766ce107206d None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:43.782844 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749d3d1-f843-4174-af53-766ce107206d None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:43.782930 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749d3d1-f843-4174-af53-766ce107206d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:43.802352 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-1749d3d1-f843-4174-af53-766ce107206d None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:43.803567 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-1749d3d1-f843-4174-af53-766ce107206d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:43.812917 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 702/1396] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:41:43.856996 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acb5f0-bbcd-410e-9987-2fe25c367d97 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:43.873008 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acb5f0-bbcd-410e-9987-2fe25c367d97 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:43.879401 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d56dc1-a125-43d7-8835-a14f14d3f1cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:43.880048 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d56dc1-a125-43d7-8835-a14f14d3f1cc service nova] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:43.880328 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d56dc1-a125-43d7-8835-a14f14d3f1cc service nova] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:43.880600 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d56dc1-a125-43d7-8835-a14f14d3f1cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:43.888985 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d56dc1-a125-43d7-8835-a14f14d3f1cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:43.890613 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d56dc1-a125-43d7-8835-a14f14d3f1cc service nova] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:43.900216 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 695/1397] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:41:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:41:44.065600 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d68de5-cf8e-4c4a-bf17-0a74ce7c81d6 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:44.065823 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d68de5-cf8e-4c4a-bf17-0a74ce7c81d6 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:44.066202 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d68de5-cf8e-4c4a-bf17-0a74ce7c81d6 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:44.067616 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 703/1398] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:44.073876 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc61631-022d-44eb-b478-bc35e370c0ed None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:44.074274 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc61631-022d-44eb-b478-bc35e370c0ed None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:44.074619 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc61631-022d-44eb-b478-bc35e370c0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:44.094394 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-2cc61631-022d-44eb-b478-bc35e370c0ed None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:44.095647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-2cc61631-022d-44eb-b478-bc35e370c0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:44.104423 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 696/1399] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:41:44.160533 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fdc98-2e03-4951-8543-cf6a0dba770b None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:44.160834 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fdc98-2e03-4951-8543-cf6a0dba770b None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:44.161132 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fdc98-2e03-4951-8543-cf6a0dba770b None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:44.162541 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 704/1400] 10.222.0.27 () {54 vars in 962 bytes} [Tue Jul 5 20:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:44.168321 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8c0ce-7bf8-4829-a596-5f95735b75a7 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:44.168614 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8c0ce-7bf8-4829-a596-5f95735b75a7 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:44.168889 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8c0ce-7bf8-4829-a596-5f95735b75a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:44.219343 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-eae8c0ce-7bf8-4829-a596-5f95735b75a7 None None] MFA Rules not processed for user `a05f331339d143c09eaa12efe2b80653`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:44.220587 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-eae8c0ce-7bf8-4829-a596-5f95735b75a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:44.286712 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 697/1401] 10.222.0.27 () {58 vars in 1059 bytes} [Tue Jul 5 20:41:44 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:41:44.294901 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8fdc98-2e03-4951-8543-cf6a0dba770b None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:44.306906 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8fdc98-2e03-4951-8543-cf6a0dba770b None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:44.310739 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a6156a-b2aa-4d67-8e9b-9b4500ccb35b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05f331339d143c09eaa12efe2b80653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:44.311381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6156a-b2aa-4d67-8e9b-9b4500ccb35b service glance] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:44.311653 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6156a-b2aa-4d67-8e9b-9b4500ccb35b service glance] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:44.311923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6156a-b2aa-4d67-8e9b-9b4500ccb35b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:44.321357 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a6156a-b2aa-4d67-8e9b-9b4500ccb35b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:44.322768 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a6156a-b2aa-4d67-8e9b-9b4500ccb35b service glance] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:44.332499 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 705/1402] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:41:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:41:45.050232 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26682d82-1759-4032-810a-232b84698efd None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:45.050832 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26682d82-1759-4032-810a-232b84698efd None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:45.050832 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26682d82-1759-4032-810a-232b84698efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:45.103231 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-26682d82-1759-4032-810a-232b84698efd None None] MFA Rules not processed for user `c9647d15389e49e6b7c43ea1b1538a13`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:45.105213 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-26682d82-1759-4032-810a-232b84698efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:45.152973 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:45.177983 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 698/1403] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Jul 5 20:41:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:41:45.221881 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18259848-01d3-46e3-b5e5-c0639364118f None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:45.222390 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18259848-01d3-46e3-b5e5-c0639364118f None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:45.222390 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18259848-01d3-46e3-b5e5-c0639364118f None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:45.223863 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 706/1404] 10.222.0.27 () {54 vars in 942 bytes} [Tue Jul 5 20:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:45.230113 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc555b52-c286-4448-96ce-d32b3007496a None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:45.230405 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc555b52-c286-4448-96ce-d32b3007496a None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:45.230711 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc555b52-c286-4448-96ce-d32b3007496a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:45.279346 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-bc555b52-c286-4448-96ce-d32b3007496a None None] MFA Rules not processed for user `90aa580a2e10467a93c2d79d1906bd8a`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:45.280495 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-bc555b52-c286-4448-96ce-d32b3007496a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:45.354264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 699/1405] 10.222.0.27 () {58 vars in 1039 bytes} [Tue Jul 5 20:41:45 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:41:45.363615 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18259848-01d3-46e3-b5e5-c0639364118f None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:45.376995 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18259848-01d3-46e3-b5e5-c0639364118f None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:45.381939 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4ea25-309a-48fa-b84c-4a5f736085a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90aa580a2e10467a93c2d79d1906bd8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:45.382571 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4ea25-309a-48fa-b84c-4a5f736085a0 service swift] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:45.382958 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4ea25-309a-48fa-b84c-4a5f736085a0 service swift] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:45.383233 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4ea25-309a-48fa-b84c-4a5f736085a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:45.391357 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4ea25-309a-48fa-b84c-4a5f736085a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:45.392971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4ea25-309a-48fa-b84c-4a5f736085a0 service swift] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:45.401479 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 707/1406] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Jul 5 20:41:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 20:41:45.958267 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cb524-3c26-4378-bf06-f103dc8df6e7 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:45.958911 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cb524-3c26-4378-bf06-f103dc8df6e7 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:45.959295 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cb524-3c26-4378-bf06-f103dc8df6e7 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:45.960976 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 700/1407] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:41:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:41:45.966998 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef84d3-5be2-49e4-a85e-94dd43124b64 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:45.967286 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef84d3-5be2-49e4-a85e-94dd43124b64 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:45.967561 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef84d3-5be2-49e4-a85e-94dd43124b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:45.973574 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=67 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:45.987940 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-03ef84d3-5be2-49e4-a85e-94dd43124b64 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:41:45.989375 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-03ef84d3-5be2-49e4-a85e-94dd43124b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:41:46.000501 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 708/1408] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:41:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:41:46.045307 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7cb524-3c26-4378-bf06-f103dc8df6e7 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:41:46.060761 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7cb524-3c26-4378-bf06-f103dc8df6e7 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:41:46.066640 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628e5ad-5c92-4c8a-99c5-1f4c71c2b6d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:41:46.067462 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628e5ad-5c92-4c8a-99c5-1f4c71c2b6d1 service nova] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:41:46.067853 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628e5ad-5c92-4c8a-99c5-1f4c71c2b6d1 service nova] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:41:46.068135 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628e5ad-5c92-4c8a-99c5-1f4c71c2b6d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:41:46.079766 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2628e5ad-5c92-4c8a-99c5-1f4c71c2b6d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:41:46.081451 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2628e5ad-5c92-4c8a-99c5-1f4c71c2b6d1 service nova] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:41:46.091675 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 701/1409] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:41:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:41:55.981735 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=2 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:41:56.086961 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=59 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:07.005544 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ba033-20cf-4904-a505-123398778e5d None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:07.006204 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ba033-20cf-4904-a505-123398778e5d None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:07.006204 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ba033-20cf-4904-a505-123398778e5d None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:07.007559 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 709/1410] 10.222.0.27 () {54 vars in 918 bytes} [Tue Jul 5 20:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:07.013670 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1c3c7-22a9-4e4c-a5a0-97bf547b72aa None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:07.014147 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1c3c7-22a9-4e4c-a5a0-97bf547b72aa None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:07.014260 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1c3c7-22a9-4e4c-a5a0-97bf547b72aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:07.035018 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-fdf1c3c7-22a9-4e4c-a5a0-97bf547b72aa None None] MFA Rules not processed for user `16662dd5e2e74163b6aa2e1e7ef07524`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:07.036243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-fdf1c3c7-22a9-4e4c-a5a0-97bf547b72aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:07.046554 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 702/1411] 10.222.0.27 () {58 vars in 1015 bytes} [Tue Jul 5 20:42:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:42:07.061029 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2825da-a31b-4ad3-8f72-683c6cccf0d2 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:07.061316 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2825da-a31b-4ad3-8f72-683c6cccf0d2 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:07.061592 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2825da-a31b-4ad3-8f72-683c6cccf0d2 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:07.063058 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 710/1412] 10.222.0.27 () {54 vars in 918 bytes} [Tue Jul 5 20:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:07.067917 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531cd6c-15ae-4b3a-9f29-afc3fea7fa6f None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:07.068205 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531cd6c-15ae-4b3a-9f29-afc3fea7fa6f None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:07.068479 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531cd6c-15ae-4b3a-9f29-afc3fea7fa6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:07.087657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-b531cd6c-15ae-4b3a-9f29-afc3fea7fa6f None None] MFA Rules not processed for user `814b675b98b844a2a12a39890ee69d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:07.088858 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-b531cd6c-15ae-4b3a-9f29-afc3fea7fa6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:07.099941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 703/1413] 10.222.0.27 () {58 vars in 1015 bytes} [Tue Jul 5 20:42:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:42:09.571909 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb285534-183d-4def-91f6-e0a4268f37c3 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:09.572810 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb285534-183d-4def-91f6-e0a4268f37c3 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:09.573117 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb285534-183d-4def-91f6-e0a4268f37c3 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:09.577237 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 711/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 20:42:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:09.582760 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c1f39-aa3b-4371-8dac-908b7488cc36 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:09.583217 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c1f39-aa3b-4371-8dac-908b7488cc36 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:09.583395 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c1f39-aa3b-4371-8dac-908b7488cc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:09.601663 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-5c6c1f39-aa3b-4371-8dac-908b7488cc36 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:09.602883 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-5c6c1f39-aa3b-4371-8dac-908b7488cc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:09.611209 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 704/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 20:42:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:42:09.658471 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb285534-183d-4def-91f6-e0a4268f37c3 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:09.678440 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb285534-183d-4def-91f6-e0a4268f37c3 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:09.684334 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375eca43-fa88-4076-8dcc-f06602bd2530 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:09.684910 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375eca43-fa88-4076-8dcc-f06602bd2530 service nova] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:09.685185 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375eca43-fa88-4076-8dcc-f06602bd2530 service nova] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:09.685450 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375eca43-fa88-4076-8dcc-f06602bd2530 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:09.694767 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375eca43-fa88-4076-8dcc-f06602bd2530 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:09.696391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375eca43-fa88-4076-8dcc-f06602bd2530 service nova] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:09.706195 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 712/1416] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:42:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:42:10.618662 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179eae2-711e-4692-96a8-68554b0a8e42 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:10.619551 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179eae2-711e-4692-96a8-68554b0a8e42 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:10.619551 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179eae2-711e-4692-96a8-68554b0a8e42 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:10.621901 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 705/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 20:42:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:10.628733 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bd7ba-96bf-43d1-b5da-3014b2c125a5 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:10.629534 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bd7ba-96bf-43d1-b5da-3014b2c125a5 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:10.629534 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bd7ba-96bf-43d1-b5da-3014b2c125a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:10.651458 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-5b4bd7ba-96bf-43d1-b5da-3014b2c125a5 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:10.652716 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-5b4bd7ba-96bf-43d1-b5da-3014b2c125a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:10.661173 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 713/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 20:42:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:42:10.813545 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179eae2-711e-4692-96a8-68554b0a8e42 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:10.833489 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179eae2-711e-4692-96a8-68554b0a8e42 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:10.841394 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37eea2-5830-4dbd-978c-943bc65606ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:10.842073 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37eea2-5830-4dbd-978c-943bc65606ac service nova] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:10.842361 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37eea2-5830-4dbd-978c-943bc65606ac service nova] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:10.842640 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37eea2-5830-4dbd-978c-943bc65606ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:10.851864 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c37eea2-5830-4dbd-978c-943bc65606ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:10.853506 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c37eea2-5830-4dbd-978c-943bc65606ac service nova] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:10.868380 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 706/1419] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:42:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:42:11.786202 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad89bd-393c-4d61-bc73-a65ca7a49df2 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:11.786797 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad89bd-393c-4d61-bc73-a65ca7a49df2 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:11.786797 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad89bd-393c-4d61-bc73-a65ca7a49df2 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:11.788138 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 714/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 20:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:11.796280 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921d5ca-e081-47fe-83b5-85650d7ac928 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:11.796714 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921d5ca-e081-47fe-83b5-85650d7ac928 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:11.796826 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921d5ca-e081-47fe-83b5-85650d7ac928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:11.816543 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-3921d5ca-e081-47fe-83b5-85650d7ac928 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:11.817738 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-3921d5ca-e081-47fe-83b5-85650d7ac928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:11.826138 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 707/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 20:42:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:42:11.984010 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad89bd-393c-4d61-bc73-a65ca7a49df2 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:12.005171 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad89bd-393c-4d61-bc73-a65ca7a49df2 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:12.014667 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39e28b-e532-49a0-ac72-c609f7e15d9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:12.015309 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39e28b-e532-49a0-ac72-c609f7e15d9f service nova] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:12.015586 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39e28b-e532-49a0-ac72-c609f7e15d9f service nova] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:12.015855 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39e28b-e532-49a0-ac72-c609f7e15d9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:12.024620 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f39e28b-e532-49a0-ac72-c609f7e15d9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:12.026267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f39e28b-e532-49a0-ac72-c609f7e15d9f service nova] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:12.035715 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 715/1422] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:42:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:42:12.886408 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b14e0f-83fd-4163-8f5e-4de9d04fff32 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:12.887390 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b14e0f-83fd-4163-8f5e-4de9d04fff32 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:12.887390 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b14e0f-83fd-4163-8f5e-4de9d04fff32 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:12.889545 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 708/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 20:42:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:12.895694 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d2d4a-1104-46f1-9730-8e9a313c3d49 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:12.896907 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d2d4a-1104-46f1-9730-8e9a313c3d49 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:12.897291 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d2d4a-1104-46f1-9730-8e9a313c3d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:12.924188 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-6d7d2d4a-1104-46f1-9730-8e9a313c3d49 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:12.925396 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-6d7d2d4a-1104-46f1-9730-8e9a313c3d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:12.933938 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 716/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 20:42:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:42:13.080550 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b14e0f-83fd-4163-8f5e-4de9d04fff32 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:13.095129 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b14e0f-83fd-4163-8f5e-4de9d04fff32 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:13.100666 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e0a3f-47ab-4c81-a891-ebccdd100322 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:13.101320 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e0a3f-47ab-4c81-a891-ebccdd100322 service nova] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:13.101602 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e0a3f-47ab-4c81-a891-ebccdd100322 service nova] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:13.101973 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e0a3f-47ab-4c81-a891-ebccdd100322 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:13.110756 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e0a3f-47ab-4c81-a891-ebccdd100322 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:13.112359 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e0a3f-47ab-4c81-a891-ebccdd100322 service nova] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:13.122041 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 709/1425] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:42:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:42:13.976098 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91211f-ba3d-4849-80c2-a00045ff16eb None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:13.976703 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91211f-ba3d-4849-80c2-a00045ff16eb None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:13.976703 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91211f-ba3d-4849-80c2-a00045ff16eb None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:13.978066 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 717/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 20:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:13.983295 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4255ca-cdb3-4ef9-b661-e7b88b6c2393 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:13.983741 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4255ca-cdb3-4ef9-b661-e7b88b6c2393 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:13.983831 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4255ca-cdb3-4ef9-b661-e7b88b6c2393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:14.004168 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-da4255ca-cdb3-4ef9-b661-e7b88b6c2393 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:14.005368 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-da4255ca-cdb3-4ef9-b661-e7b88b6c2393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:14.014095 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 710/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 20:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:42:14.167425 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e91211f-ba3d-4849-80c2-a00045ff16eb None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:14.183072 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e91211f-ba3d-4849-80c2-a00045ff16eb None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:14.189057 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315e30d-606b-4813-8217-77bcfc6be800 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:14.189689 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315e30d-606b-4813-8217-77bcfc6be800 service nova] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:14.189999 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315e30d-606b-4813-8217-77bcfc6be800 service nova] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:14.190292 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315e30d-606b-4813-8217-77bcfc6be800 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:14.198599 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c315e30d-606b-4813-8217-77bcfc6be800 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:14.200286 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c315e30d-606b-4813-8217-77bcfc6be800 service nova] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:14.209695 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 718/1428] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:42:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:42:15.028080 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b72b6e-913e-4b3d-bc80-07a12795879e None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:15.028680 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b72b6e-913e-4b3d-bc80-07a12795879e None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:15.028680 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b72b6e-913e-4b3d-bc80-07a12795879e None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:15.030655 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 711/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 20:42:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:15.037385 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddfd8f-c408-4942-b7f3-3bfde787ba33 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:15.037878 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddfd8f-c408-4942-b7f3-3bfde787ba33 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:15.037998 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddfd8f-c408-4942-b7f3-3bfde787ba33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:15.056585 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-f1ddfd8f-c408-4942-b7f3-3bfde787ba33 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:15.057782 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-f1ddfd8f-c408-4942-b7f3-3bfde787ba33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:15.065920 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 719/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 20:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:42:15.218774 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b72b6e-913e-4b3d-bc80-07a12795879e None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:15.240860 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b72b6e-913e-4b3d-bc80-07a12795879e None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:15.247752 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e68ce-5570-48d0-b6aa-1830bd12e46f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:15.248618 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e68ce-5570-48d0-b6aa-1830bd12e46f service nova] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:15.249106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e68ce-5570-48d0-b6aa-1830bd12e46f service nova] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:15.249622 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e68ce-5570-48d0-b6aa-1830bd12e46f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:15.261292 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e68ce-5570-48d0-b6aa-1830bd12e46f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:15.263013 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e68ce-5570-48d0-b6aa-1830bd12e46f service nova] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:15.273333 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 712/1431] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:42:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:42:16.082780 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f29d4-d99e-4357-aeed-425dc624a5d3 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:16.083472 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f29d4-d99e-4357-aeed-425dc624a5d3 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:16.083472 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f29d4-d99e-4357-aeed-425dc624a5d3 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:16.085484 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 720/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 20:42:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:16.092735 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2b65d-fc7d-4137-9669-ab5ab6fcfedd None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:16.093228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2b65d-fc7d-4137-9669-ab5ab6fcfedd None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:16.093330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2b65d-fc7d-4137-9669-ab5ab6fcfedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:16.112942 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-22b2b65d-fc7d-4137-9669-ab5ab6fcfedd None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:16.114166 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-22b2b65d-fc7d-4137-9669-ab5ab6fcfedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:16.122602 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 713/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 20:42:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:42:16.273515 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f29d4-d99e-4357-aeed-425dc624a5d3 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:16.293506 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f29d4-d99e-4357-aeed-425dc624a5d3 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:16.303434 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4f4c2-3977-46e0-9ac6-a44f8ab5a89c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:16.304282 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4f4c2-3977-46e0-9ac6-a44f8ab5a89c service nova] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:16.304660 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4f4c2-3977-46e0-9ac6-a44f8ab5a89c service nova] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:16.304962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4f4c2-3977-46e0-9ac6-a44f8ab5a89c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:16.316104 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4f4c2-3977-46e0-9ac6-a44f8ab5a89c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:16.317704 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4f4c2-3977-46e0-9ac6-a44f8ab5a89c service nova] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:16.328024 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 721/1434] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:42:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:42:17.139369 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e49275-fff7-40b6-b227-f799eb0e2c0d None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:17.139901 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e49275-fff7-40b6-b227-f799eb0e2c0d None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:17.140004 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e49275-fff7-40b6-b227-f799eb0e2c0d None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:17.141395 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 714/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 20:42:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:17.147980 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceabbf12-b540-4e0a-8c57-83f7e12560e2 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:17.148425 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceabbf12-b540-4e0a-8c57-83f7e12560e2 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:17.148535 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceabbf12-b540-4e0a-8c57-83f7e12560e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:17.174181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-ceabbf12-b540-4e0a-8c57-83f7e12560e2 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:17.175405 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-ceabbf12-b540-4e0a-8c57-83f7e12560e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:17.184721 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 722/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 20:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:42:17.336966 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e49275-fff7-40b6-b227-f799eb0e2c0d None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:17.353824 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e49275-fff7-40b6-b227-f799eb0e2c0d None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:17.360178 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2be0cf-791e-45a3-9fc3-ba9eda20917c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:17.360813 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2be0cf-791e-45a3-9fc3-ba9eda20917c service nova] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:17.361060 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2be0cf-791e-45a3-9fc3-ba9eda20917c service nova] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:17.361355 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2be0cf-791e-45a3-9fc3-ba9eda20917c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:17.371895 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2be0cf-791e-45a3-9fc3-ba9eda20917c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:17.374771 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2be0cf-791e-45a3-9fc3-ba9eda20917c service nova] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:17.386632 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 715/1437] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:42:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:42:18.181170 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e211f-ed6b-48a3-acef-638732839e01 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:18.181728 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e211f-ed6b-48a3-acef-638732839e01 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:18.181728 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e211f-ed6b-48a3-acef-638732839e01 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:18.183125 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 723/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 20:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:18.188284 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e609559-e4f4-436e-a126-ac4f1d399bdc None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:18.188730 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e609559-e4f4-436e-a126-ac4f1d399bdc None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:18.188840 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e609559-e4f4-436e-a126-ac4f1d399bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:18.208478 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-5e609559-e4f4-436e-a126-ac4f1d399bdc None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:18.209689 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-5e609559-e4f4-436e-a126-ac4f1d399bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:18.219659 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 716/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 20:42:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:42:18.374824 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e211f-ed6b-48a3-acef-638732839e01 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:18.389870 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e211f-ed6b-48a3-acef-638732839e01 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:18.395903 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464a1c9-23e1-4f64-ab9b-d948c27f94bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:18.396545 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464a1c9-23e1-4f64-ab9b-d948c27f94bc service nova] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:18.396804 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464a1c9-23e1-4f64-ab9b-d948c27f94bc service nova] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:18.397089 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464a1c9-23e1-4f64-ab9b-d948c27f94bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:18.407538 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a464a1c9-23e1-4f64-ab9b-d948c27f94bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:18.409909 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a464a1c9-23e1-4f64-ab9b-d948c27f94bc service nova] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:18.420496 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 724/1440] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:42:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:42:20.337577 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab58981-6aef-4794-919b-b98121adc25d None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:20.338501 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab58981-6aef-4794-919b-b98121adc25d None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:20.338501 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab58981-6aef-4794-919b-b98121adc25d None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:20.341157 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 717/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 20:42:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:20.350077 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54cf4e-0ea2-4ef7-98d1-2dc5bdaa5145 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:20.350546 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54cf4e-0ea2-4ef7-98d1-2dc5bdaa5145 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:20.350655 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54cf4e-0ea2-4ef7-98d1-2dc5bdaa5145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:20.371606 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-af54cf4e-0ea2-4ef7-98d1-2dc5bdaa5145 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:20.372811 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-af54cf4e-0ea2-4ef7-98d1-2dc5bdaa5145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:20.382323 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 725/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 20:42:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:42:20.423193 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab58981-6aef-4794-919b-b98121adc25d None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:20.425716 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-4ab58981-6aef-4794-919b-b98121adc25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:20.447210 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab58981-6aef-4794-919b-b98121adc25d None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:20.452369 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d259572-2218-4aa2-bc85-5605eec59d65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:20.453058 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d259572-2218-4aa2-bc85-5605eec59d65 service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:20.453343 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d259572-2218-4aa2-bc85-5605eec59d65 service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:20.453586 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d259572-2218-4aa2-bc85-5605eec59d65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:20.463443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d259572-2218-4aa2-bc85-5605eec59d65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:20.464918 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d259572-2218-4aa2-bc85-5605eec59d65 service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:20.474949 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 718/1443] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:42:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:42:22.643301 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5977a13-9a12-431c-861a-e5803fcc5f63 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:22.643935 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5977a13-9a12-431c-861a-e5803fcc5f63 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:22.643935 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5977a13-9a12-431c-861a-e5803fcc5f63 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:22.645256 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 726/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 20:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:22.650889 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79773677-74b4-4e25-bc7c-9d10f1ae2e15 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:22.651343 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79773677-74b4-4e25-bc7c-9d10f1ae2e15 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:22.651452 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79773677-74b4-4e25-bc7c-9d10f1ae2e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:22.671295 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-79773677-74b4-4e25-bc7c-9d10f1ae2e15 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:22.672485 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-79773677-74b4-4e25-bc7c-9d10f1ae2e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:22.680762 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 719/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 20:42:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:42:22.717970 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5977a13-9a12-431c-861a-e5803fcc5f63 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:22.730623 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5977a13-9a12-431c-861a-e5803fcc5f63 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:22.734954 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195c465-5f9f-44fa-b1db-b30207d84a6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:22.735590 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195c465-5f9f-44fa-b1db-b30207d84a6b service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:22.735892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195c465-5f9f-44fa-b1db-b30207d84a6b service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:22.736118 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195c465-5f9f-44fa-b1db-b30207d84a6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:22.745452 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6195c465-5f9f-44fa-b1db-b30207d84a6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:22.747305 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6195c465-5f9f-44fa-b1db-b30207d84a6b service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:22.759535 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 727/1446] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:42:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:42:25.134494 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e6a0d-3b4c-4e2d-adce-5ce60c0882da None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:25.135454 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e6a0d-3b4c-4e2d-adce-5ce60c0882da None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:25.135454 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e6a0d-3b4c-4e2d-adce-5ce60c0882da None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:25.137547 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 720/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 20:42:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:25.146374 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97715a-0ff3-42e7-8d35-3bc21efaf86e None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:25.146818 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97715a-0ff3-42e7-8d35-3bc21efaf86e None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:25.146939 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97715a-0ff3-42e7-8d35-3bc21efaf86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:25.167974 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-ef97715a-0ff3-42e7-8d35-3bc21efaf86e None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:25.169171 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-ef97715a-0ff3-42e7-8d35-3bc21efaf86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:25.178186 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 728/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 20:42:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:42:25.216607 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e6a0d-3b4c-4e2d-adce-5ce60c0882da None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:25.229531 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e6a0d-3b4c-4e2d-adce-5ce60c0882da None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:25.234015 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46515f-a845-4d2c-a824-5012bd8924e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:25.234663 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46515f-a845-4d2c-a824-5012bd8924e4 service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:25.234941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46515f-a845-4d2c-a824-5012bd8924e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:25.235214 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46515f-a845-4d2c-a824-5012bd8924e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:25.244409 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c46515f-a845-4d2c-a824-5012bd8924e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:25.245874 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c46515f-a845-4d2c-a824-5012bd8924e4 service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:25.255298 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 721/1449] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:42:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:42:27.496094 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62f7c4-daa9-4097-9b30-98731abee7de None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:27.496730 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62f7c4-daa9-4097-9b30-98731abee7de None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:27.496730 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62f7c4-daa9-4097-9b30-98731abee7de None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:27.498143 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 729/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 20:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:27.504433 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bd851-d21a-4643-883f-b87c116cac39 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:27.505248 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bd851-d21a-4643-883f-b87c116cac39 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:27.505463 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bd851-d21a-4643-883f-b87c116cac39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:27.532141 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-6f5bd851-d21a-4643-883f-b87c116cac39 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:27.533336 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-6f5bd851-d21a-4643-883f-b87c116cac39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:27.542051 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 722/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 20:42:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:42:27.582845 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62f7c4-daa9-4097-9b30-98731abee7de None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:27.594629 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62f7c4-daa9-4097-9b30-98731abee7de None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:27.598529 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d54fda-e673-425c-9b2a-0eed49b9e7e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:27.599164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d54fda-e673-425c-9b2a-0eed49b9e7e0 service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:27.599442 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d54fda-e673-425c-9b2a-0eed49b9e7e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:27.599717 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d54fda-e673-425c-9b2a-0eed49b9e7e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:27.609053 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d54fda-e673-425c-9b2a-0eed49b9e7e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:27.610531 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d54fda-e673-425c-9b2a-0eed49b9e7e0 service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:27.620070 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 730/1452] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:42:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:42:29.760769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bdda31-c29b-475b-a2da-843aaa857724 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:29.761315 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bdda31-c29b-475b-a2da-843aaa857724 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:29.761315 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bdda31-c29b-475b-a2da-843aaa857724 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:29.763414 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 723/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 20:42:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:29.772301 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad27638-ff3b-4724-a2e0-4edc80f4468a None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:29.772706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad27638-ff3b-4724-a2e0-4edc80f4468a None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:29.772913 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad27638-ff3b-4724-a2e0-4edc80f4468a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:29.792742 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-fad27638-ff3b-4724-a2e0-4edc80f4468a None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:29.794053 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-fad27638-ff3b-4724-a2e0-4edc80f4468a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:29.802502 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 731/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 20:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:42:29.844157 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bdda31-c29b-475b-a2da-843aaa857724 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:29.860720 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bdda31-c29b-475b-a2da-843aaa857724 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:29.865625 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735b6b9-7b96-48d6-a585-16b33a410576 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:29.866286 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735b6b9-7b96-48d6-a585-16b33a410576 service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:29.866561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735b6b9-7b96-48d6-a585-16b33a410576 service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:29.866827 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735b6b9-7b96-48d6-a585-16b33a410576 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:29.876546 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735b6b9-7b96-48d6-a585-16b33a410576 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:29.878021 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735b6b9-7b96-48d6-a585-16b33a410576 service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:29.888400 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 724/1455] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:42:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:42:31.975401 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20de9b-2600-463e-84ed-0c9bb00e23dd None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:31.976276 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20de9b-2600-463e-84ed-0c9bb00e23dd None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:31.976276 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20de9b-2600-463e-84ed-0c9bb00e23dd None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:31.978556 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 732/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 20:42:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:31.984252 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01fc57-9b64-4ee7-adf3-539b6bdcf466 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:31.984716 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01fc57-9b64-4ee7-adf3-539b6bdcf466 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:31.984817 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01fc57-9b64-4ee7-adf3-539b6bdcf466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:32.004176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-3d01fc57-9b64-4ee7-adf3-539b6bdcf466 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:32.005377 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-3d01fc57-9b64-4ee7-adf3-539b6bdcf466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:32.013858 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 725/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 20:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:42:32.054759 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20de9b-2600-463e-84ed-0c9bb00e23dd None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:32.072966 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20de9b-2600-463e-84ed-0c9bb00e23dd None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:32.078221 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac978146-78fc-41d9-a44f-b277b9826470 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:32.078904 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac978146-78fc-41d9-a44f-b277b9826470 service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:32.079253 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac978146-78fc-41d9-a44f-b277b9826470 service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:32.079526 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac978146-78fc-41d9-a44f-b277b9826470 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:32.089528 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac978146-78fc-41d9-a44f-b277b9826470 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:32.091015 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac978146-78fc-41d9-a44f-b277b9826470 service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:32.100696 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 733/1458] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:42:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:42:34.172052 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03be0c-eb8e-41d6-8fdb-473bac29ebb3 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:34.172821 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03be0c-eb8e-41d6-8fdb-473bac29ebb3 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:34.172931 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03be0c-eb8e-41d6-8fdb-473bac29ebb3 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:34.174983 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 726/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 20:42:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:34.181079 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5046f5-c6dd-40ef-9a37-d6fdbe1caadd None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:34.181534 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5046f5-c6dd-40ef-9a37-d6fdbe1caadd None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:34.181630 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5046f5-c6dd-40ef-9a37-d6fdbe1caadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:34.201794 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-df5046f5-c6dd-40ef-9a37-d6fdbe1caadd None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:34.203036 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-df5046f5-c6dd-40ef-9a37-d6fdbe1caadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:34.212041 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 734/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 20:42:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:42:34.251002 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03be0c-eb8e-41d6-8fdb-473bac29ebb3 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:34.263912 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03be0c-eb8e-41d6-8fdb-473bac29ebb3 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:34.268734 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3fb8d-9d97-4b24-85f1-0e086488c263 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:34.269385 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3fb8d-9d97-4b24-85f1-0e086488c263 service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:34.269668 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3fb8d-9d97-4b24-85f1-0e086488c263 service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:34.269975 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3fb8d-9d97-4b24-85f1-0e086488c263 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:34.279401 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3fb8d-9d97-4b24-85f1-0e086488c263 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:34.280850 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3fb8d-9d97-4b24-85f1-0e086488c263 service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:34.290171 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 727/1461] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:42:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:42:36.371600 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdaa78a-d8eb-4977-9072-7ff5b8146e6c None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:36.372382 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdaa78a-d8eb-4977-9072-7ff5b8146e6c None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:36.372382 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdaa78a-d8eb-4977-9072-7ff5b8146e6c None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:36.373867 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 735/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 20:42:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:36.379407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773aa72-59ab-4811-a2d5-cd040b270f5f None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:36.379857 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773aa72-59ab-4811-a2d5-cd040b270f5f None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:36.379976 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773aa72-59ab-4811-a2d5-cd040b270f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:36.389257 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=79 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:36.407399 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-e773aa72-59ab-4811-a2d5-cd040b270f5f None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:36.408551 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-e773aa72-59ab-4811-a2d5-cd040b270f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:36.417492 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 728/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 20:42:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:42:36.454885 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdaa78a-d8eb-4977-9072-7ff5b8146e6c None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:36.461145 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=73 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:36.468329 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdaa78a-d8eb-4977-9072-7ff5b8146e6c None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:36.472350 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c31151-001e-4517-898e-aba6c9f3b03b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:36.472994 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c31151-001e-4517-898e-aba6c9f3b03b service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:36.473274 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c31151-001e-4517-898e-aba6c9f3b03b service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:36.473545 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c31151-001e-4517-898e-aba6c9f3b03b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:36.482867 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c31151-001e-4517-898e-aba6c9f3b03b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:36.484315 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c31151-001e-4517-898e-aba6c9f3b03b service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:36.493723 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 736/1464] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:42:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:42:38.538654 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce4798-3d7b-41c7-a3d6-bbc8a1c26e1e None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:38.539238 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce4798-3d7b-41c7-a3d6-bbc8a1c26e1e None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:38.539238 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce4798-3d7b-41c7-a3d6-bbc8a1c26e1e None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:38.540498 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 729/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 20:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:38.547334 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982e83b-2bc6-4730-8f68-08e507810df4 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:38.548068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982e83b-2bc6-4730-8f68-08e507810df4 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:38.548219 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982e83b-2bc6-4730-8f68-08e507810df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:38.571737 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-5982e83b-2bc6-4730-8f68-08e507810df4 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:38.573110 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-5982e83b-2bc6-4730-8f68-08e507810df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:38.582690 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 737/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 20:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:42:38.624959 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce4798-3d7b-41c7-a3d6-bbc8a1c26e1e None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:38.644272 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce4798-3d7b-41c7-a3d6-bbc8a1c26e1e None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:38.651382 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e2f5f-fefa-4292-a876-db436c21ee4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:38.652295 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e2f5f-fefa-4292-a876-db436c21ee4b service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:38.652572 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e2f5f-fefa-4292-a876-db436c21ee4b service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:38.652909 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e2f5f-fefa-4292-a876-db436c21ee4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:38.662942 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e2f5f-fefa-4292-a876-db436c21ee4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:38.664390 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e2f5f-fefa-4292-a876-db436c21ee4b service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:38.674178 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 730/1467] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:42:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:42:40.685463 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03261a-bd72-40f9-add6-15f6b6e487d7 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:40.686126 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03261a-bd72-40f9-add6-15f6b6e487d7 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:40.686126 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03261a-bd72-40f9-add6-15f6b6e487d7 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:40.687479 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 738/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 20:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:42:40.693010 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714ca43-c775-4615-9665-2106a66e716b None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:40.693461 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714ca43-c775-4615-9665-2106a66e716b None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:40.693556 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714ca43-c775-4615-9665-2106a66e716b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:40.712365 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-e714ca43-c775-4615-9665-2106a66e716b None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:42:40.713551 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-e714ca43-c775-4615-9665-2106a66e716b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:42:40.722280 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 731/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 20:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:42:40.761583 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03261a-bd72-40f9-add6-15f6b6e487d7 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:42:40.774663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03261a-bd72-40f9-add6-15f6b6e487d7 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:42:40.779114 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61af30-2c0a-47f7-971f-8315c8870207 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:42:40.779751 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61af30-2c0a-47f7-971f-8315c8870207 service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:42:40.780030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61af30-2c0a-47f7-971f-8315c8870207 service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:42:40.780304 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61af30-2c0a-47f7-971f-8315c8870207 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:42:40.789434 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a61af30-2c0a-47f7-971f-8315c8870207 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:42:40.790897 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a61af30-2c0a-47f7-971f-8315c8870207 service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:42:40.800506 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 739/1470] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:42:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:42:50.707148 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=11 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:42:50.796541 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=14 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:00.321138 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644980a3-8176-41de-9ec7-a81a510d5c87 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:00.322055 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644980a3-8176-41de-9ec7-a81a510d5c87 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:00.322055 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644980a3-8176-41de-9ec7-a81a510d5c87 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:00.324296 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 732/1471] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:43:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:43:00.330477 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c288f6-01f2-481e-9fb9-677c3a9e40d0 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:00.330918 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c288f6-01f2-481e-9fb9-677c3a9e40d0 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:00.331033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c288f6-01f2-481e-9fb9-677c3a9e40d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:00.353033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-77c288f6-01f2-481e-9fb9-677c3a9e40d0 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:43:00.354268 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-77c288f6-01f2-481e-9fb9-677c3a9e40d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:43:00.363293 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 740/1472] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:43:00.449670 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135a135-61a1-4c12-ace2-e8850fab4d78 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:00.450159 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135a135-61a1-4c12-ace2-e8850fab4d78 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:00.450650 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135a135-61a1-4c12-ace2-e8850fab4d78 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:00.452945 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 733/1473] 10.222.0.27 () {54 vars in 962 bytes} [Tue Jul 5 20:43:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:43:00.458110 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1d948-3b8a-4a3f-93e7-c2060c2236d9 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:00.458387 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1d948-3b8a-4a3f-93e7-c2060c2236d9 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:00.458657 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1d948-3b8a-4a3f-93e7-c2060c2236d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:00.477168 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-ebb1d948-3b8a-4a3f-93e7-c2060c2236d9 None None] MFA Rules not processed for user `a05f331339d143c09eaa12efe2b80653`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:43:00.478381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-ebb1d948-3b8a-4a3f-93e7-c2060c2236d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:43:00.487928 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 741/1474] 10.222.0.27 () {58 vars in 1059 bytes} [Tue Jul 5 20:43:00 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:43:00.495264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135a135-61a1-4c12-ace2-e8850fab4d78 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:00.507778 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135a135-61a1-4c12-ace2-e8850fab4d78 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:00.512574 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30843c18-9743-4582-b7b7-8e276b73a888 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05f331339d143c09eaa12efe2b80653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:00.513216 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30843c18-9743-4582-b7b7-8e276b73a888 service glance] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:00.513503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30843c18-9743-4582-b7b7-8e276b73a888 service glance] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:00.513781 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30843c18-9743-4582-b7b7-8e276b73a888 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:00.526481 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30843c18-9743-4582-b7b7-8e276b73a888 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:00.528524 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30843c18-9743-4582-b7b7-8e276b73a888 service glance] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:00.539248 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 734/1475] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:43:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:43:02.652221 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd182db-ab83-4450-8a64-a6ecbb10220e None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:02.652791 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd182db-ab83-4450-8a64-a6ecbb10220e None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:02.652791 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd182db-ab83-4450-8a64-a6ecbb10220e None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:02.654170 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 742/1476] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:43:02.659834 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc07bc0-ba48-4aa5-afb7-1cc675a6ca71 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:02.660294 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc07bc0-ba48-4aa5-afb7-1cc675a6ca71 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:02.660405 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc07bc0-ba48-4aa5-afb7-1cc675a6ca71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:02.680633 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-1cc07bc0-ba48-4aa5-afb7-1cc675a6ca71 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:43:02.681868 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-1cc07bc0-ba48-4aa5-afb7-1cc675a6ca71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:43:02.691248 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 735/1477] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:43:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:43:02.715324 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd182db-ab83-4450-8a64-a6ecbb10220e None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:02.730353 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd182db-ab83-4450-8a64-a6ecbb10220e None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:02.736313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375fe71-793e-4baa-8a14-9c80b54d1b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:02.736983 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375fe71-793e-4baa-8a14-9c80b54d1b87 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:02.737262 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375fe71-793e-4baa-8a14-9c80b54d1b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:02.737549 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375fe71-793e-4baa-8a14-9c80b54d1b87 admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:02.738337 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375fe71-793e-4baa-8a14-9c80b54d1b87 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:02.740177 dv-cinder-797608-49-smb devstack@keystone.service[87152]: WARNING py.warnings [None req-9375fe71-793e-4baa-8a14-9c80b54d1b87 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 20:43:02.740177 dv-cinder-797608-49-smb devstack@keystone.service[87152]: warnings.warn(msg) Jul 05 20:43:02.740177 dv-cinder-797608-49-smb devstack@keystone.service[87152]: Jul 05 20:43:02.741338 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375fe71-793e-4baa-8a14-9c80b54d1b87 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:02.761140 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 743/1478] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 5 20:43:02 2022] GET /identity/v3/projects => generated 2553 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:43:04.775895 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57958c2d-865a-4ac7-9215-663eb2b5bf91 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:04.776509 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57958c2d-865a-4ac7-9215-663eb2b5bf91 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:04.776509 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57958c2d-865a-4ac7-9215-663eb2b5bf91 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:04.777828 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 736/1479] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:43:04.787288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e7cda-c55a-4dae-b7f9-45bee5bd2c76 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:04.787744 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e7cda-c55a-4dae-b7f9-45bee5bd2c76 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:04.787858 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e7cda-c55a-4dae-b7f9-45bee5bd2c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:04.810487 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-747e7cda-c55a-4dae-b7f9-45bee5bd2c76 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:43:04.811696 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-747e7cda-c55a-4dae-b7f9-45bee5bd2c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:43:04.820511 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 744/1480] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:43:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:43:04.865834 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57958c2d-865a-4ac7-9215-663eb2b5bf91 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:04.882379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57958c2d-865a-4ac7-9215-663eb2b5bf91 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:04.888406 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9f86e-e06e-465f-8277-1e9df6894ddb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:04.889051 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9f86e-e06e-465f-8277-1e9df6894ddb service nova] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:04.889362 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9f86e-e06e-465f-8277-1e9df6894ddb service nova] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:04.889641 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9f86e-e06e-465f-8277-1e9df6894ddb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:04.898089 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c9f86e-e06e-465f-8277-1e9df6894ddb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:04.899689 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c9f86e-e06e-465f-8277-1e9df6894ddb service nova] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:04.908872 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 737/1481] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:43:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:43:07.107942 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa21e34-7898-43c1-9f14-dce451a48141 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:07.108821 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa21e34-7898-43c1-9f14-dce451a48141 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:07.109167 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa21e34-7898-43c1-9f14-dce451a48141 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:07.110598 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 745/1482] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:43:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:43:07.115945 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd503dc-c47a-4819-92f9-1168a01a4eab None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:07.116388 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd503dc-c47a-4819-92f9-1168a01a4eab None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:07.116483 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd503dc-c47a-4819-92f9-1168a01a4eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:07.135461 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-8cd503dc-c47a-4819-92f9-1168a01a4eab None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:43:07.136642 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-8cd503dc-c47a-4819-92f9-1168a01a4eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:43:07.145177 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 738/1483] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:43:07.181101 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa21e34-7898-43c1-9f14-dce451a48141 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:07.193826 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa21e34-7898-43c1-9f14-dce451a48141 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:07.198275 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59506e-83c5-4aba-a8fe-81d51fe9ecf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:07.198912 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59506e-83c5-4aba-a8fe-81d51fe9ecf6 service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:07.199195 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59506e-83c5-4aba-a8fe-81d51fe9ecf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:07.199470 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59506e-83c5-4aba-a8fe-81d51fe9ecf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:07.209217 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59506e-83c5-4aba-a8fe-81d51fe9ecf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:07.210691 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59506e-83c5-4aba-a8fe-81d51fe9ecf6 service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:07.220313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 746/1484] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:43:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:43:09.278090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1326d7-45ab-498b-b960-8ed7de42b916 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:09.278674 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1326d7-45ab-498b-b960-8ed7de42b916 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:09.278674 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1326d7-45ab-498b-b960-8ed7de42b916 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:09.280033 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 739/1485] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:43:09.285672 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c24565-c35e-4624-89a6-c9ab3f49d846 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:09.286132 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c24565-c35e-4624-89a6-c9ab3f49d846 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:09.286250 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c24565-c35e-4624-89a6-c9ab3f49d846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:09.305927 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-68c24565-c35e-4624-89a6-c9ab3f49d846 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:43:09.307113 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-68c24565-c35e-4624-89a6-c9ab3f49d846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:43:09.315462 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 747/1486] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:43:09.356009 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1326d7-45ab-498b-b960-8ed7de42b916 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:09.374133 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1326d7-45ab-498b-b960-8ed7de42b916 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:09.378690 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09397d-cff6-4421-9d86-5be05497a446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:09.379345 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09397d-cff6-4421-9d86-5be05497a446 service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:09.379625 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09397d-cff6-4421-9d86-5be05497a446 service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:09.379898 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09397d-cff6-4421-9d86-5be05497a446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:09.390682 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09397d-cff6-4421-9d86-5be05497a446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:09.392115 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09397d-cff6-4421-9d86-5be05497a446 service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:09.401590 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 740/1487] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:43:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:43:11.564394 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21fc6f-dc2a-4161-938c-35582b9a0cd1 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:11.564923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21fc6f-dc2a-4161-938c-35582b9a0cd1 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:11.564923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21fc6f-dc2a-4161-938c-35582b9a0cd1 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:11.566946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 748/1488] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:43:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:43:11.575668 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187c090-ce88-4071-aa4b-03ba82841ae6 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:11.576090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187c090-ce88-4071-aa4b-03ba82841ae6 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:11.576267 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187c090-ce88-4071-aa4b-03ba82841ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:11.595960 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-d187c090-ce88-4071-aa4b-03ba82841ae6 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:43:11.597169 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-d187c090-ce88-4071-aa4b-03ba82841ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:43:11.606476 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 741/1489] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:43:11.646801 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21fc6f-dc2a-4161-938c-35582b9a0cd1 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:11.663362 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21fc6f-dc2a-4161-938c-35582b9a0cd1 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:11.667390 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d39c5-3d2e-4997-b80b-54191dff7051 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:11.668047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d39c5-3d2e-4997-b80b-54191dff7051 service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:11.668322 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d39c5-3d2e-4997-b80b-54191dff7051 service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:11.668626 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d39c5-3d2e-4997-b80b-54191dff7051 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:11.678479 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d39c5-3d2e-4997-b80b-54191dff7051 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:11.679921 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d39c5-3d2e-4997-b80b-54191dff7051 service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:11.689417 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 749/1490] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:43:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:43:13.866695 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f7c12-844c-4881-96b6-3a136b932344 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:13.867300 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f7c12-844c-4881-96b6-3a136b932344 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:13.867300 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f7c12-844c-4881-96b6-3a136b932344 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:13.868622 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 742/1491] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 5 20:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:43:13.878441 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38814d-7894-4248-9bcc-740da1dcf8d7 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:13.879186 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38814d-7894-4248-9bcc-740da1dcf8d7 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:13.879336 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38814d-7894-4248-9bcc-740da1dcf8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:13.904208 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-bd38814d-7894-4248-9bcc-740da1dcf8d7 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:43:13.908024 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-bd38814d-7894-4248-9bcc-740da1dcf8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:43:13.917387 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 750/1492] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 5 20:43:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:43:13.955816 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f7c12-844c-4881-96b6-3a136b932344 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:43:13.968823 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f7c12-844c-4881-96b6-3a136b932344 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:43:13.972567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9f4ff-73d8-414b-9a69-45a721592e29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:43:13.973213 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9f4ff-73d8-414b-9a69-45a721592e29 service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:43:13.973494 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9f4ff-73d8-414b-9a69-45a721592e29 service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:43:13.973766 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9f4ff-73d8-414b-9a69-45a721592e29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:43:13.983784 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c9f4ff-73d8-414b-9a69-45a721592e29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:43:13.985330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c9f4ff-73d8-414b-9a69-45a721592e29 service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:43:13.995064 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 743/1493] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:43:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:43:23.896120 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=33 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:43:23.990901 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=33 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:44:46.288470 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce8410-fe68-46c0-8357-506f0af9793a None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:46.289434 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce8410-fe68-46c0-8357-506f0af9793a None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:46.289434 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce8410-fe68-46c0-8357-506f0af9793a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:46.318449 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-15ce8410-fe68-46c0-8357-506f0af9793a None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:44:46.319666 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-15ce8410-fe68-46c0-8357-506f0af9793a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:44:46.331117 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 751/1494] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:44:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:44:46.343240 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdf0f9-3822-4a90-bcc0-bdade0f70949 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:46.343755 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdf0f9-3822-4a90-bcc0-bdade0f70949 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:46.343755 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdf0f9-3822-4a90-bcc0-bdade0f70949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:46.363816 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-c3bdf0f9-3822-4a90-bcc0-bdade0f70949 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:44:46.365000 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-c3bdf0f9-3822-4a90-bcc0-bdade0f70949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:44:46.374631 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 744/1495] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:44:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:44:46.379985 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce8410-fe68-46c0-8357-506f0af9793a None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:46.395171 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce8410-fe68-46c0-8357-506f0af9793a None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:46.403453 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e64b3-5a0a-4788-bc67-1d97274ce198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:46.404137 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e64b3-5a0a-4788-bc67-1d97274ce198 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:46.404416 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e64b3-5a0a-4788-bc67-1d97274ce198 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:46.404683 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e64b3-5a0a-4788-bc67-1d97274ce198 admin admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:46.405406 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e64b3-5a0a-4788-bc67-1d97274ce198 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:44:46.405716 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e64b3-5a0a-4788-bc67-1d97274ce198 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:46.406794 dv-cinder-797608-49-smb devstack@keystone.service[87152]: WARNING py.warnings [None req-0e7e64b3-5a0a-4788-bc67-1d97274ce198 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 20:44:46.406794 dv-cinder-797608-49-smb devstack@keystone.service[87152]: warnings.warn(msg) Jul 05 20:44:46.406794 dv-cinder-797608-49-smb devstack@keystone.service[87152]: Jul 05 20:44:46.407692 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e64b3-5a0a-4788-bc67-1d97274ce198 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:46.420600 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 752/1496] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:44:46.428971 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdf0f9-3822-4a90-bcc0-bdade0f70949 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:46.438773 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdf0f9-3822-4a90-bcc0-bdade0f70949 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:46.448140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec4611-f48d-4bfd-8d38-6ce4ffe3b973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:46.448800 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec4611-f48d-4bfd-8d38-6ce4ffe3b973 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:46.449073 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec4611-f48d-4bfd-8d38-6ce4ffe3b973 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:46.449340 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec4611-f48d-4bfd-8d38-6ce4ffe3b973 admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:46.450061 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec4611-f48d-4bfd-8d38-6ce4ffe3b973 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:46.451879 dv-cinder-797608-49-smb devstack@keystone.service[87151]: WARNING py.warnings [None req-5dec4611-f48d-4bfd-8d38-6ce4ffe3b973 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 20:44:46.451879 dv-cinder-797608-49-smb devstack@keystone.service[87151]: warnings.warn(msg) Jul 05 20:44:46.451879 dv-cinder-797608-49-smb devstack@keystone.service[87151]: Jul 05 20:44:46.453092 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec4611-f48d-4bfd-8d38-6ce4ffe3b973 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:46.495966 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 745/1497] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:44:46 2022] POST /identity/v3/projects => generated 377 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:44:46.500338 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e64b3-5a0a-4788-bc67-1d97274ce198 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:46.510798 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e64b3-5a0a-4788-bc67-1d97274ce198 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:46.578525 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb27313-692a-4833-9056-f4f65066a957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:46.579195 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb27313-692a-4833-9056-f4f65066a957 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:46.579476 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb27313-692a-4833-9056-f4f65066a957 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:46.579750 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb27313-692a-4833-9056-f4f65066a957 admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:46.580441 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb27313-692a-4833-9056-f4f65066a957 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:46.581470 dv-cinder-797608-49-smb devstack@keystone.service[87152]: WARNING py.warnings [None req-4fb27313-692a-4833-9056-f4f65066a957 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 20:44:46.581470 dv-cinder-797608-49-smb devstack@keystone.service[87152]: warnings.warn(msg) Jul 05 20:44:46.581470 dv-cinder-797608-49-smb devstack@keystone.service[87152]: Jul 05 20:44:46.582718 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb27313-692a-4833-9056-f4f65066a957 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:46.603776 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 753/1498] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:44:46 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:44:46.608085 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec4611-f48d-4bfd-8d38-6ce4ffe3b973 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:46.618423 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec4611-f48d-4bfd-8d38-6ce4ffe3b973 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:46.624029 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bdecf-2b92-4b7e-8d43-8857cc4ce330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:46.624683 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bdecf-2b92-4b7e-8d43-8857cc4ce330 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:46.624962 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bdecf-2b92-4b7e-8d43-8857cc4ce330 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:46.625231 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bdecf-2b92-4b7e-8d43-8857cc4ce330 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:46.625986 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739bdecf-2b92-4b7e-8d43-8857cc4ce330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:46.627007 dv-cinder-797608-49-smb devstack@keystone.service[87151]: WARNING py.warnings [None req-739bdecf-2b92-4b7e-8d43-8857cc4ce330 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 20:44:46.627007 dv-cinder-797608-49-smb devstack@keystone.service[87151]: warnings.warn(msg) Jul 05 20:44:46.627007 dv-cinder-797608-49-smb devstack@keystone.service[87151]: Jul 05 20:44:46.627926 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739bdecf-2b92-4b7e-8d43-8857cc4ce330 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:46.640882 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 746/1499] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:44:46.645720 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb27313-692a-4833-9056-f4f65066a957 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:46.658031 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb27313-692a-4833-9056-f4f65066a957 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:46.666033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03883510-e483-454b-b3fa-eb4dfd7fdf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:46.666819 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03883510-e483-454b-b3fa-eb4dfd7fdf9c admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:46.667180 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03883510-e483-454b-b3fa-eb4dfd7fdf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:46.667575 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03883510-e483-454b-b3fa-eb4dfd7fdf9c admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:46.668717 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03883510-e483-454b-b3fa-eb4dfd7fdf9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:46.670672 dv-cinder-797608-49-smb devstack@keystone.service[87152]: WARNING py.warnings [None req-03883510-e483-454b-b3fa-eb4dfd7fdf9c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 20:44:46.670672 dv-cinder-797608-49-smb devstack@keystone.service[87152]: warnings.warn(msg) Jul 05 20:44:46.670672 dv-cinder-797608-49-smb devstack@keystone.service[87152]: Jul 05 20:44:46.671624 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03883510-e483-454b-b3fa-eb4dfd7fdf9c admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:46.686029 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 754/1500] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:44:46.690407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bdecf-2b92-4b7e-8d43-8857cc4ce330 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:46.700314 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bdecf-2b92-4b7e-8d43-8857cc4ce330 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:46.704995 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7632cd39-ae0c-44e1-9446-18248b43ae7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:46.705908 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632cd39-ae0c-44e1-9446-18248b43ae7b admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:46.706184 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632cd39-ae0c-44e1-9446-18248b43ae7b admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:46.706453 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632cd39-ae0c-44e1-9446-18248b43ae7b admin admin] PATH_INFO: `/v3/projects/f89b9621ccaa4135ab797dc48d49a155/users/b29b393ad6e54d998a873d62ecd2a956/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:46.723949 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7632cd39-ae0c-44e1-9446-18248b43ae7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f89b9621ccaa4135ab797dc48d49a155, user_id=b29b393ad6e54d998a873d62ecd2a956, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:46.725017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: WARNING py.warnings [None req-7632cd39-ae0c-44e1-9446-18248b43ae7b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 20:44:46.725017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: warnings.warn(msg) Jul 05 20:44:46.725017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: Jul 05 20:44:46.727212 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7632cd39-ae0c-44e1-9446-18248b43ae7b admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:46.748309 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 747/1501] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:44:46 2022] PUT /identity/v3/projects/f89b9621ccaa4135ab797dc48d49a155/users/b29b393ad6e54d998a873d62ecd2a956/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:44:46.764519 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f78559-59f6-491c-a79b-f8eb37c453aa None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:46.764791 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f78559-59f6-491c-a79b-f8eb37c453aa None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:46.765088 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f78559-59f6-491c-a79b-f8eb37c453aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:46.794256 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-26f78559-59f6-491c-a79b-f8eb37c453aa None None] MFA Rules not processed for user `b29b393ad6e54d998a873d62ecd2a956`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:44:46.795833 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-26f78559-59f6-491c-a79b-f8eb37c453aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:44:46.860407 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 755/1502] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:44:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:44:46.879077 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4766b-8589-4aa5-9427-b6db547e69b3 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:46.879465 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4766b-8589-4aa5-9427-b6db547e69b3 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:46.879867 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4766b-8589-4aa5-9427-b6db547e69b3 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:46.882065 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 748/1503] 10.222.0.27 () {54 vars in 963 bytes} [Tue Jul 5 20:44:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:44:46.888717 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd11ff2-0878-4970-802c-508e553ce05b None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:46.889003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd11ff2-0878-4970-802c-508e553ce05b None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:46.889277 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd11ff2-0878-4970-802c-508e553ce05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:46.909827 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-1dd11ff2-0878-4970-802c-508e553ce05b None None] MFA Rules not processed for user `2141561d059043baa440e966a5e1c6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:44:46.911008 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-1dd11ff2-0878-4970-802c-508e553ce05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:44:46.958607 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:44:46.969095 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 756/1504] 10.222.0.27 () {58 vars in 1060 bytes} [Tue Jul 5 20:44:46 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:44:46.977756 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4766b-8589-4aa5-9427-b6db547e69b3 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:46.991717 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4766b-8589-4aa5-9427-b6db547e69b3 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:46.995694 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc0c1b-c36f-4138-a3a8-77ec0a22c47c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:46.996344 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc0c1b-c36f-4138-a3a8-77ec0a22c47c service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:46.996623 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc0c1b-c36f-4138-a3a8-77ec0a22c47c service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:46.996896 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc0c1b-c36f-4138-a3a8-77ec0a22c47c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:47.006341 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc0c1b-c36f-4138-a3a8-77ec0a22c47c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:47.007798 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc0c1b-c36f-4138-a3a8-77ec0a22c47c service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:47.017130 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 749/1505] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:44:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:44:47.059850 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd98abd-8926-49dc-95b4-02244519c8b1 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:47.060133 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd98abd-8926-49dc-95b4-02244519c8b1 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:47.060417 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd98abd-8926-49dc-95b4-02244519c8b1 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:47.061716 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 757/1506] 10.222.0.27 () {52 vars in 829 bytes} [Tue Jul 5 20:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:44:47.065660 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc0c1b-c36f-4138-a3a8-77ec0a22c47c service cinder] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:47.134133 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc0c1b-c36f-4138-a3a8-77ec0a22c47c service cinder] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:47.139611 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9181939-a21b-4dc7-abe7-4c0042ee2b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:47.140489 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9181939-a21b-4dc7-abe7-4c0042ee2b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:47.140766 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9181939-a21b-4dc7-abe7-4c0042ee2b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:47.141055 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9181939-a21b-4dc7-abe7-4c0042ee2b9f admin admin] PATH_INFO: `/v3/users/b29b393ad6e54d998a873d62ecd2a956` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:47.142289 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9181939-a21b-4dc7-abe7-4c0042ee2b9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b29b393ad6e54d998a873d62ecd2a956)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:47.143307 dv-cinder-797608-49-smb devstack@keystone.service[87151]: WARNING py.warnings [None req-e9181939-a21b-4dc7-abe7-4c0042ee2b9f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 20:44:47.143307 dv-cinder-797608-49-smb devstack@keystone.service[87151]: warnings.warn(msg) Jul 05 20:44:47.143307 dv-cinder-797608-49-smb devstack@keystone.service[87151]: Jul 05 20:44:47.144510 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9181939-a21b-4dc7-abe7-4c0042ee2b9f admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:47.223174 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-e9181939-a21b-4dc7-abe7-4c0042ee2b9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b29b393ad6e54d998a873d62ecd2a956'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:44:47.238351 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-e9181939-a21b-4dc7-abe7-4c0042ee2b9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b29b393ad6e54d998a873d62ecd2a956'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:44:47.259157 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-e9181939-a21b-4dc7-abe7-4c0042ee2b9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b29b393ad6e54d998a873d62ecd2a956'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:44:47.260065 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-e9181939-a21b-4dc7-abe7-4c0042ee2b9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b29b393ad6e54d998a873d62ecd2a956'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:44:47.260756 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-e9181939-a21b-4dc7-abe7-4c0042ee2b9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b29b393ad6e54d998a873d62ecd2a956'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:44:47.265065 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:44:47.279251 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 750/1507] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:44:47 2022] DELETE /identity/v3/users/b29b393ad6e54d998a873d62ecd2a956 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:44:47.284807 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55fd80-49ea-41cb-90af-202b6f2f6582 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:47.285169 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55fd80-49ea-41cb-90af-202b6f2f6582 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:47.285461 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55fd80-49ea-41cb-90af-202b6f2f6582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:47.303378 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-1d55fd80-49ea-41cb-90af-202b6f2f6582 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:44:47.304586 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-1d55fd80-49ea-41cb-90af-202b6f2f6582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:44:47.372750 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 758/1508] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:44:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:44:47.382448 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9181939-a21b-4dc7-abe7-4c0042ee2b9f admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:47.383950 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-e9181939-a21b-4dc7-abe7-4c0042ee2b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:44:47.447372 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9181939-a21b-4dc7-abe7-4c0042ee2b9f admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:47.453898 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa60d3-a1db-421b-9638-a99cb3e1e104 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:47.454554 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa60d3-a1db-421b-9638-a99cb3e1e104 service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:47.454831 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa60d3-a1db-421b-9638-a99cb3e1e104 service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:47.455098 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa60d3-a1db-421b-9638-a99cb3e1e104 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:47.465024 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa60d3-a1db-421b-9638-a99cb3e1e104 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:47.466511 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa60d3-a1db-421b-9638-a99cb3e1e104 service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:47.476513 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 751/1509] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:44:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:44:47.816607 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55fd80-49ea-41cb-90af-202b6f2f6582 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:44:47.821176 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-1d55fd80-49ea-41cb-90af-202b6f2f6582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:44:47.830574 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55fd80-49ea-41cb-90af-202b6f2f6582 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:44:47.836095 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e8d9c-d746-4a85-b67e-d1b594d9bf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:44:47.837307 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e8d9c-d746-4a85-b67e-d1b594d9bf08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:44:47.837614 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e8d9c-d746-4a85-b67e-d1b594d9bf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:44:47.837865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e8d9c-d746-4a85-b67e-d1b594d9bf08 admin admin] PATH_INFO: `/v3/projects/f89b9621ccaa4135ab797dc48d49a155` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:44:47.839061 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e8d9c-d746-4a85-b67e-d1b594d9bf08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f89b9621ccaa4135ab797dc48d49a155)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:44:47.840926 dv-cinder-797608-49-smb devstack@keystone.service[87152]: WARNING py.warnings [None req-2a5e8d9c-d746-4a85-b67e-d1b594d9bf08 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 20:44:47.840926 dv-cinder-797608-49-smb devstack@keystone.service[87152]: warnings.warn(msg) Jul 05 20:44:47.840926 dv-cinder-797608-49-smb devstack@keystone.service[87152]: Jul 05 20:44:47.842512 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e8d9c-d746-4a85-b67e-d1b594d9bf08 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:44:47.904792 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-2a5e8d9c-d746-4a85-b67e-d1b594d9bf08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f89b9621ccaa4135ab797dc48d49a155', 'request_id': 'req-2a5e8d9c-d746-4a85-b67e-d1b594d9bf08'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:44:47.911298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-2a5e8d9c-d746-4a85-b67e-d1b594d9bf08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f89b9621ccaa4135ab797dc48d49a155', 'request_id': 'req-2a5e8d9c-d746-4a85-b67e-d1b594d9bf08'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:44:47.923134 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-2a5e8d9c-d746-4a85-b67e-d1b594d9bf08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f89b9621ccaa4135ab797dc48d49a155', 'request_id': 'req-2a5e8d9c-d746-4a85-b67e-d1b594d9bf08'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:44:47.942345 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-2a5e8d9c-d746-4a85-b67e-d1b594d9bf08 admin admin] The token cache is being invalidate because project f89b9621ccaa4135ab797dc48d49a155 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:44:47.942629 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-2a5e8d9c-d746-4a85-b67e-d1b594d9bf08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:44:47.943310 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-2a5e8d9c-d746-4a85-b67e-d1b594d9bf08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:44:47.945048 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 759/1510] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:44:47 2022] DELETE /identity/v3/projects/f89b9621ccaa4135ab797dc48d49a155 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:44:57.471660 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:44:57.939354 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:46:36.634596 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca6640-9bd8-46f2-b9f5-7c1f7bef7e86 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:36.635207 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca6640-9bd8-46f2-b9f5-7c1f7bef7e86 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:36.635207 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca6640-9bd8-46f2-b9f5-7c1f7bef7e86 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:36.636524 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 752/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 20:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:46:36.641774 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4409de9-b170-4414-af25-d7a2059749d7 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:36.642241 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4409de9-b170-4414-af25-d7a2059749d7 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:36.642356 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4409de9-b170-4414-af25-d7a2059749d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:36.662428 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-f4409de9-b170-4414-af25-d7a2059749d7 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:46:36.663657 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-f4409de9-b170-4414-af25-d7a2059749d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:36.733435 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 760/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 20:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:46:36.890071 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca6640-9bd8-46f2-b9f5-7c1f7bef7e86 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:46:36.893060 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-7dca6640-9bd8-46f2-b9f5-7c1f7bef7e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:36.973875 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca6640-9bd8-46f2-b9f5-7c1f7bef7e86 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:46:36.980544 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca96d0b-0011-4d10-89cb-b71d7ad0d5b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:46:36.981191 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca96d0b-0011-4d10-89cb-b71d7ad0d5b3 service nova] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:36.981472 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca96d0b-0011-4d10-89cb-b71d7ad0d5b3 service nova] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:36.981746 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca96d0b-0011-4d10-89cb-b71d7ad0d5b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:36.991139 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca96d0b-0011-4d10-89cb-b71d7ad0d5b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:46:36.993508 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca96d0b-0011-4d10-89cb-b71d7ad0d5b3 service nova] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:46:37.006341 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 753/1513] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:46:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:46:37.824100 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b68564-cb3f-42dc-ba1c-d1844b977388 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:37.825017 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b68564-cb3f-42dc-ba1c-d1844b977388 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:37.825017 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b68564-cb3f-42dc-ba1c-d1844b977388 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:37.827241 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 761/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 20:46:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:46:37.833283 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38513c-3237-4969-8a86-c5e7641fe18c None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:37.833745 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38513c-3237-4969-8a86-c5e7641fe18c None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:37.833872 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38513c-3237-4969-8a86-c5e7641fe18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:37.852681 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-ae38513c-3237-4969-8a86-c5e7641fe18c None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:46:37.853877 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-ae38513c-3237-4969-8a86-c5e7641fe18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:37.862957 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 754/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 20:46:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:46:38.014935 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b68564-cb3f-42dc-ba1c-d1844b977388 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:46:38.038957 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b68564-cb3f-42dc-ba1c-d1844b977388 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:46:38.046188 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc4a62-54ad-473f-bc7c-1522c7f56bf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:46:38.046818 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc4a62-54ad-473f-bc7c-1522c7f56bf0 service nova] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:38.047095 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc4a62-54ad-473f-bc7c-1522c7f56bf0 service nova] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:38.047365 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc4a62-54ad-473f-bc7c-1522c7f56bf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:38.055586 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdc4a62-54ad-473f-bc7c-1522c7f56bf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:46:38.057188 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdc4a62-54ad-473f-bc7c-1522c7f56bf0 service nova] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:46:38.066934 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 762/1516] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:46:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:46:38.453588 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96189e4-1101-4ced-81d0-8c2a43930ef1 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:38.453880 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96189e4-1101-4ced-81d0-8c2a43930ef1 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:38.454164 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96189e4-1101-4ced-81d0-8c2a43930ef1 None None] PATH_INFO: `/v3` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:38.455507 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 755/1517] 10.222.0.25 () {54 vars in 925 bytes} [Tue Jul 5 20:46:38 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:46:38.463636 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa7ca4-987c-43e5-a38b-2646f7cf8ffe None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:38.464115 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa7ca4-987c-43e5-a38b-2646f7cf8ffe None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:38.464587 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa7ca4-987c-43e5-a38b-2646f7cf8ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:38.490729 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-c7fa7ca4-987c-43e5-a38b-2646f7cf8ffe None None] MFA Rules not processed for user `16662dd5e2e74163b6aa2e1e7ef07524`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:46:38.491982 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-c7fa7ca4-987c-43e5-a38b-2646f7cf8ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:38.563824 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 763/1518] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Jul 5 20:46:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:46:47.586110 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec35aa6-3d9f-46ba-af84-579c54e5a3d7 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:47.586672 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec35aa6-3d9f-46ba-af84-579c54e5a3d7 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:47.586672 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec35aa6-3d9f-46ba-af84-579c54e5a3d7 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:47.588779 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 756/1519] 10.222.0.27 () {54 vars in 960 bytes} [Tue Jul 5 20:46:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:46:47.596342 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d9816-1ed0-4201-8245-859b34065491 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:47.596793 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d9816-1ed0-4201-8245-859b34065491 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:47.596919 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d9816-1ed0-4201-8245-859b34065491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:47.619686 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-419d9816-1ed0-4201-8245-859b34065491 None None] MFA Rules not processed for user `16662dd5e2e74163b6aa2e1e7ef07524`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:46:47.620925 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-419d9816-1ed0-4201-8245-859b34065491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:47.631084 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 764/1520] 10.222.0.27 () {58 vars in 1057 bytes} [Tue Jul 5 20:46:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:46:47.638769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec35aa6-3d9f-46ba-af84-579c54e5a3d7 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:46:47.654326 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec35aa6-3d9f-46ba-af84-579c54e5a3d7 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:46:47.662482 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c4225-9f41-4ff0-9dbe-6b8fc47f39c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16662dd5e2e74163b6aa2e1e7ef07524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:46:47.663133 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c4225-9f41-4ff0-9dbe-6b8fc47f39c3 service placement] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:47.663398 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c4225-9f41-4ff0-9dbe-6b8fc47f39c3 service placement] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:47.663671 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c4225-9f41-4ff0-9dbe-6b8fc47f39c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:47.675398 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c4225-9f41-4ff0-9dbe-6b8fc47f39c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:46:47.677150 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c4225-9f41-4ff0-9dbe-6b8fc47f39c3 service placement] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:46:47.687198 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 757/1521] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:46:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:46:49.341997 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdd27f-8370-476e-92b7-ed5527ccfada None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:49.342811 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdd27f-8370-476e-92b7-ed5527ccfada None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:49.342811 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdd27f-8370-476e-92b7-ed5527ccfada None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:49.345094 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 765/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 20:46:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:46:49.350866 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1bdb3-c3b4-4419-8f17-e9f77c7b570a None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:49.351331 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1bdb3-c3b4-4419-8f17-e9f77c7b570a None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:49.351427 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1bdb3-c3b4-4419-8f17-e9f77c7b570a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:49.372569 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-8fa1bdb3-c3b4-4419-8f17-e9f77c7b570a None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:46:49.373784 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-8fa1bdb3-c3b4-4419-8f17-e9f77c7b570a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:49.383068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 758/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 20:46:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:46:49.533099 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fdd27f-8370-476e-92b7-ed5527ccfada None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:46:49.548277 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fdd27f-8370-476e-92b7-ed5527ccfada None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:46:49.554711 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ff901-61c4-4877-bfe7-657325c924a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:46:49.555351 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ff901-61c4-4877-bfe7-657325c924a1 service nova] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:49.555633 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ff901-61c4-4877-bfe7-657325c924a1 service nova] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:49.555901 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ff901-61c4-4877-bfe7-657325c924a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:49.564176 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ff901-61c4-4877-bfe7-657325c924a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:46:49.565859 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ff901-61c4-4877-bfe7-657325c924a1 service nova] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:46:49.575278 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 766/1524] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:46:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:46:50.387474 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0004bf-bd78-441d-b921-a30c119aff1c None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:50.388330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0004bf-bd78-441d-b921-a30c119aff1c None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:50.388330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0004bf-bd78-441d-b921-a30c119aff1c None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:50.390676 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 759/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 5 20:46:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:46:50.397498 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7bea7-2e31-4d0e-875a-dad39fdf7a7e None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:50.397985 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7bea7-2e31-4d0e-875a-dad39fdf7a7e None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:50.397985 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7bea7-2e31-4d0e-875a-dad39fdf7a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:50.417315 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-57a7bea7-2e31-4d0e-875a-dad39fdf7a7e None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:46:50.418590 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-57a7bea7-2e31-4d0e-875a-dad39fdf7a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:50.427581 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 767/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 5 20:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:46:50.580338 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0004bf-bd78-441d-b921-a30c119aff1c None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:46:50.603916 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0004bf-bd78-441d-b921-a30c119aff1c None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:46:50.615321 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9c796-8737-4587-81be-e43881c5c174 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:46:50.615321 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9c796-8737-4587-81be-e43881c5c174 service nova] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:50.615321 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9c796-8737-4587-81be-e43881c5c174 service nova] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:50.615657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9c796-8737-4587-81be-e43881c5c174 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:50.627863 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9c796-8737-4587-81be-e43881c5c174 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:46:50.630423 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9c796-8737-4587-81be-e43881c5c174 service nova] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:46:50.644345 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 760/1527] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:46:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:46:54.515854 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c37de3-c611-4eaf-aab3-7715a3dbed5c None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:54.516509 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c37de3-c611-4eaf-aab3-7715a3dbed5c None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:54.516509 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c37de3-c611-4eaf-aab3-7715a3dbed5c None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:54.517785 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 768/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 20:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:46:54.523385 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b138af6-e62f-49d0-ad3a-1cad9b671e1e None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:54.523838 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b138af6-e62f-49d0-ad3a-1cad9b671e1e None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:54.523942 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b138af6-e62f-49d0-ad3a-1cad9b671e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:54.544881 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-6b138af6-e62f-49d0-ad3a-1cad9b671e1e None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:46:54.546144 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-6b138af6-e62f-49d0-ad3a-1cad9b671e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:54.555221 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 761/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 20:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:46:54.631880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c37de3-c611-4eaf-aab3-7715a3dbed5c None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:46:54.633970 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-77c37de3-c611-4eaf-aab3-7715a3dbed5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:54.708670 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c37de3-c611-4eaf-aab3-7715a3dbed5c None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:46:54.712910 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46adfd7-ca66-489e-817b-6ba847172ec7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:46:54.713488 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46adfd7-ca66-489e-817b-6ba847172ec7 service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:54.713769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46adfd7-ca66-489e-817b-6ba847172ec7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:54.714072 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46adfd7-ca66-489e-817b-6ba847172ec7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:54.723471 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46adfd7-ca66-489e-817b-6ba847172ec7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:46:54.724952 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46adfd7-ca66-489e-817b-6ba847172ec7 service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:46:54.729929 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:46:54.734863 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 769/1530] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:46:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:46:56.721575 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264409f-359b-4c6b-89c7-26ab6bcfb018 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:56.722141 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264409f-359b-4c6b-89c7-26ab6bcfb018 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:56.722141 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264409f-359b-4c6b-89c7-26ab6bcfb018 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:56.723926 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 762/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 20:46:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:46:56.730491 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec869a1-3819-4963-ab55-eba92f53e362 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:56.731419 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec869a1-3819-4963-ab55-eba92f53e362 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:56.731789 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec869a1-3819-4963-ab55-eba92f53e362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:56.751038 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-4ec869a1-3819-4963-ab55-eba92f53e362 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:46:56.752248 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-4ec869a1-3819-4963-ab55-eba92f53e362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:56.760116 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 770/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 20:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:46:56.796642 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264409f-359b-4c6b-89c7-26ab6bcfb018 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:46:56.799713 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-c264409f-359b-4c6b-89c7-26ab6bcfb018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:46:56.819689 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264409f-359b-4c6b-89c7-26ab6bcfb018 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:46:56.824027 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ccb5e-9035-44fb-8036-bea242e3a737 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:46:56.824667 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ccb5e-9035-44fb-8036-bea242e3a737 service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:46:56.824976 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ccb5e-9035-44fb-8036-bea242e3a737 service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:46:56.825217 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ccb5e-9035-44fb-8036-bea242e3a737 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:46:56.835251 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ccb5e-9035-44fb-8036-bea242e3a737 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:46:56.836698 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ccb5e-9035-44fb-8036-bea242e3a737 service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:46:56.846503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 763/1533] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:46:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:47:00.455148 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99d523-176b-49d9-a3af-04ddf31e8609 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:00.455987 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99d523-176b-49d9-a3af-04ddf31e8609 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:00.455987 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99d523-176b-49d9-a3af-04ddf31e8609 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:00.457994 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 771/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 20:47:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:47:00.466061 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad26d3-2f97-43e3-829e-d3145044f21e None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:00.466484 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad26d3-2f97-43e3-829e-d3145044f21e None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:00.466599 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad26d3-2f97-43e3-829e-d3145044f21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:00.473871 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=62 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:47:00.488724 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-71ad26d3-2f97-43e3-829e-d3145044f21e None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:47:00.489969 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-71ad26d3-2f97-43e3-829e-d3145044f21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:47:00.498323 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 764/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 20:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:47:00.805106 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99d523-176b-49d9-a3af-04ddf31e8609 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:47:00.807279 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-ae99d523-176b-49d9-a3af-04ddf31e8609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:47:00.880276 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99d523-176b-49d9-a3af-04ddf31e8609 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:47:00.884744 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2ad8d-a0dd-4094-9cf6-c08f2343684c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:47:00.885390 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2ad8d-a0dd-4094-9cf6-c08f2343684c service cinder] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:00.885699 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2ad8d-a0dd-4094-9cf6-c08f2343684c service cinder] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:00.886002 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2ad8d-a0dd-4094-9cf6-c08f2343684c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:00.896037 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2ad8d-a0dd-4094-9cf6-c08f2343684c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:47:00.897482 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2ad8d-a0dd-4094-9cf6-c08f2343684c service cinder] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:47:00.907056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 772/1536] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:47:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:47:02.943910 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e42ff6-a2f7-4712-baa9-b79eee933de1 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:02.944733 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e42ff6-a2f7-4712-baa9-b79eee933de1 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:02.944733 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e42ff6-a2f7-4712-baa9-b79eee933de1 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:02.947110 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 765/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 5 20:47:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:47:02.953330 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae132e3-74e9-494c-ae8b-fbead7c67893 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:02.953785 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae132e3-74e9-494c-ae8b-fbead7c67893 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:02.954000 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae132e3-74e9-494c-ae8b-fbead7c67893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:02.980628 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-7ae132e3-74e9-494c-ae8b-fbead7c67893 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:47:02.981873 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-7ae132e3-74e9-494c-ae8b-fbead7c67893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:47:02.991456 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 773/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 5 20:47:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:47:03.289952 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e42ff6-a2f7-4712-baa9-b79eee933de1 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:47:03.293074 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-a2e42ff6-a2f7-4712-baa9-b79eee933de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:47:03.310680 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e42ff6-a2f7-4712-baa9-b79eee933de1 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:47:03.314916 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dff0f7-6010-4a38-848a-1d1ec1f49759 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:47:03.315558 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dff0f7-6010-4a38-848a-1d1ec1f49759 service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:47:03.315839 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dff0f7-6010-4a38-848a-1d1ec1f49759 service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:47:03.316115 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dff0f7-6010-4a38-848a-1d1ec1f49759 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:47:03.325832 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dff0f7-6010-4a38-848a-1d1ec1f49759 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:47:03.327298 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dff0f7-6010-4a38-848a-1d1ec1f49759 service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:47:03.337635 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 766/1539] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:47:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:47:12.975207 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=32 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:47:13.332990 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=8 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:33.503369 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0e0b1-dbff-4627-ba48-78b1a39588dd None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:33.504599 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0e0b1-dbff-4627-ba48-78b1a39588dd None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:33.504599 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0e0b1-dbff-4627-ba48-78b1a39588dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:33.539507 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-1ff0e0b1-dbff-4627-ba48-78b1a39588dd None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:33.540741 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-1ff0e0b1-dbff-4627-ba48-78b1a39588dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:33.554118 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 774/1540] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:33.563364 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67387f88-8fe1-4bf0-9af9-f06cf2c3304f None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:33.563981 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67387f88-8fe1-4bf0-9af9-f06cf2c3304f None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:33.563981 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67387f88-8fe1-4bf0-9af9-f06cf2c3304f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:33.595350 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-67387f88-8fe1-4bf0-9af9-f06cf2c3304f None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:33.596807 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-67387f88-8fe1-4bf0-9af9-f06cf2c3304f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:33.611720 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 767/1541] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:33.616010 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff0e0b1-dbff-4627-ba48-78b1a39588dd None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:33.632583 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff0e0b1-dbff-4627-ba48-78b1a39588dd None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:33.637219 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261553dd-5a6a-42dd-8ea7-8365a31ea37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:33.637911 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261553dd-5a6a-42dd-8ea7-8365a31ea37c admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:33.638195 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261553dd-5a6a-42dd-8ea7-8365a31ea37c admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:33.638469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261553dd-5a6a-42dd-8ea7-8365a31ea37c admin admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:33.639202 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261553dd-5a6a-42dd-8ea7-8365a31ea37c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:48:33.639502 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261553dd-5a6a-42dd-8ea7-8365a31ea37c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:33.641122 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261553dd-5a6a-42dd-8ea7-8365a31ea37c admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:33.665634 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 775/1542] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:48:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:48:33.674443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67387f88-8fe1-4bf0-9af9-f06cf2c3304f None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:33.684680 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67387f88-8fe1-4bf0-9af9-f06cf2c3304f None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:33.694210 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156f429-258a-462e-8177-25c6ee21ef04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:33.694894 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156f429-258a-462e-8177-25c6ee21ef04 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:33.695177 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156f429-258a-462e-8177-25c6ee21ef04 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:33.695460 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156f429-258a-462e-8177-25c6ee21ef04 admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:33.696163 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b156f429-258a-462e-8177-25c6ee21ef04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:33.698132 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b156f429-258a-462e-8177-25c6ee21ef04 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:33.716754 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c771afd-b851-48d1-af9b-0f09992c12eb None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:33.717080 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c771afd-b851-48d1-af9b-0f09992c12eb None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:33.717354 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c771afd-b851-48d1-af9b-0f09992c12eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:33.747450 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-5c771afd-b851-48d1-af9b-0f09992c12eb None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:33.747838 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 768/1543] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:48:33 2022] POST /identity/v3/projects => generated 393 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:48:33.748758 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-5c771afd-b851-48d1-af9b-0f09992c12eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:33.752634 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156f429-258a-462e-8177-25c6ee21ef04 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:33.865851 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 776/1544] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:33.867515 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156f429-258a-462e-8177-25c6ee21ef04 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:33.880108 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dc3d1-9099-43e4-bd1b-5343a4bcdff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:33.880325 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d6866-d605-4986-9c0b-0c3ace2eca80 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:33.880560 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d6866-d605-4986-9c0b-0c3ace2eca80 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:33.880796 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dc3d1-9099-43e4-bd1b-5343a4bcdff1 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:33.880915 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d6866-d605-4986-9c0b-0c3ace2eca80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:33.881069 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dc3d1-9099-43e4-bd1b-5343a4bcdff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:33.881345 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dc3d1-9099-43e4-bd1b-5343a4bcdff1 admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:33.882065 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1dc3d1-9099-43e4-bd1b-5343a4bcdff1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:33.883096 dv-cinder-797608-49-smb devstack@keystone.service[87151]: WARNING py.warnings [None req-5e1dc3d1-9099-43e4-bd1b-5343a4bcdff1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 20:48:33.883096 dv-cinder-797608-49-smb devstack@keystone.service[87151]: warnings.warn(msg) Jul 05 20:48:33.883096 dv-cinder-797608-49-smb devstack@keystone.service[87151]: Jul 05 20:48:33.884904 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1dc3d1-9099-43e4-bd1b-5343a4bcdff1 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:33.911970 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-593d6866-d605-4986-9c0b-0c3ace2eca80 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:33.913232 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-593d6866-d605-4986-9c0b-0c3ace2eca80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:33.924974 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 777/1545] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:48:33.926080 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cc4d8-394f-4a30-829b-ff2ef7c0f6cb None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:33.926412 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cc4d8-394f-4a30-829b-ff2ef7c0f6cb None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:33.926691 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cc4d8-394f-4a30-829b-ff2ef7c0f6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:33.927410 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 769/1546] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:48:33 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:48:33.928763 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6b8f2-94e0-47fd-8cf3-04caec7a032f None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:33.929050 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6b8f2-94e0-47fd-8cf3-04caec7a032f None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:33.929375 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6b8f2-94e0-47fd-8cf3-04caec7a032f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:33.955414 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-b8c6b8f2-94e0-47fd-8cf3-04caec7a032f None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:33.956969 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-b8c6b8f2-94e0-47fd-8cf3-04caec7a032f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:33.958037 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-fa1cc4d8-394f-4a30-829b-ff2ef7c0f6cb None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:33.965862 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-fa1cc4d8-394f-4a30-829b-ff2ef7c0f6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:33.969035 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 778/1547] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:33.969832 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1cc4d8-394f-4a30-829b-ff2ef7c0f6cb None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:33.976074 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 770/1548] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:33.976748 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6b8f2-94e0-47fd-8cf3-04caec7a032f None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:33.990552 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1cc4d8-394f-4a30-829b-ff2ef7c0f6cb None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:33.994390 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6b8f2-94e0-47fd-8cf3-04caec7a032f None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:33.997879 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c4a2f-f21a-4534-adb6-54f564ef9a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:33.997879 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c4a2f-f21a-4534-adb6-54f564ef9a9a admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:33.997879 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c4a2f-f21a-4534-adb6-54f564ef9a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:33.997879 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c4a2f-f21a-4534-adb6-54f564ef9a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:33.998265 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c4a2f-f21a-4534-adb6-54f564ef9a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:33.999341 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c4a2f-f21a-4534-adb6-54f564ef9a9a admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:34.009460 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1569f5d-70dc-4bd1-9d66-0563f6c548f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:34.010166 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1569f5d-70dc-4bd1-9d66-0563f6c548f0 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:34.010445 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1569f5d-70dc-4bd1-9d66-0563f6c548f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:34.010717 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1569f5d-70dc-4bd1-9d66-0563f6c548f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:34.011465 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1569f5d-70dc-4bd1-9d66-0563f6c548f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:48:34.011772 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1569f5d-70dc-4bd1-9d66-0563f6c548f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:34.012804 dv-cinder-797608-49-smb devstack@keystone.service[87151]: WARNING py.warnings [None req-f1569f5d-70dc-4bd1-9d66-0563f6c548f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 05 20:48:34.012804 dv-cinder-797608-49-smb devstack@keystone.service[87151]: warnings.warn(msg) Jul 05 20:48:34.012804 dv-cinder-797608-49-smb devstack@keystone.service[87151]: Jul 05 20:48:34.013700 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1569f5d-70dc-4bd1-9d66-0563f6c548f0 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:34.021261 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 779/1549] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:48:34.022857 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c813a-098c-481d-b29d-1c6d7e3c8bd4 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:34.023145 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c813a-098c-481d-b29d-1c6d7e3c8bd4 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:34.023422 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c813a-098c-481d-b29d-1c6d7e3c8bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:34.033431 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 771/1550] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:48:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:48:34.037467 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c21bdb-df08-4267-adec-323a7cad08fc None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:34.037749 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c21bdb-df08-4267-adec-323a7cad08fc None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:34.038060 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c21bdb-df08-4267-adec-323a7cad08fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:34.046158 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-ce4c813a-098c-481d-b29d-1c6d7e3c8bd4 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:34.048212 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-ce4c813a-098c-481d-b29d-1c6d7e3c8bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:34.057015 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 780/1551] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:34.058457 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7914f-c3d2-4e19-80f8-f15de0606c3f None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:34.058747 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7914f-c3d2-4e19-80f8-f15de0606c3f None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:34.059023 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7914f-c3d2-4e19-80f8-f15de0606c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:34.064739 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-d9c21bdb-df08-4267-adec-323a7cad08fc None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:34.065998 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-d9c21bdb-df08-4267-adec-323a7cad08fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:34.073921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 772/1552] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:34.074999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8c70c-d50e-4f7e-930d-01084c58eb4b None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:34.075285 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8c70c-d50e-4f7e-930d-01084c58eb4b None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:34.075563 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8c70c-d50e-4f7e-930d-01084c58eb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:34.077005 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-8fc7914f-c3d2-4e19-80f8-f15de0606c3f None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:34.078272 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-8fc7914f-c3d2-4e19-80f8-f15de0606c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:34.086935 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 781/1553] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:34.087786 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7914f-c3d2-4e19-80f8-f15de0606c3f None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:34.096188 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-8df8c70c-d50e-4f7e-930d-01084c58eb4b None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:34.097391 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-8df8c70c-d50e-4f7e-930d-01084c58eb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:34.099295 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7914f-c3d2-4e19-80f8-f15de0606c3f None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:34.105089 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4ad81-8d65-4064-9d69-d18bd68c2206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:34.105646 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 773/1554] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:34.105767 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4ad81-8d65-4064-9d69-d18bd68c2206 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:34.106063 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4ad81-8d65-4064-9d69-d18bd68c2206 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:34.106344 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4ad81-8d65-4064-9d69-d18bd68c2206 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:34.106453 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8c70c-d50e-4f7e-930d-01084c58eb4b None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:34.107076 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d4ad81-8d65-4064-9d69-d18bd68c2206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:34.108724 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d4ad81-8d65-4064-9d69-d18bd68c2206 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:34.116413 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8c70c-d50e-4f7e-930d-01084c58eb4b None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:34.121208 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa1e44-1e2e-4504-b0b3-0923d821262e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:34.121887 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa1e44-1e2e-4504-b0b3-0923d821262e admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:34.122171 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa1e44-1e2e-4504-b0b3-0923d821262e admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:34.122444 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa1e44-1e2e-4504-b0b3-0923d821262e admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:34.125918 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 782/1555] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:48:34.126066 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa1e44-1e2e-4504-b0b3-0923d821262e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:34.126165 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe4231-f197-47ff-90eb-53df4e43d075 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:34.126165 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe4231-f197-47ff-90eb-53df4e43d075 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:34.126165 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe4231-f197-47ff-90eb-53df4e43d075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:34.126373 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa1e44-1e2e-4504-b0b3-0923d821262e admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:34.142792 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-cabe4231-f197-47ff-90eb-53df4e43d075 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:34.144030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-cabe4231-f197-47ff-90eb-53df4e43d075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:34.152867 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 783/1556] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:34.154213 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e4756-620f-4cd9-b25b-3148fc37f66f None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:34.154491 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e4756-620f-4cd9-b25b-3148fc37f66f None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:34.154770 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e4756-620f-4cd9-b25b-3148fc37f66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:34.161047 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 774/1557] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:48:34 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:48:34.162777 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c7e5a-2784-4cb7-8d0b-0211b7cd657e None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:34.163063 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c7e5a-2784-4cb7-8d0b-0211b7cd657e None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:34.163350 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c7e5a-2784-4cb7-8d0b-0211b7cd657e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:34.178485 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-611e4756-620f-4cd9-b25b-3148fc37f66f None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:34.179702 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-611e4756-620f-4cd9-b25b-3148fc37f66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:34.181411 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-f58c7e5a-2784-4cb7-8d0b-0211b7cd657e None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:34.182617 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-f58c7e5a-2784-4cb7-8d0b-0211b7cd657e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:34.238674 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 784/1558] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:34.239647 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e4756-620f-4cd9-b25b-3148fc37f66f None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:34.240570 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 775/1559] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:34.241269 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c7e5a-2784-4cb7-8d0b-0211b7cd657e None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:34.251568 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c7e5a-2784-4cb7-8d0b-0211b7cd657e None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:34.253100 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e4756-620f-4cd9-b25b-3148fc37f66f None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:34.256642 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f6008-4856-4fe4-ab68-e4167c7658eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:34.257299 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f6008-4856-4fe4-ab68-e4167c7658eb admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:34.257581 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f6008-4856-4fe4-ab68-e4167c7658eb admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:34.257693 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1bf5f-bcc0-49a3-a312-7199bd1a2111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:34.257880 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f6008-4856-4fe4-ab68-e4167c7658eb admin admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:34.258418 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1bf5f-bcc0-49a3-a312-7199bd1a2111 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:34.258619 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f6008-4856-4fe4-ab68-e4167c7658eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:48:34.258714 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1bf5f-bcc0-49a3-a312-7199bd1a2111 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:34.258926 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f6008-4856-4fe4-ab68-e4167c7658eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:34.259020 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1bf5f-bcc0-49a3-a312-7199bd1a2111 admin admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:34.259672 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1bf5f-bcc0-49a3-a312-7199bd1a2111 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:48:34.259979 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1bf5f-bcc0-49a3-a312-7199bd1a2111 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:34.260536 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f6008-4856-4fe4-ab68-e4167c7658eb admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:34.261594 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1bf5f-bcc0-49a3-a312-7199bd1a2111 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:34.262103 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:34.274058 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 776/1560] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:48:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:48:34.274232 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 785/1561] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:48:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:48:34.274767 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1bf5f-bcc0-49a3-a312-7199bd1a2111 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:34.275221 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619a8f0-47d4-4175-87ea-92ca3410d864 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:34.275484 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619a8f0-47d4-4175-87ea-92ca3410d864 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:34.275872 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619a8f0-47d4-4175-87ea-92ca3410d864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:34.284556 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1bf5f-bcc0-49a3-a312-7199bd1a2111 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:34.289210 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d70a83-ab94-47d4-9a03-ab2262f14fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:34.290130 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d70a83-ab94-47d4-9a03-ab2262f14fcc admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:34.290412 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d70a83-ab94-47d4-9a03-ab2262f14fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:34.290686 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d70a83-ab94-47d4-9a03-ab2262f14fcc admin admin] PATH_INFO: `/v3/projects/0b1eced4c4c648b484991197f77e8630/users/bc1c30d3677845c5b9185f4a4ad5ea03/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:34.293738 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-d619a8f0-47d4-4175-87ea-92ca3410d864 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:34.294983 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-d619a8f0-47d4-4175-87ea-92ca3410d864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:34.302601 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:34.303165 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 777/1562] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:34.304334 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab82d8-5573-4570-aac2-22aba69fce32 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:34.304656 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab82d8-5573-4570-aac2-22aba69fce32 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:34.304964 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab82d8-5573-4570-aac2-22aba69fce32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:34.309476 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d70a83-ab94-47d4-9a03-ab2262f14fcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b1eced4c4c648b484991197f77e8630, user_id=bc1c30d3677845c5b9185f4a4ad5ea03, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:34.310568 dv-cinder-797608-49-smb devstack@keystone.service[87152]: WARNING py.warnings [None req-c1d70a83-ab94-47d4-9a03-ab2262f14fcc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 20:48:34.310568 dv-cinder-797608-49-smb devstack@keystone.service[87152]: warnings.warn(msg) Jul 05 20:48:34.310568 dv-cinder-797608-49-smb devstack@keystone.service[87152]: Jul 05 20:48:34.312515 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d70a83-ab94-47d4-9a03-ab2262f14fcc admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:34.323182 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-60ab82d8-5573-4570-aac2-22aba69fce32 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:34.324348 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-60ab82d8-5573-4570-aac2-22aba69fce32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:34.325874 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 786/1563] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:48:34 2022] PUT /identity/v3/projects/0b1eced4c4c648b484991197f77e8630/users/bc1c30d3677845c5b9185f4a4ad5ea03/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:48:34.326678 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d70a83-ab94-47d4-9a03-ab2262f14fcc admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:34.386546 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 778/1564] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:34.387499 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab82d8-5573-4570-aac2-22aba69fce32 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:34.388637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d70a83-ab94-47d4-9a03-ab2262f14fcc admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:34.393613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24201c49-c5c1-4f00-a07b-7bd1069731ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:34.394466 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24201c49-c5c1-4f00-a07b-7bd1069731ee admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:34.394762 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24201c49-c5c1-4f00-a07b-7bd1069731ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:34.395031 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24201c49-c5c1-4f00-a07b-7bd1069731ee admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:34.395711 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24201c49-c5c1-4f00-a07b-7bd1069731ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:34.397256 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab82d8-5573-4570-aac2-22aba69fce32 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:34.397670 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24201c49-c5c1-4f00-a07b-7bd1069731ee admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:34.401733 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1270de-4cc0-44bc-8e74-f523f9566bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:34.402409 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1270de-4cc0-44bc-8e74-f523f9566bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:34.402691 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1270de-4cc0-44bc-8e74-f523f9566bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:34.402967 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1270de-4cc0-44bc-8e74-f523f9566bd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:34.403688 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1270de-4cc0-44bc-8e74-f523f9566bd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:48:34.403990 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1270de-4cc0-44bc-8e74-f523f9566bd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:34.405786 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1270de-4cc0-44bc-8e74-f523f9566bd3 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:34.418584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 779/1565] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:48:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:48:34.423365 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 787/1566] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:48:34 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:48:34.423534 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dc1e6-7d83-4ea1-81af-a12ea874952c None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:34.423534 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dc1e6-7d83-4ea1-81af-a12ea874952c None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:34.423534 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dc1e6-7d83-4ea1-81af-a12ea874952c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:34.423911 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24201c49-c5c1-4f00-a07b-7bd1069731ee admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:34.435493 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24201c49-c5c1-4f00-a07b-7bd1069731ee admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:34.438974 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-f01dc1e6-7d83-4ea1-81af-a12ea874952c None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:34.440239 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-f01dc1e6-7d83-4ea1-81af-a12ea874952c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:34.440469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a3b0c-8dee-4589-9221-1d7f9107efd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:34.441134 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a3b0c-8dee-4589-9221-1d7f9107efd8 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:34.441415 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a3b0c-8dee-4589-9221-1d7f9107efd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:34.441690 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a3b0c-8dee-4589-9221-1d7f9107efd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:34.442434 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a3b0c-8dee-4589-9221-1d7f9107efd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:34.443450 dv-cinder-797608-49-smb devstack@keystone.service[87152]: WARNING py.warnings [None req-eb3a3b0c-8dee-4589-9221-1d7f9107efd8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 20:48:34.443450 dv-cinder-797608-49-smb devstack@keystone.service[87152]: warnings.warn(msg) Jul 05 20:48:34.443450 dv-cinder-797608-49-smb devstack@keystone.service[87152]: Jul 05 20:48:34.444651 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a3b0c-8dee-4589-9221-1d7f9107efd8 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:34.448086 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 780/1567] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:34.448864 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01dc1e6-7d83-4ea1-81af-a12ea874952c None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:34.458251 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01dc1e6-7d83-4ea1-81af-a12ea874952c None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:34.463755 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d94e63-8ec9-4699-bc4c-4d4f38cb522a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:34.464508 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d94e63-8ec9-4699-bc4c-4d4f38cb522a admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:34.464791 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d94e63-8ec9-4699-bc4c-4d4f38cb522a admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:34.465064 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d94e63-8ec9-4699-bc4c-4d4f38cb522a admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:34.466161 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d94e63-8ec9-4699-bc4c-4d4f38cb522a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:34.468121 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d94e63-8ec9-4699-bc4c-4d4f38cb522a admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:34.477097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 788/1568] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:48:34 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:48:34.477097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a3b0c-8dee-4589-9221-1d7f9107efd8 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:34.496440 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 781/1569] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:48:34 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:48:34.497824 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3146ae-07c5-4c85-9adb-bdc93f2c70da None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:34.498150 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3146ae-07c5-4c85-9adb-bdc93f2c70da None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:34.498433 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3146ae-07c5-4c85-9adb-bdc93f2c70da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:34.516116 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-0b3146ae-07c5-4c85-9adb-bdc93f2c70da None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:34.517344 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-0b3146ae-07c5-4c85-9adb-bdc93f2c70da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:34.543426 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a3b0c-8dee-4589-9221-1d7f9107efd8 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:34.578241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 782/1570] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:34.579678 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3146ae-07c5-4c85-9adb-bdc93f2c70da None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:34.591216 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3146ae-07c5-4c85-9adb-bdc93f2c70da None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:34.596011 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0e97d-af6c-49af-908d-3fac74cc8faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:34.596669 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0e97d-af6c-49af-908d-3fac74cc8faf admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:34.596951 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0e97d-af6c-49af-908d-3fac74cc8faf admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:34.597233 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0e97d-af6c-49af-908d-3fac74cc8faf admin admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:34.598026 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0e97d-af6c-49af-908d-3fac74cc8faf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:48:34.598334 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0e97d-af6c-49af-908d-3fac74cc8faf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:34.599963 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0e97d-af6c-49af-908d-3fac74cc8faf admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:34.600082 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16747d8-220e-432c-8f90-12367e1fbeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:34.600718 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16747d8-220e-432c-8f90-12367e1fbeed admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:34.600996 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16747d8-220e-432c-8f90-12367e1fbeed admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:34.601271 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16747d8-220e-432c-8f90-12367e1fbeed admin admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:34.602052 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16747d8-220e-432c-8f90-12367e1fbeed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:48:34.602352 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16747d8-220e-432c-8f90-12367e1fbeed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:34.603954 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16747d8-220e-432c-8f90-12367e1fbeed admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:34.610550 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:34.611883 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 783/1571] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:48:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:48:34.612662 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0e97d-af6c-49af-908d-3fac74cc8faf admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:34.616773 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 789/1572] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:48:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:48:34.618818 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16747d8-220e-432c-8f90-12367e1fbeed admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:34.625709 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0e97d-af6c-49af-908d-3fac74cc8faf admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:34.629662 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16747d8-220e-432c-8f90-12367e1fbeed admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:34.631101 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54b23d-95ed-49fb-9374-52dd20badedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:34.631799 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54b23d-95ed-49fb-9374-52dd20badedf admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:34.632082 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54b23d-95ed-49fb-9374-52dd20badedf admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:34.632357 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54b23d-95ed-49fb-9374-52dd20badedf admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:34.633095 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54b23d-95ed-49fb-9374-52dd20badedf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:34.634385 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6386b364-2357-4080-8e3b-7008229103a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:34.634807 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54b23d-95ed-49fb-9374-52dd20badedf admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:34.635153 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386b364-2357-4080-8e3b-7008229103a7 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:34.635434 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386b364-2357-4080-8e3b-7008229103a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:34.635703 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386b364-2357-4080-8e3b-7008229103a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:34.636610 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6386b364-2357-4080-8e3b-7008229103a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:34.638550 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6386b364-2357-4080-8e3b-7008229103a7 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:34.645688 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 784/1573] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:48:34.646521 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54b23d-95ed-49fb-9374-52dd20badedf admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:34.656192 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54b23d-95ed-49fb-9374-52dd20badedf admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:34.661091 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9d5eb-dd42-40d0-88fb-f115c805569c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:34.661735 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9d5eb-dd42-40d0-88fb-f115c805569c admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:34.662048 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9d5eb-dd42-40d0-88fb-f115c805569c admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:34.662329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9d5eb-dd42-40d0-88fb-f115c805569c admin admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:34.663053 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9d5eb-dd42-40d0-88fb-f115c805569c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:48:34.663517 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9d5eb-dd42-40d0-88fb-f115c805569c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:34.664994 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9d5eb-dd42-40d0-88fb-f115c805569c admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:34.669489 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 790/1574] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:48:34 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:48:34.669489 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6386b364-2357-4080-8e3b-7008229103a7 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:34.687440 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 785/1575] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:48:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:48:34.687440 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9d5eb-dd42-40d0-88fb-f115c805569c admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:34.690737 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9d5eb-dd42-40d0-88fb-f115c805569c admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:34.695475 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:34.731232 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6386b364-2357-4080-8e3b-7008229103a7 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:34.736080 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77476ca7-7e16-42aa-97f9-67b060b26ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:34.737685 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77476ca7-7e16-42aa-97f9-67b060b26ba0 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:34.737992 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77476ca7-7e16-42aa-97f9-67b060b26ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:34.738262 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77476ca7-7e16-42aa-97f9-67b060b26ba0 admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:34.738942 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77476ca7-7e16-42aa-97f9-67b060b26ba0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:34.740940 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77476ca7-7e16-42aa-97f9-67b060b26ba0 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:34.746493 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0eb0f2-819d-422e-a94d-6c2318228c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:34.747173 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0eb0f2-819d-422e-a94d-6c2318228c50 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:34.747456 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0eb0f2-819d-422e-a94d-6c2318228c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:34.747733 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0eb0f2-819d-422e-a94d-6c2318228c50 admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:34.748429 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0eb0f2-819d-422e-a94d-6c2318228c50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:34.750467 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0eb0f2-819d-422e-a94d-6c2318228c50 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:34.761596 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 791/1576] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:48:34 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:48:34.762824 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77476ca7-7e16-42aa-97f9-67b060b26ba0 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:34.777427 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 786/1577] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:48:34 2022] POST /identity/v3/users => generated 282 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:48:34.777427 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0eb0f2-819d-422e-a94d-6c2318228c50 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:34.785016 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0eb0f2-819d-422e-a94d-6c2318228c50 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:34.789645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af7b39-6518-489f-9deb-438a1539096b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:34.790317 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af7b39-6518-489f-9deb-438a1539096b admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:34.790603 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af7b39-6518-489f-9deb-438a1539096b admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:34.790879 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af7b39-6518-489f-9deb-438a1539096b admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:34.791559 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af7b39-6518-489f-9deb-438a1539096b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:34.793789 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af7b39-6518-489f-9deb-438a1539096b admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:34.820198 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 787/1578] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:48:34 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:48:34.820991 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af7b39-6518-489f-9deb-438a1539096b admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:34.825974 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77476ca7-7e16-42aa-97f9-67b060b26ba0 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:34.874928 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca67b9-32bd-4a38-9c7b-df000d925c39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:34.875606 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca67b9-32bd-4a38-9c7b-df000d925c39 service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:34.875954 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca67b9-32bd-4a38-9c7b-df000d925c39 service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:34.876163 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca67b9-32bd-4a38-9c7b-df000d925c39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:34.884693 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af7b39-6518-489f-9deb-438a1539096b admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:34.885535 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcca67b9-32bd-4a38-9c7b-df000d925c39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:34.887101 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcca67b9-32bd-4a38-9c7b-df000d925c39 service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:34.889270 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df722817-0ac1-4498-8e0c-7f76539d6bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:34.890028 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df722817-0ac1-4498-8e0c-7f76539d6bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:34.890307 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df722817-0ac1-4498-8e0c-7f76539d6bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:34.890575 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df722817-0ac1-4498-8e0c-7f76539d6bc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:34.891397 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df722817-0ac1-4498-8e0c-7f76539d6bc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:34.893802 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df722817-0ac1-4498-8e0c-7f76539d6bc1 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:34.896522 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 792/1579] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:34.897291 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca67b9-32bd-4a38-9c7b-df000d925c39 service neutron] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:34.906221 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca67b9-32bd-4a38-9c7b-df000d925c39 service neutron] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:34.911880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9308f-cc73-4921-a728-2dbdbb84a9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:34.912685 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9308f-cc73-4921-a728-2dbdbb84a9bb admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:34.912958 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9308f-cc73-4921-a728-2dbdbb84a9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:34.913553 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9308f-cc73-4921-a728-2dbdbb84a9bb admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:34.914319 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f9308f-cc73-4921-a728-2dbdbb84a9bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:34.915943 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f9308f-cc73-4921-a728-2dbdbb84a9bb admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:34.922730 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 788/1580] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:48:34 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:48:34.923699 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df722817-0ac1-4498-8e0c-7f76539d6bc1 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:34.929357 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 793/1581] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:48:34.930288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9308f-cc73-4921-a728-2dbdbb84a9bb admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:34.941477 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9308f-cc73-4921-a728-2dbdbb84a9bb admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:34.950855 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:34.997128 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df722817-0ac1-4498-8e0c-7f76539d6bc1 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:35.002082 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70615de-91d0-444e-b3b3-2b25d78bb515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:35.002926 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70615de-91d0-444e-b3b3-2b25d78bb515 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:35.003350 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70615de-91d0-444e-b3b3-2b25d78bb515 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:35.003594 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70615de-91d0-444e-b3b3-2b25d78bb515 admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:35.004470 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70615de-91d0-444e-b3b3-2b25d78bb515 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:35.006447 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70615de-91d0-444e-b3b3-2b25d78bb515 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:35.007484 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298da13-35f3-4e25-b9f0-7eecda1f0fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:35.008293 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298da13-35f3-4e25-b9f0-7eecda1f0fbb admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:35.008633 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298da13-35f3-4e25-b9f0-7eecda1f0fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:35.008968 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298da13-35f3-4e25-b9f0-7eecda1f0fbb admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:35.009725 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6298da13-35f3-4e25-b9f0-7eecda1f0fbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:35.011719 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6298da13-35f3-4e25-b9f0-7eecda1f0fbb admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:35.016840 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:35.037222 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 789/1582] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:48:34 2022] POST /identity/v3/users => generated 286 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:48:35.037222 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70615de-91d0-444e-b3b3-2b25d78bb515 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:35.047047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 794/1583] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:48:34 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:48:35.047047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298da13-35f3-4e25-b9f0-7eecda1f0fbb admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:35.047329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70615de-91d0-444e-b3b3-2b25d78bb515 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:35.125057 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298da13-35f3-4e25-b9f0-7eecda1f0fbb admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:35.132643 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94033a60-a658-4f4e-9e09-c525f6e5de93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:35.133392 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0c924-d043-44cf-9290-93bb47890909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:35.133524 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94033a60-a658-4f4e-9e09-c525f6e5de93 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:35.133810 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94033a60-a658-4f4e-9e09-c525f6e5de93 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:35.134116 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0c924-d043-44cf-9290-93bb47890909 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:35.134239 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94033a60-a658-4f4e-9e09-c525f6e5de93 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:35.134409 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0c924-d043-44cf-9290-93bb47890909 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:35.134668 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0c924-d043-44cf-9290-93bb47890909 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:35.134969 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94033a60-a658-4f4e-9e09-c525f6e5de93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:35.135406 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0c924-d043-44cf-9290-93bb47890909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:35.136741 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94033a60-a658-4f4e-9e09-c525f6e5de93 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:35.137291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0c924-d043-44cf-9290-93bb47890909 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:35.151604 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 795/1584] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:48:35.151604 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94033a60-a658-4f4e-9e09-c525f6e5de93 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:35.155909 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 790/1585] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:48:35.156872 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0c924-d043-44cf-9290-93bb47890909 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:35.167846 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94033a60-a658-4f4e-9e09-c525f6e5de93 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:35.168015 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0c924-d043-44cf-9290-93bb47890909 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:35.173078 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbba8b8-d977-43f3-834e-7c0f924359d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:35.173505 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbba8b8-d977-43f3-834e-7c0f924359d7 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:35.173942 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbba8b8-d977-43f3-834e-7c0f924359d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:35.174318 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbba8b8-d977-43f3-834e-7c0f924359d7 admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:35.174423 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95557681-39de-470b-8937-2d5336e763f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:35.175026 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbba8b8-d977-43f3-834e-7c0f924359d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:35.175148 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95557681-39de-470b-8937-2d5336e763f3 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:35.175410 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95557681-39de-470b-8937-2d5336e763f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:35.176414 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95557681-39de-470b-8937-2d5336e763f3 admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:35.177122 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbba8b8-d977-43f3-834e-7c0f924359d7 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:35.177235 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95557681-39de-470b-8937-2d5336e763f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:35.179471 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95557681-39de-470b-8937-2d5336e763f3 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:35.204119 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 791/1586] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:48:35 2022] POST /identity/v3/users => generated 287 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:48:35.204119 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbba8b8-d977-43f3-834e-7c0f924359d7 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:35.204436 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 796/1587] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:48:35 2022] POST /identity/v3/users => generated 284 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:48:35.204436 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95557681-39de-470b-8937-2d5336e763f3 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:35.215544 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95557681-39de-470b-8937-2d5336e763f3 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:35.216732 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbba8b8-d977-43f3-834e-7c0f924359d7 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:35.220217 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7065a0b-38a6-48cd-9f60-fe414fe3aeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:35.220929 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7065a0b-38a6-48cd-9f60-fe414fe3aeef admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:35.221211 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7065a0b-38a6-48cd-9f60-fe414fe3aeef admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:35.221484 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7065a0b-38a6-48cd-9f60-fe414fe3aeef admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:35.222129 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d72823-c4b2-4d18-83bd-97cb37ba8cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:35.222282 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7065a0b-38a6-48cd-9f60-fe414fe3aeef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:35.223523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d72823-c4b2-4d18-83bd-97cb37ba8cdf admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:35.223830 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7065a0b-38a6-48cd-9f60-fe414fe3aeef admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:35.224204 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d72823-c4b2-4d18-83bd-97cb37ba8cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:35.224669 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d72823-c4b2-4d18-83bd-97cb37ba8cdf admin admin] PATH_INFO: `/v3/projects/3bd1fbab26fd4467a70369892dc4babe/users/f240a106d1814e0b919b222517c8c381/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:35.236897 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 797/1588] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:48:35.238222 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7065a0b-38a6-48cd-9f60-fe414fe3aeef admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:35.243624 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d72823-c4b2-4d18-83bd-97cb37ba8cdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bd1fbab26fd4467a70369892dc4babe, user_id=f240a106d1814e0b919b222517c8c381, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:35.246470 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d72823-c4b2-4d18-83bd-97cb37ba8cdf admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:35.249872 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7065a0b-38a6-48cd-9f60-fe414fe3aeef admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:35.255565 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a85381-3d66-4e53-802d-56ced52b571e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:35.258651 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a85381-3d66-4e53-802d-56ced52b571e admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:35.259041 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a85381-3d66-4e53-802d-56ced52b571e admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:35.259329 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a85381-3d66-4e53-802d-56ced52b571e admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:35.260127 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a85381-3d66-4e53-802d-56ced52b571e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:35.262479 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a85381-3d66-4e53-802d-56ced52b571e admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:35.267871 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 792/1589] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:48:35 2022] PUT /identity/v3/projects/3bd1fbab26fd4467a70369892dc4babe/users/f240a106d1814e0b919b222517c8c381/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:48:35.268830 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d72823-c4b2-4d18-83bd-97cb37ba8cdf admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:35.290677 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 798/1590] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:48:35 2022] POST /identity/v3/users => generated 294 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:48:35.292192 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a85381-3d66-4e53-802d-56ced52b571e admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:35.307567 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a85381-3d66-4e53-802d-56ced52b571e admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:35.348305 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d72823-c4b2-4d18-83bd-97cb37ba8cdf admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:35.353779 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0e4a8-ab69-497b-8a2c-22aa21d205b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:35.354634 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0e4a8-ab69-497b-8a2c-22aa21d205b8 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:35.354957 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0e4a8-ab69-497b-8a2c-22aa21d205b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:35.355239 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0e4a8-ab69-497b-8a2c-22aa21d205b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:35.356151 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0e4a8-ab69-497b-8a2c-22aa21d205b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:35.357913 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0e4a8-ab69-497b-8a2c-22aa21d205b8 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:35.368461 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:35.370888 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 793/1591] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:48:35.371843 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0e4a8-ab69-497b-8a2c-22aa21d205b8 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:35.382662 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0e4a8-ab69-497b-8a2c-22aa21d205b8 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:35.387785 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bcf5a8-c05b-4a61-b46f-81060ec99c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:35.388131 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec9bc4-5956-494b-b786-ffa9d8183494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:35.388561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcf5a8-c05b-4a61-b46f-81060ec99c5a admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:35.388913 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcf5a8-c05b-4a61-b46f-81060ec99c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:35.389039 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec9bc4-5956-494b-b786-ffa9d8183494 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:35.389303 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcf5a8-c05b-4a61-b46f-81060ec99c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:35.389433 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec9bc4-5956-494b-b786-ffa9d8183494 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:35.389748 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec9bc4-5956-494b-b786-ffa9d8183494 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:35.390271 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bcf5a8-c05b-4a61-b46f-81060ec99c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:35.390630 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec9bc4-5956-494b-b786-ffa9d8183494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:35.392069 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bcf5a8-c05b-4a61-b46f-81060ec99c5a admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:35.392458 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec9bc4-5956-494b-b786-ffa9d8183494 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:35.406450 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 794/1592] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:48:35.406450 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bcf5a8-c05b-4a61-b46f-81060ec99c5a admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:35.406772 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 799/1593] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:48:35.407661 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec9bc4-5956-494b-b786-ffa9d8183494 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:35.420296 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bcf5a8-c05b-4a61-b46f-81060ec99c5a admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:35.421392 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec9bc4-5956-494b-b786-ffa9d8183494 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:35.425718 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5bcc17-d924-412b-9ec6-29ebb456d342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:35.426482 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5bcc17-d924-412b-9ec6-29ebb456d342 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:35.426834 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5bcc17-d924-412b-9ec6-29ebb456d342 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:35.427179 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5bcc17-d924-412b-9ec6-29ebb456d342 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:35.428138 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644459db-1466-4e0b-ab9a-d72235395662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:35.428296 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5bcc17-d924-412b-9ec6-29ebb456d342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:35.428813 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644459db-1466-4e0b-ab9a-d72235395662 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:35.429096 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644459db-1466-4e0b-ab9a-d72235395662 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:35.429368 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644459db-1466-4e0b-ab9a-d72235395662 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:35.429938 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5bcc17-d924-412b-9ec6-29ebb456d342 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:35.430139 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644459db-1466-4e0b-ab9a-d72235395662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:35.432492 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644459db-1466-4e0b-ab9a-d72235395662 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:35.441016 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 795/1594] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:48:35.447751 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 800/1595] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:48:35.447920 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46aef6f-1540-49b5-9cd8-3ea270964ad3 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:35.447920 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46aef6f-1540-49b5-9cd8-3ea270964ad3 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:35.447920 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46aef6f-1540-49b5-9cd8-3ea270964ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:35.448229 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644459db-1466-4e0b-ab9a-d72235395662 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:35.458590 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644459db-1466-4e0b-ab9a-d72235395662 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:35.463563 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa505465-0339-4579-a982-bacc6a2a2e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:35.464375 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa505465-0339-4579-a982-bacc6a2a2e5f admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:35.464592 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-f46aef6f-1540-49b5-9cd8-3ea270964ad3 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:35.464781 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa505465-0339-4579-a982-bacc6a2a2e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:35.465146 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa505465-0339-4579-a982-bacc6a2a2e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:35.465959 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-f46aef6f-1540-49b5-9cd8-3ea270964ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:35.466074 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa505465-0339-4579-a982-bacc6a2a2e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:35.467671 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa505465-0339-4579-a982-bacc6a2a2e5f admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:35.473815 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 796/1596] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:35.477114 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46aef6f-1540-49b5-9cd8-3ea270964ad3 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:35.484009 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46aef6f-1540-49b5-9cd8-3ea270964ad3 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:35.485999 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 801/1597] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:48:35.486968 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa505465-0339-4579-a982-bacc6a2a2e5f admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:35.491871 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d0fa6-5234-4fdf-b4ad-f7247a169dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:35.492983 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d0fa6-5234-4fdf-b4ad-f7247a169dcd admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:35.493370 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d0fa6-5234-4fdf-b4ad-f7247a169dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:35.493740 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d0fa6-5234-4fdf-b4ad-f7247a169dcd admin admin] PATH_INFO: `/v3/projects/4b1a4df9ef5149469cd526df761aeb94/users/47348fd92c5c44dbb8c6b518cf8481ac/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:35.497582 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa505465-0339-4579-a982-bacc6a2a2e5f admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:35.504568 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca6763-72aa-4f19-a749-1920c3105a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:35.505329 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca6763-72aa-4f19-a749-1920c3105a3c admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:35.505673 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca6763-72aa-4f19-a749-1920c3105a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:35.506083 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca6763-72aa-4f19-a749-1920c3105a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:35.506891 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca6763-72aa-4f19-a749-1920c3105a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:35.507545 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:35.508722 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca6763-72aa-4f19-a749-1920c3105a3c admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:35.514289 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d0fa6-5234-4fdf-b4ad-f7247a169dcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b1a4df9ef5149469cd526df761aeb94, user_id=47348fd92c5c44dbb8c6b518cf8481ac, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:35.517168 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d0fa6-5234-4fdf-b4ad-f7247a169dcd admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:35.519645 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 802/1598] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:48:35.520628 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca6763-72aa-4f19-a749-1920c3105a3c admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:35.532176 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca6763-72aa-4f19-a749-1920c3105a3c admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:35.535168 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 797/1599] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:48:35 2022] PUT /identity/v3/projects/4b1a4df9ef5149469cd526df761aeb94/users/47348fd92c5c44dbb8c6b518cf8481ac/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:48:35.536112 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d0fa6-5234-4fdf-b4ad-f7247a169dcd admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:35.603293 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d0fa6-5234-4fdf-b4ad-f7247a169dcd admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:35.608751 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2751dfd-c9cc-4178-99d6-0e7a8e804ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:35.609542 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2751dfd-c9cc-4178-99d6-0e7a8e804ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:35.609924 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2751dfd-c9cc-4178-99d6-0e7a8e804ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:35.610261 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2751dfd-c9cc-4178-99d6-0e7a8e804ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:35.611060 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2751dfd-c9cc-4178-99d6-0e7a8e804ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:35.612925 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2751dfd-c9cc-4178-99d6-0e7a8e804ab4 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:35.616396 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf2133-e3ba-45fa-8da9-7bcb995b5a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:35.617387 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf2133-e3ba-45fa-8da9-7bcb995b5a3d admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:35.617728 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf2133-e3ba-45fa-8da9-7bcb995b5a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:35.618091 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf2133-e3ba-45fa-8da9-7bcb995b5a3d admin admin] PATH_INFO: `/v3/projects/61f25a3062bf49a78c6872c66daa887d/users/96c018ba46da45b3a079189aafdcdecd/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:35.626964 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 798/1600] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:48:35.627575 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2751dfd-c9cc-4178-99d6-0e7a8e804ab4 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:35.639299 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2751dfd-c9cc-4178-99d6-0e7a8e804ab4 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:35.644747 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5ce57-14ac-4acb-9ac5-4e6019beb650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:35.645742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5ce57-14ac-4acb-9ac5-4e6019beb650 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:35.646147 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5ce57-14ac-4acb-9ac5-4e6019beb650 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:35.646475 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5ce57-14ac-4acb-9ac5-4e6019beb650 admin admin] PATH_INFO: `/v3/projects/ddb1873b0486469980166145a8c9ec6e/users/47994775a2ce412793145808b1d8fbac/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:35.660177 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf2133-e3ba-45fa-8da9-7bcb995b5a3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=61f25a3062bf49a78c6872c66daa887d, user_id=96c018ba46da45b3a079189aafdcdecd, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:35.662570 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5ce57-14ac-4acb-9ac5-4e6019beb650 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddb1873b0486469980166145a8c9ec6e, user_id=47994775a2ce412793145808b1d8fbac, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:35.665449 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5ce57-14ac-4acb-9ac5-4e6019beb650 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:35.665751 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf2133-e3ba-45fa-8da9-7bcb995b5a3d admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:35.688318 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 803/1602] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:48:35 2022] PUT /identity/v3/projects/61f25a3062bf49a78c6872c66daa887d/users/96c018ba46da45b3a079189aafdcdecd/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:48:35.689452 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf2133-e3ba-45fa-8da9-7bcb995b5a3d admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:35.690191 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 799/1602] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:48:35 2022] PUT /identity/v3/projects/ddb1873b0486469980166145a8c9ec6e/users/47994775a2ce412793145808b1d8fbac/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:48:35.693025 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5ce57-14ac-4acb-9ac5-4e6019beb650 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:35.764192 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf2133-e3ba-45fa-8da9-7bcb995b5a3d admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:35.769445 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3673474-728f-4fc3-99f7-dd8662beb83f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:35.770334 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5ce57-14ac-4acb-9ac5-4e6019beb650 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:35.770528 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3673474-728f-4fc3-99f7-dd8662beb83f service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:35.770906 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3673474-728f-4fc3-99f7-dd8662beb83f service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:35.771390 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3673474-728f-4fc3-99f7-dd8662beb83f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:35.835164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:35.841771 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0399c6-e2c1-453e-aee8-1dc02d87ab40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:35.842579 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0399c6-e2c1-453e-aee8-1dc02d87ab40 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:35.842861 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0399c6-e2c1-453e-aee8-1dc02d87ab40 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:35.843148 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0399c6-e2c1-453e-aee8-1dc02d87ab40 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:35.843977 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0399c6-e2c1-453e-aee8-1dc02d87ab40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:35.846182 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0399c6-e2c1-453e-aee8-1dc02d87ab40 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:35.858656 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3673474-728f-4fc3-99f7-dd8662beb83f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:35.862977 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 800/1603] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:48:35.862977 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0399c6-e2c1-453e-aee8-1dc02d87ab40 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:35.864120 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3673474-728f-4fc3-99f7-dd8662beb83f service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:35.871238 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:35.875357 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 804/1604] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:35.877112 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cc7a2-cc9b-46b6-a669-0bb65bc4ed5f None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:35.877400 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cc7a2-cc9b-46b6-a669-0bb65bc4ed5f None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:35.877863 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cc7a2-cc9b-46b6-a669-0bb65bc4ed5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:35.877999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0399c6-e2c1-453e-aee8-1dc02d87ab40 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:35.884527 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b43c8-040f-4efe-8698-d2b1da3d9bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:35.886987 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b43c8-040f-4efe-8698-d2b1da3d9bf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:35.887777 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b43c8-040f-4efe-8698-d2b1da3d9bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:35.888162 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b43c8-040f-4efe-8698-d2b1da3d9bf9 admin admin] PATH_INFO: `/v3/projects/4c6550ff5b4e43808416d5fd90cca7c0/users/554ee3a69d42468a8f6b6a1a8cb6982e/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:35.906601 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b43c8-040f-4efe-8698-d2b1da3d9bf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c6550ff5b4e43808416d5fd90cca7c0, user_id=554ee3a69d42468a8f6b6a1a8cb6982e, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:35.910061 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b43c8-040f-4efe-8698-d2b1da3d9bf9 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:35.911833 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-d94cc7a2-cc9b-46b6-a669-0bb65bc4ed5f None None] MFA Rules not processed for user `47348fd92c5c44dbb8c6b518cf8481ac`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:35.913180 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-d94cc7a2-cc9b-46b6-a669-0bb65bc4ed5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:35.932072 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 801/1605] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:48:35 2022] PUT /identity/v3/projects/4c6550ff5b4e43808416d5fd90cca7c0/users/554ee3a69d42468a8f6b6a1a8cb6982e/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:48:35.933521 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b43c8-040f-4efe-8698-d2b1da3d9bf9 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:35.997288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 805/1606] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:35 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:35.998956 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99a1fd-4616-43f1-a65c-01dc250ff99c None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:35.999248 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99a1fd-4616-43f1-a65c-01dc250ff99c None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:35.999525 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99a1fd-4616-43f1-a65c-01dc250ff99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:36.022293 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-6b99a1fd-4616-43f1-a65c-01dc250ff99c None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:36.023785 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-6b99a1fd-4616-43f1-a65c-01dc250ff99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:36.024066 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b43c8-040f-4efe-8698-d2b1da3d9bf9 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:36.030204 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1006390-9f0c-4f08-9c36-3de23f053b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:36.031243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1006390-9f0c-4f08-9c36-3de23f053b4a admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:36.031596 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1006390-9f0c-4f08-9c36-3de23f053b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:36.031941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1006390-9f0c-4f08-9c36-3de23f053b4a admin admin] PATH_INFO: `/v3/projects/c6c4293e87864db4a560cd2591f9ecb7/users/bf3041cfeb044f0a91b3419ca95fee54/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:36.032921 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 806/1607] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:36.034405 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22413d1-a586-4a4e-a3d6-dc4308210d56 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:36.034713 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22413d1-a586-4a4e-a3d6-dc4308210d56 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:36.034977 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22413d1-a586-4a4e-a3d6-dc4308210d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:36.054599 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1006390-9f0c-4f08-9c36-3de23f053b4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6c4293e87864db4a560cd2591f9ecb7, user_id=bf3041cfeb044f0a91b3419ca95fee54, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:36.057339 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1006390-9f0c-4f08-9c36-3de23f053b4a admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:36.072432 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-b22413d1-a586-4a4e-a3d6-dc4308210d56 None None] MFA Rules not processed for user `47994775a2ce412793145808b1d8fbac`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:36.074576 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-b22413d1-a586-4a4e-a3d6-dc4308210d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:36.084190 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 802/1608] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:48:35 2022] PUT /identity/v3/projects/c6c4293e87864db4a560cd2591f9ecb7/users/bf3041cfeb044f0a91b3419ca95fee54/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:48:36.085471 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1006390-9f0c-4f08-9c36-3de23f053b4a admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:36.193796 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1006390-9f0c-4f08-9c36-3de23f053b4a admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:36.199878 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82f607-a2e8-4854-b72c-4d4df1346502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:36.201195 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82f607-a2e8-4854-b72c-4d4df1346502 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:36.201877 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82f607-a2e8-4854-b72c-4d4df1346502 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:36.203032 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82f607-a2e8-4854-b72c-4d4df1346502 admin admin] PATH_INFO: `/v3/projects/15de4592868d4fa79817f1761b2003e0/users/1f6d6f1250b14637bb24345550161cda/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:36.219679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 807/1609] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:36.220052 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca82f607-a2e8-4854-b72c-4d4df1346502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15de4592868d4fa79817f1761b2003e0, user_id=1f6d6f1250b14637bb24345550161cda, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:36.221690 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63a287-1907-426f-9fab-55928e400a8f None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:36.222327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63a287-1907-426f-9fab-55928e400a8f None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:36.223104 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63a287-1907-426f-9fab-55928e400a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:36.223387 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca82f607-a2e8-4854-b72c-4d4df1346502 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:36.247537 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 803/1610] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:48:36 2022] PUT /identity/v3/projects/15de4592868d4fa79817f1761b2003e0/users/1f6d6f1250b14637bb24345550161cda/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:48:36.248478 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82f607-a2e8-4854-b72c-4d4df1346502 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:36.260190 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-ae63a287-1907-426f-9fab-55928e400a8f None None] MFA Rules not processed for user `554ee3a69d42468a8f6b6a1a8cb6982e`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:36.261867 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-ae63a287-1907-426f-9fab-55928e400a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:36.328967 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:36.329988 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:36.359490 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82f607-a2e8-4854-b72c-4d4df1346502 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:36.360829 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 808/1611] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:36.362370 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae63a287-1907-426f-9fab-55928e400a8f None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:36.369668 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1926609a-fb5a-4b12-808d-c9f8e277e61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:36.370811 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926609a-fb5a-4b12-808d-c9f8e277e61d admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:36.371579 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926609a-fb5a-4b12-808d-c9f8e277e61d admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:36.372126 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926609a-fb5a-4b12-808d-c9f8e277e61d admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:36.373362 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1926609a-fb5a-4b12-808d-c9f8e277e61d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:36.376392 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1926609a-fb5a-4b12-808d-c9f8e277e61d admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:36.443601 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 804/1612] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:48:36 2022] POST /identity/v3/projects => generated 365 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:48:36.468650 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed72bc2-9eee-4cf2-8d96-4c989a715e8c None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:36.470106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed72bc2-9eee-4cf2-8d96-4c989a715e8c None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:36.470223 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed72bc2-9eee-4cf2-8d96-4c989a715e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:36.487628 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae63a287-1907-426f-9fab-55928e400a8f None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:36.524541 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-8ed72bc2-9eee-4cf2-8d96-4c989a715e8c None None] MFA Rules not processed for user `bf3041cfeb044f0a91b3419ca95fee54`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:36.525918 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-8ed72bc2-9eee-4cf2-8d96-4c989a715e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:36.551180 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39009d9e-bb76-4e20-ae6d-6d2a0f44d4d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:36.552225 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39009d9e-bb76-4e20-ae6d-6d2a0f44d4d5 service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:36.552701 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39009d9e-bb76-4e20-ae6d-6d2a0f44d4d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:36.552979 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39009d9e-bb76-4e20-ae6d-6d2a0f44d4d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:36.608051 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 805/1613] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:36 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:36.609095 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed72bc2-9eee-4cf2-8d96-4c989a715e8c None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:36.641792 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39009d9e-bb76-4e20-ae6d-6d2a0f44d4d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:36.643953 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39009d9e-bb76-4e20-ae6d-6d2a0f44d4d5 service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:36.657505 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 809/1614] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:36.658373 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f181af-2bee-4b52-bf24-88dda5fd44a7 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:36.658758 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f181af-2bee-4b52-bf24-88dda5fd44a7 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:36.659140 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f181af-2bee-4b52-bf24-88dda5fd44a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:36.680512 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-33f181af-2bee-4b52-bf24-88dda5fd44a7 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:36.682860 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-33f181af-2bee-4b52-bf24-88dda5fd44a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:36.695505 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 810/1615] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:36.697132 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab64d9-534e-4bd6-b398-ec2cae141e2c None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:36.697497 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab64d9-534e-4bd6-b398-ec2cae141e2c None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:36.697870 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab64d9-534e-4bd6-b398-ec2cae141e2c None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:36.699345 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 811/1616] 10.222.0.27 () {54 vars in 961 bytes} [Tue Jul 5 20:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:48:36.700119 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab64d9-534e-4bd6-b398-ec2cae141e2c None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:36.714023 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab64d9-534e-4bd6-b398-ec2cae141e2c None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:36.716264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed72bc2-9eee-4cf2-8d96-4c989a715e8c None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:36.719707 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98adbb67-024c-433d-9256-6fd453e77021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:36.720468 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adbb67-024c-433d-9256-6fd453e77021 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:36.720860 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adbb67-024c-433d-9256-6fd453e77021 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:36.721233 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adbb67-024c-433d-9256-6fd453e77021 admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:36.721936 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740873c-d97f-4c63-816b-d2b832e83dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:36.722175 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98adbb67-024c-433d-9256-6fd453e77021 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:36.722905 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740873c-d97f-4c63-816b-d2b832e83dcd admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:36.723249 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740873c-d97f-4c63-816b-d2b832e83dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:36.723590 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740873c-d97f-4c63-816b-d2b832e83dcd admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:36.724403 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740873c-d97f-4c63-816b-d2b832e83dcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:36.724631 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98adbb67-024c-433d-9256-6fd453e77021 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:36.727074 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740873c-d97f-4c63-816b-d2b832e83dcd admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:36.758561 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 812/1617] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:48:36 2022] POST /identity/v3/users => generated 289 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:48:36.759442 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98adbb67-024c-433d-9256-6fd453e77021 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:36.851654 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 806/1618] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:48:36 2022] POST /identity/v3/projects => generated 371 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:48:36.851654 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b28b8-116e-480a-bb0c-c4523e4795aa None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:36.851654 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b28b8-116e-480a-bb0c-c4523e4795aa None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:36.851654 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b28b8-116e-480a-bb0c-c4523e4795aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:36.880700 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:36.881072 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-fb8b28b8-116e-480a-bb0c-c4523e4795aa None None] MFA Rules not processed for user `814b675b98b844a2a12a39890ee69d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:36.884502 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-fb8b28b8-116e-480a-bb0c-c4523e4795aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:36.938217 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98adbb67-024c-433d-9256-6fd453e77021 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:36.984672 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:37.035342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 807/1619] 10.222.0.27 () {58 vars in 1058 bytes} [Tue Jul 5 20:48:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:37.036290 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b28b8-116e-480a-bb0c-c4523e4795aa None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:37.049240 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ebff4-96d2-4570-8a5f-475dda09cc11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:37.051062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ebff4-96d2-4570-8a5f-475dda09cc11 service cinder] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:37.051447 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ebff4-96d2-4570-8a5f-475dda09cc11 service cinder] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:37.052359 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ebff4-96d2-4570-8a5f-475dda09cc11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:37.120005 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b28b8-116e-480a-bb0c-c4523e4795aa None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:37.125473 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec1397-bc1d-4ce4-85b0-3824ebd0d481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:37.126624 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec1397-bc1d-4ce4-85b0-3824ebd0d481 service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:37.127209 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec1397-bc1d-4ce4-85b0-3824ebd0d481 service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:37.127703 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec1397-bc1d-4ce4-85b0-3824ebd0d481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:37.139978 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ebff4-96d2-4570-8a5f-475dda09cc11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:37.142525 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ebff4-96d2-4570-8a5f-475dda09cc11 service cinder] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:37.180463 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 813/1620] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:36 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:37.181685 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ebff4-96d2-4570-8a5f-475dda09cc11 service cinder] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:37.221682 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec1397-bc1d-4ce4-85b0-3824ebd0d481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:37.223669 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec1397-bc1d-4ce4-85b0-3824ebd0d481 service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:37.235801 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 808/1621] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:37.237148 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec1397-bc1d-4ce4-85b0-3824ebd0d481 service neutron] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:37.248213 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec1397-bc1d-4ce4-85b0-3824ebd0d481 service neutron] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:37.254392 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe1ff8-91c3-409b-a8cf-5cfd0eb800df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:37.255554 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe1ff8-91c3-409b-a8cf-5cfd0eb800df admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:37.256042 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe1ff8-91c3-409b-a8cf-5cfd0eb800df admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:37.257063 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe1ff8-91c3-409b-a8cf-5cfd0eb800df admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:37.258115 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe1ff8-91c3-409b-a8cf-5cfd0eb800df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:37.260284 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe1ff8-91c3-409b-a8cf-5cfd0eb800df admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:37.291715 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 809/1622] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:48:37 2022] POST /identity/v3/users => generated 292 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:48:37.293298 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe1ff8-91c3-409b-a8cf-5cfd0eb800df admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:37.322654 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe1ff8-91c3-409b-a8cf-5cfd0eb800df admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:37.337554 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac29012-fc29-4505-b409-fc8a70fd7083 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:37.339253 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac29012-fc29-4505-b409-fc8a70fd7083 service nova] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:37.342337 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac29012-fc29-4505-b409-fc8a70fd7083 service nova] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:37.343802 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac29012-fc29-4505-b409-fc8a70fd7083 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:37.373502 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ebff4-96d2-4570-8a5f-475dda09cc11 service cinder] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:37.388926 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40119abb-f210-4a9f-8758-4fed8d315d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:37.390007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40119abb-f210-4a9f-8758-4fed8d315d49 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:37.390381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40119abb-f210-4a9f-8758-4fed8d315d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:37.390780 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40119abb-f210-4a9f-8758-4fed8d315d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:37.392300 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40119abb-f210-4a9f-8758-4fed8d315d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:37.395535 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40119abb-f210-4a9f-8758-4fed8d315d49 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:37.426824 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 814/1623] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:48:37.430489 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40119abb-f210-4a9f-8758-4fed8d315d49 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:37.461888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40119abb-f210-4a9f-8758-4fed8d315d49 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:37.475501 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3f449-d0b2-467c-a2e8-c543e82c40dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:37.476407 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3f449-d0b2-467c-a2e8-c543e82c40dd admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:37.476531 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3f449-d0b2-467c-a2e8-c543e82c40dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:37.476718 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3f449-d0b2-467c-a2e8-c543e82c40dd admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:37.477447 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3f449-d0b2-467c-a2e8-c543e82c40dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:37.479128 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3f449-d0b2-467c-a2e8-c543e82c40dd admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:37.502439 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac29012-fc29-4505-b409-fc8a70fd7083 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:37.504170 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac29012-fc29-4505-b409-fc8a70fd7083 service nova] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:37.517598 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 815/1624] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:48:37.518587 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3f449-d0b2-467c-a2e8-c543e82c40dd admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:37.531780 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 810/1625] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:37.534463 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac29012-fc29-4505-b409-fc8a70fd7083 service nova] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:37.544469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3f449-d0b2-467c-a2e8-c543e82c40dd admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:37.554193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f3cd4-a416-4989-afa5-9a6cbcc1a78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:37.555113 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f3cd4-a416-4989-afa5-9a6cbcc1a78c admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:37.555396 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f3cd4-a416-4989-afa5-9a6cbcc1a78c admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:37.555672 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f3cd4-a416-4989-afa5-9a6cbcc1a78c admin admin] PATH_INFO: `/v3/projects/269f2cccbd3f4fa68dc92f5e2b80820f/users/2e1056db930a418486ea977195a32401/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:37.561908 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac29012-fc29-4505-b409-fc8a70fd7083 service nova] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:37.573789 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6fa825-4196-4060-bf41-55a0a7e764a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:37.575089 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fa825-4196-4060-bf41-55a0a7e764a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:37.575368 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fa825-4196-4060-bf41-55a0a7e764a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:37.576452 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fa825-4196-4060-bf41-55a0a7e764a3 admin admin] PATH_INFO: `/v3/projects/d794fa340fa549a79422b80c01b10133/users/92eb98196d4a4837ad89d39da5999b15/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:37.584189 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:37.594336 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f3cd4-a416-4989-afa5-9a6cbcc1a78c admin admin] RBAC: Authorizing `identity:create_grant(project_id=269f2cccbd3f4fa68dc92f5e2b80820f, user_id=2e1056db930a418486ea977195a32401, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:37.601060 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f3cd4-a416-4989-afa5-9a6cbcc1a78c admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:37.613300 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6fa825-4196-4060-bf41-55a0a7e764a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d794fa340fa549a79422b80c01b10133, user_id=92eb98196d4a4837ad89d39da5999b15, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:37.616335 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6fa825-4196-4060-bf41-55a0a7e764a3 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:37.634292 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:37.639756 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 816/1626] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:48:37 2022] PUT /identity/v3/projects/269f2cccbd3f4fa68dc92f5e2b80820f/users/2e1056db930a418486ea977195a32401/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:48:37.644829 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 811/1627] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:48:37 2022] PUT /identity/v3/projects/d794fa340fa549a79422b80c01b10133/users/92eb98196d4a4837ad89d39da5999b15/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:48:37.648579 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6fa825-4196-4060-bf41-55a0a7e764a3 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:37.649183 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f3cd4-a416-4989-afa5-9a6cbcc1a78c admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:37.790407 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f3cd4-a416-4989-afa5-9a6cbcc1a78c admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:37.840237 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6fa825-4196-4060-bf41-55a0a7e764a3 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:37.855865 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0236e6-4cfd-4d3d-ad1e-fd72774a8a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:37.857009 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0236e6-4cfd-4d3d-ad1e-fd72774a8a2d admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:37.858211 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0236e6-4cfd-4d3d-ad1e-fd72774a8a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:37.858626 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0236e6-4cfd-4d3d-ad1e-fd72774a8a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:37.862074 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0236e6-4cfd-4d3d-ad1e-fd72774a8a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:37.865042 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0236e6-4cfd-4d3d-ad1e-fd72774a8a2d admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:37.907726 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 812/1628] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:48:37.909324 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0236e6-4cfd-4d3d-ad1e-fd72774a8a2d admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:37.932281 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0236e6-4cfd-4d3d-ad1e-fd72774a8a2d admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:37.952781 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ceec2-27c6-4636-bcdf-1801e576a949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:37.953885 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ceec2-27c6-4636-bcdf-1801e576a949 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:37.954544 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ceec2-27c6-4636-bcdf-1801e576a949 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:37.955615 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ceec2-27c6-4636-bcdf-1801e576a949 admin admin] PATH_INFO: `/v3/projects/d794fa340fa549a79422b80c01b10133/users/92eb98196d4a4837ad89d39da5999b15/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:37.961459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ceec2-27c6-4636-bcdf-1801e576a949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d794fa340fa549a79422b80c01b10133, user_id=92eb98196d4a4837ad89d39da5999b15, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:37.965366 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ceec2-27c6-4636-bcdf-1801e576a949 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:37.975983 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6943760-8ce8-4499-a734-8593519c2c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:37.977628 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6943760-8ce8-4499-a734-8593519c2c0d admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:37.978053 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6943760-8ce8-4499-a734-8593519c2c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:37.978428 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6943760-8ce8-4499-a734-8593519c2c0d admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:37.979591 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6943760-8ce8-4499-a734-8593519c2c0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:37.984365 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6943760-8ce8-4499-a734-8593519c2c0d admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:37.993800 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 813/1629] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:48:37 2022] PUT /identity/v3/projects/d794fa340fa549a79422b80c01b10133/users/92eb98196d4a4837ad89d39da5999b15/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:48:38.007477 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c6791-2e2d-46de-9045-11a971289c7f None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:38.008668 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c6791-2e2d-46de-9045-11a971289c7f None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:38.008792 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c6791-2e2d-46de-9045-11a971289c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:38.018547 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 817/1630] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:48:38.025834 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6943760-8ce8-4499-a734-8593519c2c0d admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:38.037885 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6943760-8ce8-4499-a734-8593519c2c0d admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:38.077929 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-7c8c6791-2e2d-46de-9045-11a971289c7f None None] MFA Rules not processed for user `92eb98196d4a4837ad89d39da5999b15`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:38.080007 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-7c8c6791-2e2d-46de-9045-11a971289c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:38.210110 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 814/1631] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:38 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:38.210110 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19caec2-872a-41c5-9dbf-da23f1f4447c None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:38.210110 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19caec2-872a-41c5-9dbf-da23f1f4447c None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:38.210110 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19caec2-872a-41c5-9dbf-da23f1f4447c None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:38.211155 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 815/1632] 10.222.0.27 () {54 vars in 912 bytes} [Tue Jul 5 20:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:48:38.223874 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687752c7-d185-4915-954d-6d164f82ac15 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:38.224090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687752c7-d185-4915-954d-6d164f82ac15 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:38.224375 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687752c7-d185-4915-954d-6d164f82ac15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:38.240995 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21111fb-09f5-4db2-8d46-3b23eb7c835c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:38.243903 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21111fb-09f5-4db2-8d46-3b23eb7c835c admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:38.244184 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21111fb-09f5-4db2-8d46-3b23eb7c835c admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:38.244458 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21111fb-09f5-4db2-8d46-3b23eb7c835c admin admin] PATH_INFO: `/v3/projects/269f2cccbd3f4fa68dc92f5e2b80820f/users/2e1056db930a418486ea977195a32401/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:38.250499 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21111fb-09f5-4db2-8d46-3b23eb7c835c admin admin] RBAC: Authorizing `identity:create_grant(project_id=269f2cccbd3f4fa68dc92f5e2b80820f, user_id=2e1056db930a418486ea977195a32401, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:38.257879 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21111fb-09f5-4db2-8d46-3b23eb7c835c admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:38.265613 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-687752c7-d185-4915-954d-6d164f82ac15 None None] MFA Rules not processed for user `814b675b98b844a2a12a39890ee69d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:38.268077 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-687752c7-d185-4915-954d-6d164f82ac15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:38.292646 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 818/1633] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:48:38 2022] PUT /identity/v3/projects/269f2cccbd3f4fa68dc92f5e2b80820f/users/2e1056db930a418486ea977195a32401/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:48:38.292646 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21111fb-09f5-4db2-8d46-3b23eb7c835c admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:38.378047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:38.390122 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:38.411781 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21111fb-09f5-4db2-8d46-3b23eb7c835c admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:38.416529 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81309e-c50c-4cda-ba5b-a6b24df2d423 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:38.417901 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81309e-c50c-4cda-ba5b-a6b24df2d423 service cinder] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:38.418353 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81309e-c50c-4cda-ba5b-a6b24df2d423 service cinder] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:38.419164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81309e-c50c-4cda-ba5b-a6b24df2d423 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:38.441344 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 816/1634] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Jul 5 20:48:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:38.442604 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fe4e8-177a-4a84-b0d3-d05ece4bd657 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:38.442888 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fe4e8-177a-4a84-b0d3-d05ece4bd657 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:38.443161 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fe4e8-177a-4a84-b0d3-d05ece4bd657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:38.515853 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-bc4fe4e8-177a-4a84-b0d3-d05ece4bd657 None None] MFA Rules not processed for user `2e1056db930a418486ea977195a32401`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:38.518934 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-bc4fe4e8-177a-4a84-b0d3-d05ece4bd657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:38.568263 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81309e-c50c-4cda-ba5b-a6b24df2d423 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:38.569733 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81309e-c50c-4cda-ba5b-a6b24df2d423 service cinder] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:38.586895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 819/1635] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:38 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:38.587905 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81309e-c50c-4cda-ba5b-a6b24df2d423 service cinder] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:38.608459 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81309e-c50c-4cda-ba5b-a6b24df2d423 service cinder] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:38.616167 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08dce4-b18e-482a-b151-c3d28982c4cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:38.617684 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08dce4-b18e-482a-b151-c3d28982c4cd service cinder] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:38.617815 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08dce4-b18e-482a-b151-c3d28982c4cd service cinder] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:38.618127 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08dce4-b18e-482a-b151-c3d28982c4cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:38.629316 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 817/1636] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:38 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:38.648388 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a08dce4-b18e-482a-b151-c3d28982c4cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:38.649942 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a08dce4-b18e-482a-b151-c3d28982c4cd service cinder] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:38.658049 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fe4e8-177a-4a84-b0d3-d05ece4bd657 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:38.671352 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fe4e8-177a-4a84-b0d3-d05ece4bd657 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:38.677059 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a232634-4e88-4bc8-972b-980213593aa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:38.678236 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a232634-4e88-4bc8-972b-980213593aa5 service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:38.679243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a232634-4e88-4bc8-972b-980213593aa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:38.679876 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a232634-4e88-4bc8-972b-980213593aa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:38.695137 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 820/1637] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:38.696754 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a232634-4e88-4bc8-972b-980213593aa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:38.698270 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a232634-4e88-4bc8-972b-980213593aa5 service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:38.720048 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 818/1638] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:38 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:48:38.869588 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08dce4-b18e-482a-b151-c3d28982c4cd service cinder] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:38.886668 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08dce4-b18e-482a-b151-c3d28982c4cd service cinder] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:38.897129 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57acd86-e4e5-40ca-8236-20c0a2955ade service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:38.899760 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57acd86-e4e5-40ca-8236-20c0a2955ade service cinder] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:38.900195 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57acd86-e4e5-40ca-8236-20c0a2955ade service cinder] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:38.901636 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57acd86-e4e5-40ca-8236-20c0a2955ade service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:39.089208 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57acd86-e4e5-40ca-8236-20c0a2955ade service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:39.097037 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57acd86-e4e5-40ca-8236-20c0a2955ade service cinder] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:39.137723 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 821/1639] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:39.411878 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a232634-4e88-4bc8-972b-980213593aa5 service cinder] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:39.433106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a232634-4e88-4bc8-972b-980213593aa5 service cinder] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:39.442022 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce263590-d63d-4b53-ad4d-b385a6018d16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:39.443196 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce263590-d63d-4b53-ad4d-b385a6018d16 service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:39.444367 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce263590-d63d-4b53-ad4d-b385a6018d16 service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:39.448543 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce263590-d63d-4b53-ad4d-b385a6018d16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:39.596708 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce263590-d63d-4b53-ad4d-b385a6018d16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:39.598249 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce263590-d63d-4b53-ad4d-b385a6018d16 service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:39.627099 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 819/1640] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:39 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:40.403361 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7fab2-459d-401e-856a-1e798bfac05d None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:40.403906 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7fab2-459d-401e-856a-1e798bfac05d None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:40.404594 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7fab2-459d-401e-856a-1e798bfac05d None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:40.405873 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 822/1641] 10.222.0.27 () {54 vars in 961 bytes} [Tue Jul 5 20:48:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:48:40.419668 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca255b-3078-43d6-8d36-db4933c7da3a None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:40.420283 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca255b-3078-43d6-8d36-db4933c7da3a None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:40.420283 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca255b-3078-43d6-8d36-db4933c7da3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:40.442938 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-47ca255b-3078-43d6-8d36-db4933c7da3a None None] MFA Rules not processed for user `814b675b98b844a2a12a39890ee69d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:40.444740 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-47ca255b-3078-43d6-8d36-db4933c7da3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:40.459055 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 820/1642] 10.222.0.27 () {58 vars in 1058 bytes} [Tue Jul 5 20:48:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:40.465374 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0f3b2-f600-464c-8a3a-b6a20cfbb0f7 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:40.466142 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0f3b2-f600-464c-8a3a-b6a20cfbb0f7 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:40.466665 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0f3b2-f600-464c-8a3a-b6a20cfbb0f7 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:40.468512 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 823/1643] 10.222.0.27 () {54 vars in 912 bytes} [Tue Jul 5 20:48:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:48:40.480719 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633825b2-4204-43a6-b54e-bc80359f9a64 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:40.480719 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633825b2-4204-43a6-b54e-bc80359f9a64 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:40.481058 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633825b2-4204-43a6-b54e-bc80359f9a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:40.530733 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-633825b2-4204-43a6-b54e-bc80359f9a64 None None] MFA Rules not processed for user `814b675b98b844a2a12a39890ee69d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:40.533652 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-633825b2-4204-43a6-b54e-bc80359f9a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:40.559407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 821/1644] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Jul 5 20:48:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:40.573013 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0f3b2-f600-464c-8a3a-b6a20cfbb0f7 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:40.588660 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0f3b2-f600-464c-8a3a-b6a20cfbb0f7 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:40.597865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab60f9-86fd-47ed-8489-456de409cda6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:40.599118 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab60f9-86fd-47ed-8489-456de409cda6 service cinder] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:40.599868 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab60f9-86fd-47ed-8489-456de409cda6 service cinder] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:40.600864 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab60f9-86fd-47ed-8489-456de409cda6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:40.631749 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab60f9-86fd-47ed-8489-456de409cda6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:40.634477 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab60f9-86fd-47ed-8489-456de409cda6 service cinder] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:40.650421 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 824/1645] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:43.173586 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633825b2-4204-43a6-b54e-bc80359f9a64 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:43.268003 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:43.301077 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633825b2-4204-43a6-b54e-bc80359f9a64 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:43.308555 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c9a13-f7d6-4c4c-8691-1c4fed529b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:43.309535 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c9a13-f7d6-4c4c-8691-1c4fed529b7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:43.309906 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c9a13-f7d6-4c4c-8691-1c4fed529b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:43.310494 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c9a13-f7d6-4c4c-8691-1c4fed529b7f admin admin] PATH_INFO: `/v3/users/554ee3a69d42468a8f6b6a1a8cb6982e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:43.311782 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c9a13-f7d6-4c4c-8691-1c4fed529b7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=554ee3a69d42468a8f6b6a1a8cb6982e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:43.314100 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c9a13-f7d6-4c4c-8691-1c4fed529b7f admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:43.422429 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c90c9a13-f7d6-4c4c-8691-1c4fed529b7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '554ee3a69d42468a8f6b6a1a8cb6982e'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:43.444110 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c90c9a13-f7d6-4c4c-8691-1c4fed529b7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '554ee3a69d42468a8f6b6a1a8cb6982e'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:43.483865 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c90c9a13-f7d6-4c4c-8691-1c4fed529b7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '554ee3a69d42468a8f6b6a1a8cb6982e'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:43.485155 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c90c9a13-f7d6-4c4c-8691-1c4fed529b7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '554ee3a69d42468a8f6b6a1a8cb6982e'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:43.487747 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c90c9a13-f7d6-4c4c-8691-1c4fed529b7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '554ee3a69d42468a8f6b6a1a8cb6982e'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:43.514947 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 822/1646] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:48:43 2022] DELETE /identity/v3/users/554ee3a69d42468a8f6b6a1a8cb6982e => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:48:43.519826 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd8ff1-faaa-48e2-98c1-9db12f69e937 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:43.520412 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd8ff1-faaa-48e2-98c1-9db12f69e937 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:43.520412 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd8ff1-faaa-48e2-98c1-9db12f69e937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:43.558271 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-fffd8ff1-faaa-48e2-98c1-9db12f69e937 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:43.559589 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-fffd8ff1-faaa-48e2-98c1-9db12f69e937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:43.733823 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:43.753144 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 825/1647] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:43.808469 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c9a13-f7d6-4c4c-8691-1c4fed529b7f admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:43.810341 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-c90c9a13-f7d6-4c4c-8691-1c4fed529b7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:44.057696 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c9a13-f7d6-4c4c-8691-1c4fed529b7f admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:44.077541 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078eb6c-059d-4ac6-9f5c-dc79e698d7bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:44.078638 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078eb6c-059d-4ac6-9f5c-dc79e698d7bb service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:44.079026 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078eb6c-059d-4ac6-9f5c-dc79e698d7bb service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:44.079401 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078eb6c-059d-4ac6-9f5c-dc79e698d7bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:44.113450 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8078eb6c-059d-4ac6-9f5c-dc79e698d7bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:44.135324 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8078eb6c-059d-4ac6-9f5c-dc79e698d7bb service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:44.193288 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 823/1648] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:45.538090 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd8ff1-faaa-48e2-98c1-9db12f69e937 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:45.539619 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-fffd8ff1-faaa-48e2-98c1-9db12f69e937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:45.573693 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd8ff1-faaa-48e2-98c1-9db12f69e937 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:45.608213 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144f120-b0f3-4795-be9a-d9e043b86c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:45.609176 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144f120-b0f3-4795-be9a-d9e043b86c86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:45.609363 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144f120-b0f3-4795-be9a-d9e043b86c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:45.609784 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144f120-b0f3-4795-be9a-d9e043b86c86 admin admin] PATH_INFO: `/v3/projects/4c6550ff5b4e43808416d5fd90cca7c0` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:45.622964 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1144f120-b0f3-4795-be9a-d9e043b86c86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c6550ff5b4e43808416d5fd90cca7c0)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:45.624915 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1144f120-b0f3-4795-be9a-d9e043b86c86 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:45.748924 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-1144f120-b0f3-4795-be9a-d9e043b86c86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c6550ff5b4e43808416d5fd90cca7c0', 'request_id': 'req-1144f120-b0f3-4795-be9a-d9e043b86c86'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:45.765004 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-1144f120-b0f3-4795-be9a-d9e043b86c86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c6550ff5b4e43808416d5fd90cca7c0', 'request_id': 'req-1144f120-b0f3-4795-be9a-d9e043b86c86'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:45.776431 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-1144f120-b0f3-4795-be9a-d9e043b86c86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c6550ff5b4e43808416d5fd90cca7c0', 'request_id': 'req-1144f120-b0f3-4795-be9a-d9e043b86c86'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:45.803968 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-1144f120-b0f3-4795-be9a-d9e043b86c86 admin admin] The token cache is being invalidate because project 4c6550ff5b4e43808416d5fd90cca7c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:48:45.804501 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-1144f120-b0f3-4795-be9a-d9e043b86c86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:45.805449 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-1144f120-b0f3-4795-be9a-d9e043b86c86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:45.807943 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 826/1649] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:48:45 2022] DELETE /identity/v3/projects/4c6550ff5b4e43808416d5fd90cca7c0 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:48:45.813584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf4330-a269-46db-b25e-0f650068525f None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:45.814096 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf4330-a269-46db-b25e-0f650068525f None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:45.814290 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf4330-a269-46db-b25e-0f650068525f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:45.873127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-c0bf4330-a269-46db-b25e-0f650068525f None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:45.874799 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-c0bf4330-a269-46db-b25e-0f650068525f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:45.972893 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 824/1650] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:45.974172 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653dd9b-84a0-4849-aac2-81aad2e343a2 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:45.974655 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653dd9b-84a0-4849-aac2-81aad2e343a2 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:45.974930 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653dd9b-84a0-4849-aac2-81aad2e343a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:45.996923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-0653dd9b-84a0-4849-aac2-81aad2e343a2 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:46.005934 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-0653dd9b-84a0-4849-aac2-81aad2e343a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:46.021631 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf4330-a269-46db-b25e-0f650068525f None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:46.031534 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:46.034477 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 827/1651] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:48:46.036425 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf4330-a269-46db-b25e-0f650068525f None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:46.045895 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71fff84-ade5-4ed4-9124-2714b04a9b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:46.050066 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71fff84-ade5-4ed4-9124-2714b04a9b8b admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:46.060608 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71fff84-ade5-4ed4-9124-2714b04a9b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:46.061076 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71fff84-ade5-4ed4-9124-2714b04a9b8b admin admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:46.076646 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71fff84-ade5-4ed4-9124-2714b04a9b8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:48:46.078174 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71fff84-ade5-4ed4-9124-2714b04a9b8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:46.082951 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71fff84-ade5-4ed4-9124-2714b04a9b8b admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:46.129804 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 825/1652] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:48:46.132236 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653dd9b-84a0-4849-aac2-81aad2e343a2 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:46.147290 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653dd9b-84a0-4849-aac2-81aad2e343a2 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:46.159753 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a97d04-041d-49d8-baca-b8075adf50a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:46.160680 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a97d04-041d-49d8-baca-b8075adf50a3 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:46.161099 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a97d04-041d-49d8-baca-b8075adf50a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:46.161544 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a97d04-041d-49d8-baca-b8075adf50a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:46.162487 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a97d04-041d-49d8-baca-b8075adf50a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:46.166662 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a97d04-041d-49d8-baca-b8075adf50a3 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:46.245531 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 828/1653] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:48:46 2022] POST /identity/v3/projects => generated 405 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:48:46.248965 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71fff84-ade5-4ed4-9124-2714b04a9b8b admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:46.260935 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71fff84-ade5-4ed4-9124-2714b04a9b8b admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:46.453727 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43202f52-d125-4e89-9633-8d649955211d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:46.456650 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43202f52-d125-4e89-9633-8d649955211d admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:46.457650 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43202f52-d125-4e89-9633-8d649955211d admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:46.458164 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43202f52-d125-4e89-9633-8d649955211d admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:46.460184 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43202f52-d125-4e89-9633-8d649955211d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:46.466095 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43202f52-d125-4e89-9633-8d649955211d admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:46.507794 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 826/1654] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:48:46 2022] POST /identity/v3/users => generated 303 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:48:46.512032 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a97d04-041d-49d8-baca-b8075adf50a3 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:46.526559 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a97d04-041d-49d8-baca-b8075adf50a3 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:46.551367 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30988dc8-5b8f-43d2-8251-43f0dfb12e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:46.552055 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30988dc8-5b8f-43d2-8251-43f0dfb12e09 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:46.552320 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30988dc8-5b8f-43d2-8251-43f0dfb12e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:46.552593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30988dc8-5b8f-43d2-8251-43f0dfb12e09 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:46.553333 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30988dc8-5b8f-43d2-8251-43f0dfb12e09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:46.558026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30988dc8-5b8f-43d2-8251-43f0dfb12e09 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:46.595583 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 829/1655] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:48:46.599606 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43202f52-d125-4e89-9633-8d649955211d admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:46.621061 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43202f52-d125-4e89-9633-8d649955211d admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:46.651944 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4878c8-e1e3-4560-a7ce-4e5fb7e12e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:46.652670 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4878c8-e1e3-4560-a7ce-4e5fb7e12e7b admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:46.652923 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4878c8-e1e3-4560-a7ce-4e5fb7e12e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:46.653197 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4878c8-e1e3-4560-a7ce-4e5fb7e12e7b admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:46.654055 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4878c8-e1e3-4560-a7ce-4e5fb7e12e7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:46.666551 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4878c8-e1e3-4560-a7ce-4e5fb7e12e7b admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:46.710040 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 827/1656] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:48:46.714172 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30988dc8-5b8f-43d2-8251-43f0dfb12e09 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:46.728687 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30988dc8-5b8f-43d2-8251-43f0dfb12e09 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:46.745993 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d2281-b609-4af8-b17b-3b204b8fe493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:46.749098 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d2281-b609-4af8-b17b-3b204b8fe493 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:46.751468 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d2281-b609-4af8-b17b-3b204b8fe493 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:46.752592 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d2281-b609-4af8-b17b-3b204b8fe493 admin admin] PATH_INFO: `/v3/projects/e936844cc6dd4f41a49c57bcc87741f3/users/9f0110215bdc425c99a0e2be067444ab/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:46.821736 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d2281-b609-4af8-b17b-3b204b8fe493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e936844cc6dd4f41a49c57bcc87741f3, user_id=9f0110215bdc425c99a0e2be067444ab, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:46.825192 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d2281-b609-4af8-b17b-3b204b8fe493 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:46.853148 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 830/1657] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:48:46 2022] PUT /identity/v3/projects/e936844cc6dd4f41a49c57bcc87741f3/users/9f0110215bdc425c99a0e2be067444ab/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:48:46.864795 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07220bc-5dc6-48c7-80ab-7dc82b868e38 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:46.865378 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07220bc-5dc6-48c7-80ab-7dc82b868e38 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:46.865576 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07220bc-5dc6-48c7-80ab-7dc82b868e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:46.954430 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-c07220bc-5dc6-48c7-80ab-7dc82b868e38 None None] MFA Rules not processed for user `9f0110215bdc425c99a0e2be067444ab`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:46.956159 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-c07220bc-5dc6-48c7-80ab-7dc82b868e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:47.097688 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 828/1658] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:46 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:47.103112 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d2281-b609-4af8-b17b-3b204b8fe493 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:47.275996 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d2281-b609-4af8-b17b-3b204b8fe493 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:47.295706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e9d63-38ce-4fb5-a77d-19964b5ef783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:47.296561 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e9d63-38ce-4fb5-a77d-19964b5ef783 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:47.296954 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e9d63-38ce-4fb5-a77d-19964b5ef783 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:47.297320 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e9d63-38ce-4fb5-a77d-19964b5ef783 admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:47.298246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e9d63-38ce-4fb5-a77d-19964b5ef783 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:47.300348 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e9d63-38ce-4fb5-a77d-19964b5ef783 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:47.382847 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 831/1659] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:48:47 2022] POST /identity/v3/projects => generated 405 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:48:47.387235 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07220bc-5dc6-48c7-80ab-7dc82b868e38 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:47.433256 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07220bc-5dc6-48c7-80ab-7dc82b868e38 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:47.607641 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae899b56-eb21-4388-9be5-d785190f4dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:47.610265 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae899b56-eb21-4388-9be5-d785190f4dcd admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:47.611414 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae899b56-eb21-4388-9be5-d785190f4dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:47.611837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae899b56-eb21-4388-9be5-d785190f4dcd admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:47.613062 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae899b56-eb21-4388-9be5-d785190f4dcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:47.620114 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae899b56-eb21-4388-9be5-d785190f4dcd admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:47.640016 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:47.672361 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 829/1660] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:48:47 2022] POST /identity/v3/users => generated 309 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:48:47.676607 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e9d63-38ce-4fb5-a77d-19964b5ef783 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:47.685697 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:47.695736 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e9d63-38ce-4fb5-a77d-19964b5ef783 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:47.710522 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee05917-06c1-4269-8ef0-bfcf0bfdc0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:47.711255 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee05917-06c1-4269-8ef0-bfcf0bfdc0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:47.711578 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee05917-06c1-4269-8ef0-bfcf0bfdc0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:47.711826 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee05917-06c1-4269-8ef0-bfcf0bfdc0c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:47.713628 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee05917-06c1-4269-8ef0-bfcf0bfdc0c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:47.715740 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee05917-06c1-4269-8ef0-bfcf0bfdc0c9 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:47.748709 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 832/1661] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:48:47.754049 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae899b56-eb21-4388-9be5-d785190f4dcd admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:47.777291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae899b56-eb21-4388-9be5-d785190f4dcd admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:47.794384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a545750-a288-4af3-a45d-0fede7dbf290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:47.795756 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a545750-a288-4af3-a45d-0fede7dbf290 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:47.796182 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a545750-a288-4af3-a45d-0fede7dbf290 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:47.796616 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a545750-a288-4af3-a45d-0fede7dbf290 admin admin] PATH_INFO: `/v3/projects/e822b61ec854498b8e9ae4e17faa43e9/users/be2ea30dd0fc4909bb679b3ae901421a/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:47.841233 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a545750-a288-4af3-a45d-0fede7dbf290 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e822b61ec854498b8e9ae4e17faa43e9, user_id=be2ea30dd0fc4909bb679b3ae901421a, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:47.846709 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a545750-a288-4af3-a45d-0fede7dbf290 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:47.880979 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 830/1662] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:48:47 2022] PUT /identity/v3/projects/e822b61ec854498b8e9ae4e17faa43e9/users/be2ea30dd0fc4909bb679b3ae901421a/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:48:47.885243 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee05917-06c1-4269-8ef0-bfcf0bfdc0c9 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:47.908278 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee05917-06c1-4269-8ef0-bfcf0bfdc0c9 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:48.024078 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f1fe8-d3c1-4d81-b331-0dff16b8757e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:48.026522 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f1fe8-d3c1-4d81-b331-0dff16b8757e admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:48.027058 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f1fe8-d3c1-4d81-b331-0dff16b8757e admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:48.027722 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f1fe8-d3c1-4d81-b331-0dff16b8757e admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:48.035154 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f1fe8-d3c1-4d81-b331-0dff16b8757e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:48.037863 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f1fe8-d3c1-4d81-b331-0dff16b8757e admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:48.055728 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 833/1663] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:48:48.059633 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a545750-a288-4af3-a45d-0fede7dbf290 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:48.081421 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a545750-a288-4af3-a45d-0fede7dbf290 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:48.088837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820f257-8565-4d2e-97ff-149b0d4ccb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:48.090142 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820f257-8565-4d2e-97ff-149b0d4ccb06 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:48.090509 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820f257-8565-4d2e-97ff-149b0d4ccb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:48.090780 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820f257-8565-4d2e-97ff-149b0d4ccb06 admin admin] PATH_INFO: `/v3/projects/e822b61ec854498b8e9ae4e17faa43e9/users/be2ea30dd0fc4909bb679b3ae901421a/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:48.093013 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8820f257-8565-4d2e-97ff-149b0d4ccb06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e822b61ec854498b8e9ae4e17faa43e9, user_id=be2ea30dd0fc4909bb679b3ae901421a, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:48.097646 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8820f257-8565-4d2e-97ff-149b0d4ccb06 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:48.112008 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 831/1664] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:48:48 2022] PUT /identity/v3/projects/e822b61ec854498b8e9ae4e17faa43e9/users/be2ea30dd0fc4909bb679b3ae901421a/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:48:48.123575 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b790a5-88d3-458c-98d3-990eca916569 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:48.123862 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b790a5-88d3-458c-98d3-990eca916569 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:48.124141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b790a5-88d3-458c-98d3-990eca916569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:48.180139 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-61b790a5-88d3-458c-98d3-990eca916569 None None] MFA Rules not processed for user `be2ea30dd0fc4909bb679b3ae901421a`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:48.182350 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-61b790a5-88d3-458c-98d3-990eca916569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:48.408008 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 834/1665] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:48 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:48.444589 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820f257-8565-4d2e-97ff-149b0d4ccb06 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:48.447132 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-8820f257-8565-4d2e-97ff-149b0d4ccb06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:48.563545 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820f257-8565-4d2e-97ff-149b0d4ccb06 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:48.570896 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7fdbaa-923a-455f-9c72-54ba75643e69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:48.572530 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fdbaa-923a-455f-9c72-54ba75643e69 service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:48.572961 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fdbaa-923a-455f-9c72-54ba75643e69 service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:48.573413 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fdbaa-923a-455f-9c72-54ba75643e69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:48.587189 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7fdbaa-923a-455f-9c72-54ba75643e69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:48.589544 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7fdbaa-923a-455f-9c72-54ba75643e69 service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:48.612094 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 832/1666] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:48 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:48.857659 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b790a5-88d3-458c-98d3-990eca916569 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:48.859435 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546e398-3b18-4b13-bffe-e210e7cd908e None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:48.859839 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546e398-3b18-4b13-bffe-e210e7cd908e None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:48.860188 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546e398-3b18-4b13-bffe-e210e7cd908e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:48.941392 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-1546e398-3b18-4b13-bffe-e210e7cd908e None None] MFA Rules not processed for user `96c018ba46da45b3a079189aafdcdecd`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:48.953066 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-1546e398-3b18-4b13-bffe-e210e7cd908e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:49.037372 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b790a5-88d3-458c-98d3-990eca916569 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:49.060186 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286c8d5-65a2-471a-ba5a-419f79370cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:49.063009 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286c8d5-65a2-471a-ba5a-419f79370cbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:49.063297 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286c8d5-65a2-471a-ba5a-419f79370cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:49.063577 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286c8d5-65a2-471a-ba5a-419f79370cbc admin admin] PATH_INFO: `/v3/users/9f0110215bdc425c99a0e2be067444ab` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:49.071193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286c8d5-65a2-471a-ba5a-419f79370cbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f0110215bdc425c99a0e2be067444ab)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:49.074742 dv-cinder-797608-49-smb devstack@keystone.service[87152]: WARNING py.warnings [None req-9286c8d5-65a2-471a-ba5a-419f79370cbc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 20:48:49.074742 dv-cinder-797608-49-smb devstack@keystone.service[87152]: warnings.warn(msg) Jul 05 20:48:49.074742 dv-cinder-797608-49-smb devstack@keystone.service[87152]: Jul 05 20:48:49.079299 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286c8d5-65a2-471a-ba5a-419f79370cbc admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:49.188338 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 833/1667] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:49.190151 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42002bd2-bcb3-4001-bd86-bddf43cf6f2e None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:49.190540 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42002bd2-bcb3-4001-bd86-bddf43cf6f2e None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:49.192001 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42002bd2-bcb3-4001-bd86-bddf43cf6f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:49.202070 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:49.234767 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-42002bd2-bcb3-4001-bd86-bddf43cf6f2e None None] MFA Rules not processed for user `bc1c30d3677845c5b9185f4a4ad5ea03`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:49.236369 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-42002bd2-bcb3-4001-bd86-bddf43cf6f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:49.308093 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:49.338678 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-9286c8d5-65a2-471a-ba5a-419f79370cbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f0110215bdc425c99a0e2be067444ab'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:49.358441 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 834/1668] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:49.361295 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42002bd2-bcb3-4001-bd86-bddf43cf6f2e None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:49.363255 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-42002bd2-bcb3-4001-bd86-bddf43cf6f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:49.411772 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-9286c8d5-65a2-471a-ba5a-419f79370cbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f0110215bdc425c99a0e2be067444ab'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:49.439787 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-9286c8d5-65a2-471a-ba5a-419f79370cbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f0110215bdc425c99a0e2be067444ab'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:49.441571 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-9286c8d5-65a2-471a-ba5a-419f79370cbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f0110215bdc425c99a0e2be067444ab'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:49.442334 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-9286c8d5-65a2-471a-ba5a-419f79370cbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f0110215bdc425c99a0e2be067444ab'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:49.463097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 835/1669] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:48:48 2022] DELETE /identity/v3/users/9f0110215bdc425c99a0e2be067444ab => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:48:49.464439 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4b5d7-659c-4ff8-a6f4-8d319873c047 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:49.464726 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4b5d7-659c-4ff8-a6f4-8d319873c047 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:49.464999 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4b5d7-659c-4ff8-a6f4-8d319873c047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:49.507763 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-d0f4b5d7-659c-4ff8-a6f4-8d319873c047 None None] MFA Rules not processed for user `bc1c30d3677845c5b9185f4a4ad5ea03`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:49.513530 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-d0f4b5d7-659c-4ff8-a6f4-8d319873c047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:49.514220 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42002bd2-bcb3-4001-bd86-bddf43cf6f2e None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:49.682820 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 836/1670] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:49.690580 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4b5d7-659c-4ff8-a6f4-8d319873c047 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:49.693656 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-d0f4b5d7-659c-4ff8-a6f4-8d319873c047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:49.702815 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bd053-40cb-4f40-a220-8c54948b1eac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:49.703504 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bd053-40cb-4f40-a220-8c54948b1eac service nova] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:49.703791 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bd053-40cb-4f40-a220-8c54948b1eac service nova] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:49.707309 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bd053-40cb-4f40-a220-8c54948b1eac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:49.715558 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-878bd053-40cb-4f40-a220-8c54948b1eac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:49.890880 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878bd053-40cb-4f40-a220-8c54948b1eac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:49.895015 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878bd053-40cb-4f40-a220-8c54948b1eac service nova] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:49.927096 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 835/1671] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:49.928827 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944a22e-cb31-408a-9603-0e1eb22bae4f None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:49.929507 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944a22e-cb31-408a-9603-0e1eb22bae4f None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:49.930263 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944a22e-cb31-408a-9603-0e1eb22bae4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:50.000942 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-2944a22e-cb31-408a-9603-0e1eb22bae4f None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:50.007658 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-2944a22e-cb31-408a-9603-0e1eb22bae4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:50.019046 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:50.153038 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 836/1672] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:50.153038 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944a22e-cb31-408a-9603-0e1eb22bae4f None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:50.153038 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-2944a22e-cb31-408a-9603-0e1eb22bae4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:50.216669 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944a22e-cb31-408a-9603-0e1eb22bae4f None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:50.242328 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf93350-76e0-4d59-8bec-6f564a67003b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:50.243109 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf93350-76e0-4d59-8bec-6f564a67003b service nova] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:50.246166 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf93350-76e0-4d59-8bec-6f564a67003b service nova] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:50.247211 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf93350-76e0-4d59-8bec-6f564a67003b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:50.251394 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-bcf93350-76e0-4d59-8bec-6f564a67003b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:50.299432 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4b5d7-659c-4ff8-a6f4-8d319873c047 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:50.306022 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf93350-76e0-4d59-8bec-6f564a67003b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:50.310649 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6fffcc-f83a-4f3e-8c80-e4d3fd249f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:50.311178 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf93350-76e0-4d59-8bec-6f564a67003b service nova] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:50.312093 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fffcc-f83a-4f3e-8c80-e4d3fd249f2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:50.313349 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fffcc-f83a-4f3e-8c80-e4d3fd249f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:50.316230 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fffcc-f83a-4f3e-8c80-e4d3fd249f2c admin admin] PATH_INFO: `/v3/users/47348fd92c5c44dbb8c6b518cf8481ac` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:50.319092 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6fffcc-f83a-4f3e-8c80-e4d3fd249f2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=47348fd92c5c44dbb8c6b518cf8481ac)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:50.322595 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6fffcc-f83a-4f3e-8c80-e4d3fd249f2c admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:50.362188 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 837/1673] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:50.363693 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf93350-76e0-4d59-8bec-6f564a67003b service nova] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:50.366178 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-bcf93350-76e0-4d59-8bec-6f564a67003b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:50.440705 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:50.464385 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-da6fffcc-f83a-4f3e-8c80-e4d3fd249f2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47348fd92c5c44dbb8c6b518cf8481ac'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:50.524586 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-da6fffcc-f83a-4f3e-8c80-e4d3fd249f2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47348fd92c5c44dbb8c6b518cf8481ac'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:50.575555 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-da6fffcc-f83a-4f3e-8c80-e4d3fd249f2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47348fd92c5c44dbb8c6b518cf8481ac'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:50.579637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-da6fffcc-f83a-4f3e-8c80-e4d3fd249f2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47348fd92c5c44dbb8c6b518cf8481ac'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:50.580950 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-da6fffcc-f83a-4f3e-8c80-e4d3fd249f2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47348fd92c5c44dbb8c6b518cf8481ac'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:50.640778 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf93350-76e0-4d59-8bec-6f564a67003b service nova] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:50.652339 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 837/1674] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:48:49 2022] DELETE /identity/v3/users/47348fd92c5c44dbb8c6b518cf8481ac => generated 0 bytes in 966 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:48:50.653979 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02abf8-c93b-41e9-af77-3d5a840b33b8 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:50.657185 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02abf8-c93b-41e9-af77-3d5a840b33b8 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:50.657325 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02abf8-c93b-41e9-af77-3d5a840b33b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:50.740199 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-8e02abf8-c93b-41e9-af77-3d5a840b33b8 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:50.741498 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-8e02abf8-c93b-41e9-af77-3d5a840b33b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:50.828303 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c741d-567f-4290-a4c0-102c0c6bf36f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:50.836142 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c741d-567f-4290-a4c0-102c0c6bf36f service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:50.846388 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c741d-567f-4290-a4c0-102c0c6bf36f service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:50.855438 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c741d-567f-4290-a4c0-102c0c6bf36f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:50.867080 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-e11c741d-567f-4290-a4c0-102c0c6bf36f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:51.046126 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 838/1675] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:51.048341 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e02abf8-c93b-41e9-af77-3d5a840b33b8 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:51.056358 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-8e02abf8-c93b-41e9-af77-3d5a840b33b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:51.099806 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e02abf8-c93b-41e9-af77-3d5a840b33b8 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:51.115713 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa9446-4e1d-40f0-9fa2-bfdef190b367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:51.124388 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa9446-4e1d-40f0-9fa2-bfdef190b367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:51.125010 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa9446-4e1d-40f0-9fa2-bfdef190b367 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:51.126124 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa9446-4e1d-40f0-9fa2-bfdef190b367 admin admin] PATH_INFO: `/v3/users/bf3041cfeb044f0a91b3419ca95fee54` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:51.131580 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa9446-4e1d-40f0-9fa2-bfdef190b367 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf3041cfeb044f0a91b3419ca95fee54)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:51.136604 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa9446-4e1d-40f0-9fa2-bfdef190b367 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:51.154421 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c741d-567f-4290-a4c0-102c0c6bf36f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:51.155799 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11c741d-567f-4290-a4c0-102c0c6bf36f service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:51.214733 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 838/1676] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 852 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:51.216020 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c741d-567f-4290-a4c0-102c0c6bf36f service neutron] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:51.218327 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-e11c741d-567f-4290-a4c0-102c0c6bf36f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:51.225357 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:51.236429 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c741d-567f-4290-a4c0-102c0c6bf36f service neutron] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:51.266635 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6b773-7011-48f4-85d0-c903e8eb23fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:51.267560 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6b773-7011-48f4-85d0-c903e8eb23fa service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:51.269523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6b773-7011-48f4-85d0-c903e8eb23fa service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:51.271110 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6b773-7011-48f4-85d0-c903e8eb23fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:51.294918 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-1caa9446-4e1d-40f0-9fa2-bfdef190b367 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf3041cfeb044f0a91b3419ca95fee54'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:51.301744 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6b773-7011-48f4-85d0-c903e8eb23fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:51.305681 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6b773-7011-48f4-85d0-c903e8eb23fa service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:51.326582 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 839/1677] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:51.360002 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-1caa9446-4e1d-40f0-9fa2-bfdef190b367 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf3041cfeb044f0a91b3419ca95fee54'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:51.406271 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-1caa9446-4e1d-40f0-9fa2-bfdef190b367 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf3041cfeb044f0a91b3419ca95fee54'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:51.409369 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-1caa9446-4e1d-40f0-9fa2-bfdef190b367 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf3041cfeb044f0a91b3419ca95fee54'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:51.410331 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-1caa9446-4e1d-40f0-9fa2-bfdef190b367 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf3041cfeb044f0a91b3419ca95fee54'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:51.470064 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 839/1678] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:48:51 2022] DELETE /identity/v3/users/bf3041cfeb044f0a91b3419ca95fee54 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:48:51.476288 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf98a49-21eb-4bf8-87f8-8eb5375c45b2 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:51.477220 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf98a49-21eb-4bf8-87f8-8eb5375c45b2 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:51.477429 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf98a49-21eb-4bf8-87f8-8eb5375c45b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:51.517785 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-ddf98a49-21eb-4bf8-87f8-8eb5375c45b2 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:51.523760 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-ddf98a49-21eb-4bf8-87f8-8eb5375c45b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:51.745173 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 840/1679] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:51.784673 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa9446-4e1d-40f0-9fa2-bfdef190b367 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:51.788365 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-1caa9446-4e1d-40f0-9fa2-bfdef190b367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:51.912232 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:52.022175 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa9446-4e1d-40f0-9fa2-bfdef190b367 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:52.037444 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54573d-4f8e-4fe2-bc1b-3c8472065394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:52.038163 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54573d-4f8e-4fe2-bc1b-3c8472065394 service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:52.038442 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54573d-4f8e-4fe2-bc1b-3c8472065394 service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:52.038716 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54573d-4f8e-4fe2-bc1b-3c8472065394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:52.064214 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54573d-4f8e-4fe2-bc1b-3c8472065394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:52.065780 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54573d-4f8e-4fe2-bc1b-3c8472065394 service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:52.094504 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 840/1680] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:52.435898 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c41108-569c-4551-8c0c-871c1256dfc4 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:52.436711 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c41108-569c-4551-8c0c-871c1256dfc4 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:52.437341 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c41108-569c-4551-8c0c-871c1256dfc4 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:52.439058 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 841/1681] 10.222.0.27 () {54 vars in 912 bytes} [Tue Jul 5 20:48:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:48:52.450824 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1dc70f-2aa5-464d-8602-c81f619a9393 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:52.451685 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1dc70f-2aa5-464d-8602-c81f619a9393 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:52.452123 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1dc70f-2aa5-464d-8602-c81f619a9393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:52.567860 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-af1dc70f-2aa5-464d-8602-c81f619a9393 None None] MFA Rules not processed for user `157a258bcff642cb91a0a474f8f50941`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:52.569375 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-af1dc70f-2aa5-464d-8602-c81f619a9393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:52.599689 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 841/1682] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Jul 5 20:48:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:52.632583 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c41108-569c-4551-8c0c-871c1256dfc4 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:52.649499 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c41108-569c-4551-8c0c-871c1256dfc4 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:52.670688 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110d001-36de-430f-89f9-b61f06e4fd86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:52.671408 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110d001-36de-430f-89f9-b61f06e4fd86 service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:52.671832 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110d001-36de-430f-89f9-b61f06e4fd86 service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:52.673270 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110d001-36de-430f-89f9-b61f06e4fd86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:52.708864 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110d001-36de-430f-89f9-b61f06e4fd86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:52.710401 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110d001-36de-430f-89f9-b61f06e4fd86 service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:52.725517 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 842/1683] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:53.304302 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1dc70f-2aa5-464d-8602-c81f619a9393 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:53.305992 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-af1dc70f-2aa5-464d-8602-c81f619a9393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:53.339830 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1dc70f-2aa5-464d-8602-c81f619a9393 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:53.355892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d75f8-264d-4bfe-ad39-b67ccaf86a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:53.356701 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d75f8-264d-4bfe-ad39-b67ccaf86a5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:53.356987 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d75f8-264d-4bfe-ad39-b67ccaf86a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:53.357253 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d75f8-264d-4bfe-ad39-b67ccaf86a5c admin admin] PATH_INFO: `/v3/projects/c6c4293e87864db4a560cd2591f9ecb7` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:53.359141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d75f8-264d-4bfe-ad39-b67ccaf86a5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6c4293e87864db4a560cd2591f9ecb7)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:53.361208 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d75f8-264d-4bfe-ad39-b67ccaf86a5c admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:53.503856 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110d001-36de-430f-89f9-b61f06e4fd86 service neutron] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:53.506273 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-d110d001-36de-430f-89f9-b61f06e4fd86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:53.519732 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-053d75f8-264d-4bfe-ad39-b67ccaf86a5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6c4293e87864db4a560cd2591f9ecb7', 'request_id': 'req-053d75f8-264d-4bfe-ad39-b67ccaf86a5c'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:53.555301 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-053d75f8-264d-4bfe-ad39-b67ccaf86a5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6c4293e87864db4a560cd2591f9ecb7', 'request_id': 'req-053d75f8-264d-4bfe-ad39-b67ccaf86a5c'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:53.579488 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110d001-36de-430f-89f9-b61f06e4fd86 service neutron] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:53.583667 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-053d75f8-264d-4bfe-ad39-b67ccaf86a5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6c4293e87864db4a560cd2591f9ecb7', 'request_id': 'req-053d75f8-264d-4bfe-ad39-b67ccaf86a5c'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:53.626677 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-053d75f8-264d-4bfe-ad39-b67ccaf86a5c admin admin] The token cache is being invalidate because project c6c4293e87864db4a560cd2591f9ecb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:48:53.628558 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-053d75f8-264d-4bfe-ad39-b67ccaf86a5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:53.631550 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-053d75f8-264d-4bfe-ad39-b67ccaf86a5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:53.636126 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 842/1684] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:48:53 2022] DELETE /identity/v3/projects/c6c4293e87864db4a560cd2591f9ecb7 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:48:53.642356 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336234e-1d59-4a52-b05a-c8c9f46e9b16 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:53.643531 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336234e-1d59-4a52-b05a-c8c9f46e9b16 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:53.644757 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336234e-1d59-4a52-b05a-c8c9f46e9b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:53.680848 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c11ca4-69ec-4df0-8fea-a16206df5008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:53.681979 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c11ca4-69ec-4df0-8fea-a16206df5008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:53.682397 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c11ca4-69ec-4df0-8fea-a16206df5008 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:53.682763 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c11ca4-69ec-4df0-8fea-a16206df5008 admin admin] PATH_INFO: `/v3/projects/e936844cc6dd4f41a49c57bcc87741f3` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:53.684152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c11ca4-69ec-4df0-8fea-a16206df5008 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e936844cc6dd4f41a49c57bcc87741f3)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:53.685214 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-0336234e-1d59-4a52-b05a-c8c9f46e9b16 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:53.685332 dv-cinder-797608-49-smb devstack@keystone.service[87151]: WARNING py.warnings [None req-61c11ca4-69ec-4df0-8fea-a16206df5008 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 05 20:48:53.685332 dv-cinder-797608-49-smb devstack@keystone.service[87151]: warnings.warn(msg) Jul 05 20:48:53.685332 dv-cinder-797608-49-smb devstack@keystone.service[87151]: Jul 05 20:48:53.686819 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c11ca4-69ec-4df0-8fea-a16206df5008 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:53.687264 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-0336234e-1d59-4a52-b05a-c8c9f46e9b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:53.714307 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 843/1685] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:53.717692 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b2821-21a0-4e6c-bedc-eec802bca5dc None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:53.719632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b2821-21a0-4e6c-bedc-eec802bca5dc None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:53.721930 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b2821-21a0-4e6c-bedc-eec802bca5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:53.773614 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-007b2821-21a0-4e6c-bedc-eec802bca5dc None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:53.777799 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-007b2821-21a0-4e6c-bedc-eec802bca5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:53.812154 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-61c11ca4-69ec-4df0-8fea-a16206df5008 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e936844cc6dd4f41a49c57bcc87741f3', 'request_id': 'req-61c11ca4-69ec-4df0-8fea-a16206df5008'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:53.828415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-61c11ca4-69ec-4df0-8fea-a16206df5008 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e936844cc6dd4f41a49c57bcc87741f3', 'request_id': 'req-61c11ca4-69ec-4df0-8fea-a16206df5008'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:53.852733 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-61c11ca4-69ec-4df0-8fea-a16206df5008 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e936844cc6dd4f41a49c57bcc87741f3', 'request_id': 'req-61c11ca4-69ec-4df0-8fea-a16206df5008'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:53.920205 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-61c11ca4-69ec-4df0-8fea-a16206df5008 admin admin] The token cache is being invalidate because project e936844cc6dd4f41a49c57bcc87741f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:48:53.920501 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-61c11ca4-69ec-4df0-8fea-a16206df5008 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:53.921321 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-61c11ca4-69ec-4df0-8fea-a16206df5008 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:53.923623 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 843/1686] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:48:53 2022] DELETE /identity/v3/projects/e936844cc6dd4f41a49c57bcc87741f3 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:48:53.924771 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c11ca4-69ec-4df0-8fea-a16206df5008 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:53.927296 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-61c11ca4-69ec-4df0-8fea-a16206df5008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:53.938276 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:54.038729 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 844/1687] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:54.040473 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b2821-21a0-4e6c-bedc-eec802bca5dc None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:54.046953 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-007b2821-21a0-4e6c-bedc-eec802bca5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:54.118650 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b2821-21a0-4e6c-bedc-eec802bca5dc None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:54.156934 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae296264-f451-4551-9011-9fd42298bfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:54.157950 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae296264-f451-4551-9011-9fd42298bfa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:54.158229 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae296264-f451-4551-9011-9fd42298bfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:54.158501 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae296264-f451-4551-9011-9fd42298bfa1 admin admin] PATH_INFO: `/v3/users/be2ea30dd0fc4909bb679b3ae901421a` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:54.161550 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae296264-f451-4551-9011-9fd42298bfa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be2ea30dd0fc4909bb679b3ae901421a)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:54.166181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae296264-f451-4551-9011-9fd42298bfa1 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:54.253765 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:54.296245 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-ae296264-f451-4551-9011-9fd42298bfa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be2ea30dd0fc4909bb679b3ae901421a'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:54.325064 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-ae296264-f451-4551-9011-9fd42298bfa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be2ea30dd0fc4909bb679b3ae901421a'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:54.344220 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-ae296264-f451-4551-9011-9fd42298bfa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be2ea30dd0fc4909bb679b3ae901421a'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:54.345255 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-ae296264-f451-4551-9011-9fd42298bfa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be2ea30dd0fc4909bb679b3ae901421a'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:54.346072 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-ae296264-f451-4551-9011-9fd42298bfa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be2ea30dd0fc4909bb679b3ae901421a'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:54.373829 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 845/1688] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:48:54 2022] DELETE /identity/v3/users/be2ea30dd0fc4909bb679b3ae901421a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:48:54.375113 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae296264-f451-4551-9011-9fd42298bfa1 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:54.379450 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-ae296264-f451-4551-9011-9fd42298bfa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:54.532638 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae296264-f451-4551-9011-9fd42298bfa1 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:54.541077 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c11ca4-69ec-4df0-8fea-a16206df5008 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:54.544997 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668d274-3e63-414e-b817-35b29c7564d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:54.545690 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668d274-3e63-414e-b817-35b29c7564d8 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:54.545997 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668d274-3e63-414e-b817-35b29c7564d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:54.546270 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668d274-3e63-414e-b817-35b29c7564d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:54.550050 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668d274-3e63-414e-b817-35b29c7564d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:48:54.550993 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668d274-3e63-414e-b817-35b29c7564d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:54.556664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668d274-3e63-414e-b817-35b29c7564d8 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:54.557640 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879bdca-9d10-4b5e-95f9-74d262f2b87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:54.560447 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879bdca-9d10-4b5e-95f9-74d262f2b87b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:54.561010 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879bdca-9d10-4b5e-95f9-74d262f2b87b admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:54.561487 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879bdca-9d10-4b5e-95f9-74d262f2b87b admin admin] PATH_INFO: `/v3/projects/4b1a4df9ef5149469cd526df761aeb94` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:54.563964 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2879bdca-9d10-4b5e-95f9-74d262f2b87b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b1a4df9ef5149469cd526df761aeb94)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:54.567907 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2879bdca-9d10-4b5e-95f9-74d262f2b87b admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:54.593040 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 846/1689] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:48:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:48:54.593676 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b0357-e80e-48fb-bbb0-b889db81534a None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:54.595821 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b0357-e80e-48fb-bbb0-b889db81534a None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:54.596825 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b0357-e80e-48fb-bbb0-b889db81534a None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:54.600797 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 847/1690] 10.222.0.27 () {54 vars in 960 bytes} [Tue Jul 5 20:48:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:48:54.604921 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54fbd7-662f-4ab9-b84e-0a63b1ca9a89 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:54.605139 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54fbd7-662f-4ab9-b84e-0a63b1ca9a89 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:54.606146 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54fbd7-662f-4ab9-b84e-0a63b1ca9a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:54.655384 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-ea54fbd7-662f-4ab9-b84e-0a63b1ca9a89 None None] MFA Rules not processed for user `bc1c30d3677845c5b9185f4a4ad5ea03`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:54.661111 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-ea54fbd7-662f-4ab9-b84e-0a63b1ca9a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:54.757878 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 848/1691] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:54.757878 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54fbd7-662f-4ab9-b84e-0a63b1ca9a89 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:54.758617 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-2879bdca-9d10-4b5e-95f9-74d262f2b87b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b1a4df9ef5149469cd526df761aeb94', 'request_id': 'req-2879bdca-9d10-4b5e-95f9-74d262f2b87b'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:54.782552 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-2879bdca-9d10-4b5e-95f9-74d262f2b87b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b1a4df9ef5149469cd526df761aeb94', 'request_id': 'req-2879bdca-9d10-4b5e-95f9-74d262f2b87b'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:54.793343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54fbd7-662f-4ab9-b84e-0a63b1ca9a89 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:54.817741 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-2879bdca-9d10-4b5e-95f9-74d262f2b87b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b1a4df9ef5149469cd526df761aeb94', 'request_id': 'req-2879bdca-9d10-4b5e-95f9-74d262f2b87b'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:54.921874 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-2879bdca-9d10-4b5e-95f9-74d262f2b87b admin admin] The token cache is being invalidate because project 4b1a4df9ef5149469cd526df761aeb94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:48:54.923572 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-2879bdca-9d10-4b5e-95f9-74d262f2b87b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:54.927809 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-2879bdca-9d10-4b5e-95f9-74d262f2b87b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:54.933278 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 844/1692] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:48:53 2022] DELETE /identity/v3/projects/4b1a4df9ef5149469cd526df761aeb94 => generated 0 bytes in 1009 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:48:54.935910 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:54.941186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca251e8-c0cc-4e2c-b619-133a79a174d2 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:54.941636 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca251e8-c0cc-4e2c-b619-133a79a174d2 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:54.942140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca251e8-c0cc-4e2c-b619-133a79a174d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:54.989628 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16edb17-ed51-4024-b7e7-6ef7f97f3179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:54.990359 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16edb17-ed51-4024-b7e7-6ef7f97f3179 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:54.990637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16edb17-ed51-4024-b7e7-6ef7f97f3179 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:54.990909 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16edb17-ed51-4024-b7e7-6ef7f97f3179 admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:54.991611 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16edb17-ed51-4024-b7e7-6ef7f97f3179 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:54.993726 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16edb17-ed51-4024-b7e7-6ef7f97f3179 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:54.999420 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-aca251e8-c0cc-4e2c-b619-133a79a174d2 None None] MFA Rules not processed for user `16662dd5e2e74163b6aa2e1e7ef07524`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:55.004706 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-aca251e8-c0cc-4e2c-b619-133a79a174d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:55.064036 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 849/1693] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:48:54 2022] POST /identity/v3/projects => generated 357 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:48:55.065960 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16edb17-ed51-4024-b7e7-6ef7f97f3179 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:55.070933 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-f16edb17-ed51-4024-b7e7-6ef7f97f3179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:55.178548 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 845/1694] 10.222.0.27 () {58 vars in 1057 bytes} [Tue Jul 5 20:48:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:55.180447 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faace052-897a-4c94-90dc-68ed90ec98b8 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:55.180824 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faace052-897a-4c94-90dc-68ed90ec98b8 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:55.181264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faace052-897a-4c94-90dc-68ed90ec98b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:55.212390 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-faace052-897a-4c94-90dc-68ed90ec98b8 None None] MFA Rules not processed for user `1f6d6f1250b14637bb24345550161cda`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:55.213763 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-faace052-897a-4c94-90dc-68ed90ec98b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:55.220657 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16edb17-ed51-4024-b7e7-6ef7f97f3179 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:55.227950 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3c599-6027-44bf-95a2-03fb142c00c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:55.227950 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3c599-6027-44bf-95a2-03fb142c00c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:55.228187 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3c599-6027-44bf-95a2-03fb142c00c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:55.228399 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3c599-6027-44bf-95a2-03fb142c00c2 admin admin] PATH_INFO: `/v3/users/2e1056db930a418486ea977195a32401` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:55.229955 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f3c599-6027-44bf-95a2-03fb142c00c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e1056db930a418486ea977195a32401)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:55.232097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f3c599-6027-44bf-95a2-03fb142c00c2 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:55.237514 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:55.307841 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-d7f3c599-6027-44bf-95a2-03fb142c00c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e1056db930a418486ea977195a32401'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:55.321607 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 846/1695] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:55.335635 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-d7f3c599-6027-44bf-95a2-03fb142c00c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e1056db930a418486ea977195a32401'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:55.335856 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faace052-897a-4c94-90dc-68ed90ec98b8 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:55.338235 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-faace052-897a-4c94-90dc-68ed90ec98b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:55.355007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-d7f3c599-6027-44bf-95a2-03fb142c00c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e1056db930a418486ea977195a32401'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:55.355773 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-d7f3c599-6027-44bf-95a2-03fb142c00c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e1056db930a418486ea977195a32401'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:55.356395 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-d7f3c599-6027-44bf-95a2-03fb142c00c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e1056db930a418486ea977195a32401'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:55.363272 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faace052-897a-4c94-90dc-68ed90ec98b8 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:55.369960 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b8f5f-5167-4c4a-a037-44ad4caa32ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:55.371268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b8f5f-5167-4c4a-a037-44ad4caa32ff admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:55.371591 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b8f5f-5167-4c4a-a037-44ad4caa32ff admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:55.372137 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b8f5f-5167-4c4a-a037-44ad4caa32ff admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:55.373168 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b8f5f-5167-4c4a-a037-44ad4caa32ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:55.375241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b8f5f-5167-4c4a-a037-44ad4caa32ff admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:55.385648 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 850/1696] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:48:55 2022] DELETE /identity/v3/users/2e1056db930a418486ea977195a32401 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:48:55.387131 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ad02d-5f9a-4dce-8cdd-713d2c0a52c3 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:55.387414 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ad02d-5f9a-4dce-8cdd-713d2c0a52c3 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:55.387688 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ad02d-5f9a-4dce-8cdd-713d2c0a52c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:55.435616 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 847/1697] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:48:55 2022] POST /identity/v3/users => generated 279 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:48:55.435616 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b8f5f-5167-4c4a-a037-44ad4caa32ff admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:55.446516 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-0f5b8f5f-5167-4c4a-a037-44ad4caa32ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:55.459054 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-fd3ad02d-5f9a-4dce-8cdd-713d2c0a52c3 None None] MFA Rules not processed for user `f240a106d1814e0b919b222517c8c381`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:55.464581 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-fd3ad02d-5f9a-4dce-8cdd-713d2c0a52c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:55.563998 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:55.648063 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b8f5f-5167-4c4a-a037-44ad4caa32ff admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:55.654862 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 851/1698] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:55.655663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ad02d-5f9a-4dce-8cdd-713d2c0a52c3 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:55.658886 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-fd3ad02d-5f9a-4dce-8cdd-713d2c0a52c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:55.781104 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ad02d-5f9a-4dce-8cdd-713d2c0a52c3 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:55.802949 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f70b6-2d0d-4052-a2b6-d537f90152b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:55.803821 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f70b6-2d0d-4052-a2b6-d537f90152b9 service nova] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:55.805048 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f70b6-2d0d-4052-a2b6-d537f90152b9 service nova] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:55.805445 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f70b6-2d0d-4052-a2b6-d537f90152b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:55.810688 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-385f70b6-2d0d-4052-a2b6-d537f90152b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:55.857478 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04319f28-2e55-4fea-8f2d-d3f8d0c74788 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16662dd5e2e74163b6aa2e1e7ef07524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:55.858200 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04319f28-2e55-4fea-8f2d-d3f8d0c74788 service placement] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:55.858481 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04319f28-2e55-4fea-8f2d-d3f8d0c74788 service placement] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:55.858753 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04319f28-2e55-4fea-8f2d-d3f8d0c74788 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:55.870808 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-04319f28-2e55-4fea-8f2d-d3f8d0c74788 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:55.886766 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04319f28-2e55-4fea-8f2d-d3f8d0c74788 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:55.888567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04319f28-2e55-4fea-8f2d-d3f8d0c74788 service placement] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:55.919883 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 848/1699] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:55.920736 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04319f28-2e55-4fea-8f2d-d3f8d0c74788 service placement] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:55.924787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-04319f28-2e55-4fea-8f2d-d3f8d0c74788 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:55.986686 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385f70b6-2d0d-4052-a2b6-d537f90152b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:55.990861 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385f70b6-2d0d-4052-a2b6-d537f90152b9 service nova] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:56.035142 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 852/1700] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:56.041428 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578314ab-1e40-453f-8247-e19a06af9a17 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:56.042994 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578314ab-1e40-453f-8247-e19a06af9a17 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:56.043500 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578314ab-1e40-453f-8247-e19a06af9a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:56.077056 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:56.101775 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-578314ab-1e40-453f-8247-e19a06af9a17 None None] MFA Rules not processed for user `f240a106d1814e0b919b222517c8c381`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:56.101775 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-578314ab-1e40-453f-8247-e19a06af9a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:56.122198 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 853/1701] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:56.124875 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578314ab-1e40-453f-8247-e19a06af9a17 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:56.132717 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-578314ab-1e40-453f-8247-e19a06af9a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:56.153643 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578314ab-1e40-453f-8247-e19a06af9a17 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:56.156260 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04319f28-2e55-4fea-8f2d-d3f8d0c74788 service placement] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:56.159738 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ebf7e-d775-4446-b4fc-ed86f2068ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:56.160696 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ebf7e-d775-4446-b4fc-ed86f2068ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:56.160986 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ebf7e-d775-4446-b4fc-ed86f2068ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:56.161264 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ebf7e-d775-4446-b4fc-ed86f2068ae4 admin admin] PATH_INFO: `/v3/projects/269f2cccbd3f4fa68dc92f5e2b80820f` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:56.162782 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131ebf7e-d775-4446-b4fc-ed86f2068ae4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=269f2cccbd3f4fa68dc92f5e2b80820f)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:56.164923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131ebf7e-d775-4446-b4fc-ed86f2068ae4 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:56.180330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28347570-52be-4607-b326-97e871d350d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:56.180979 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28347570-52be-4607-b326-97e871d350d9 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:56.181261 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28347570-52be-4607-b326-97e871d350d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:56.181535 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28347570-52be-4607-b326-97e871d350d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:56.182311 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28347570-52be-4607-b326-97e871d350d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:56.184178 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28347570-52be-4607-b326-97e871d350d9 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:56.232634 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 849/1702] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:48:56.233530 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28347570-52be-4607-b326-97e871d350d9 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:56.241717 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-131ebf7e-d775-4446-b4fc-ed86f2068ae4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '269f2cccbd3f4fa68dc92f5e2b80820f', 'request_id': 'req-131ebf7e-d775-4446-b4fc-ed86f2068ae4'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:56.269780 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-131ebf7e-d775-4446-b4fc-ed86f2068ae4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '269f2cccbd3f4fa68dc92f5e2b80820f', 'request_id': 'req-131ebf7e-d775-4446-b4fc-ed86f2068ae4'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:56.272563 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28347570-52be-4607-b326-97e871d350d9 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:56.273528 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:56.286044 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-131ebf7e-d775-4446-b4fc-ed86f2068ae4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '269f2cccbd3f4fa68dc92f5e2b80820f', 'request_id': 'req-131ebf7e-d775-4446-b4fc-ed86f2068ae4'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:56.345395 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-131ebf7e-d775-4446-b4fc-ed86f2068ae4 admin admin] The token cache is being invalidate because project 269f2cccbd3f4fa68dc92f5e2b80820f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:48:56.347350 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-131ebf7e-d775-4446-b4fc-ed86f2068ae4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:56.348925 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-131ebf7e-d775-4446-b4fc-ed86f2068ae4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:56.353612 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 854/1703] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:48:56 2022] DELETE /identity/v3/projects/269f2cccbd3f4fa68dc92f5e2b80820f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:48:56.357044 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ebf7e-d775-4446-b4fc-ed86f2068ae4 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:56.361064 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-131ebf7e-d775-4446-b4fc-ed86f2068ae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:56.464617 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ebf7e-d775-4446-b4fc-ed86f2068ae4 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:56.469919 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5a4b4-9576-4b2c-945d-dc5906bb117d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:56.471045 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5a4b4-9576-4b2c-945d-dc5906bb117d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:56.471391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5a4b4-9576-4b2c-945d-dc5906bb117d admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:56.471668 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5a4b4-9576-4b2c-945d-dc5906bb117d admin admin] PATH_INFO: `/v3/projects/e822b61ec854498b8e9ae4e17faa43e9` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:56.472078 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4632e15f-7843-4aa9-84d1-7b8e6eb37572 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:56.473200 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5a4b4-9576-4b2c-945d-dc5906bb117d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e822b61ec854498b8e9ae4e17faa43e9)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:56.475199 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632e15f-7843-4aa9-84d1-7b8e6eb37572 service nova] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:56.475364 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632e15f-7843-4aa9-84d1-7b8e6eb37572 service nova] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:56.475597 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5a4b4-9576-4b2c-945d-dc5906bb117d admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:56.475727 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4632e15f-7843-4aa9-84d1-7b8e6eb37572 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:56.481274 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-4632e15f-7843-4aa9-84d1-7b8e6eb37572 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:56.543347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-b7b5a4b4-9576-4b2c-945d-dc5906bb117d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e822b61ec854498b8e9ae4e17faa43e9', 'request_id': 'req-b7b5a4b4-9576-4b2c-945d-dc5906bb117d'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:56.551327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-b7b5a4b4-9576-4b2c-945d-dc5906bb117d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e822b61ec854498b8e9ae4e17faa43e9', 'request_id': 'req-b7b5a4b4-9576-4b2c-945d-dc5906bb117d'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:56.562850 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-b7b5a4b4-9576-4b2c-945d-dc5906bb117d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e822b61ec854498b8e9ae4e17faa43e9', 'request_id': 'req-b7b5a4b4-9576-4b2c-945d-dc5906bb117d'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:56.588146 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-b7b5a4b4-9576-4b2c-945d-dc5906bb117d admin admin] The token cache is being invalidate because project e822b61ec854498b8e9ae4e17faa43e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:48:56.588846 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-b7b5a4b4-9576-4b2c-945d-dc5906bb117d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:56.591831 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-b7b5a4b4-9576-4b2c-945d-dc5906bb117d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:48:56.600727 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 855/1704] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:48:56 2022] DELETE /identity/v3/projects/e822b61ec854498b8e9ae4e17faa43e9 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:48:56.602816 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5a4b4-9576-4b2c-945d-dc5906bb117d admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:56.609789 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-b7b5a4b4-9576-4b2c-945d-dc5906bb117d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:56.724085 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4632e15f-7843-4aa9-84d1-7b8e6eb37572 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:56.730039 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4632e15f-7843-4aa9-84d1-7b8e6eb37572 service nova] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:56.768743 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 850/1705] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:56 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:56.774014 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77448a38-f146-4107-a0f7-083a2376a13f None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:56.775732 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77448a38-f146-4107-a0f7-083a2376a13f None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:56.776474 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77448a38-f146-4107-a0f7-083a2376a13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:56.863668 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-77448a38-f146-4107-a0f7-083a2376a13f None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:56.869298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5a4b4-9576-4b2c-945d-dc5906bb117d admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:56.876468 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-77448a38-f146-4107-a0f7-083a2376a13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:56.886974 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051b8bb-30ee-4970-a23c-26c4820eeac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:56.887673 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051b8bb-30ee-4970-a23c-26c4820eeac2 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:56.887954 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051b8bb-30ee-4970-a23c-26c4820eeac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:56.888230 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051b8bb-30ee-4970-a23c-26c4820eeac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:56.889629 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051b8bb-30ee-4970-a23c-26c4820eeac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:56.907932 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051b8bb-30ee-4970-a23c-26c4820eeac2 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:56.933275 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 851/1706] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:56.942546 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854cd1e-9bbd-4328-b9bf-4d526ee00a67 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:56.942718 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854cd1e-9bbd-4328-b9bf-4d526ee00a67 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:56.943257 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854cd1e-9bbd-4328-b9bf-4d526ee00a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:56.965257 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 856/1707] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:48:56.973261 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d17d4-ea2d-4443-90bf-7fdf0f18bcb6 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:56.979267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d17d4-ea2d-4443-90bf-7fdf0f18bcb6 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:56.979785 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d17d4-ea2d-4443-90bf-7fdf0f18bcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:57.031072 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-d854cd1e-9bbd-4328-b9bf-4d526ee00a67 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:57.032362 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-d854cd1e-9bbd-4328-b9bf-4d526ee00a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:57.057770 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 852/1708] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:57.058704 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854cd1e-9bbd-4328-b9bf-4d526ee00a67 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:57.073744 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-551d17d4-ea2d-4443-90bf-7fdf0f18bcb6 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:57.076029 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-551d17d4-ea2d-4443-90bf-7fdf0f18bcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:57.080623 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854cd1e-9bbd-4328-b9bf-4d526ee00a67 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:57.092594 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 857/1709] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:57.094646 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbf1a7-a36e-478a-a1f1-0e76a5369dd5 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:57.096588 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbf1a7-a36e-478a-a1f1-0e76a5369dd5 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:57.097197 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbf1a7-a36e-478a-a1f1-0e76a5369dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:57.098655 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe545524-33dd-4723-9e24-ab8fb5e3049c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:57.106682 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe545524-33dd-4723-9e24-ab8fb5e3049c admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:57.106970 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe545524-33dd-4723-9e24-ab8fb5e3049c admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:57.107236 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe545524-33dd-4723-9e24-ab8fb5e3049c admin admin] PATH_INFO: `/v3/projects/629fb8d0485f4628b5e78d5079bd75a5/users/0c07a13d08ca407eaed6027aae600e9f/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:57.146665 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-1cdbf1a7-a36e-478a-a1f1-0e76a5369dd5 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:57.147972 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-1cdbf1a7-a36e-478a-a1f1-0e76a5369dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:57.163893 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe545524-33dd-4723-9e24-ab8fb5e3049c admin admin] RBAC: Authorizing `identity:create_grant(project_id=629fb8d0485f4628b5e78d5079bd75a5, user_id=0c07a13d08ca407eaed6027aae600e9f, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:57.172008 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe545524-33dd-4723-9e24-ab8fb5e3049c admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:57.179759 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 858/1710] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:57.180638 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbf1a7-a36e-478a-a1f1-0e76a5369dd5 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:57.190404 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:57.201109 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbf1a7-a36e-478a-a1f1-0e76a5369dd5 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:57.220935 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 853/1711] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:48:57 2022] PUT /identity/v3/projects/629fb8d0485f4628b5e78d5079bd75a5/users/0c07a13d08ca407eaed6027aae600e9f/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:48:57.222269 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe545524-33dd-4723-9e24-ab8fb5e3049c admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:57.223640 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40dc088-0179-4f71-b5aa-c9d8320bb26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:57.224495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40dc088-0179-4f71-b5aa-c9d8320bb26c admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:57.224612 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40dc088-0179-4f71-b5aa-c9d8320bb26c admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:57.224854 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40dc088-0179-4f71-b5aa-c9d8320bb26c admin admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:57.225746 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40dc088-0179-4f71-b5aa-c9d8320bb26c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:48:57.226787 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40dc088-0179-4f71-b5aa-c9d8320bb26c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:57.231918 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40dc088-0179-4f71-b5aa-c9d8320bb26c admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:57.278286 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 859/1712] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:48:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:48:57.278286 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222bdda3-b731-46fd-85e7-0321cbbbf611 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:57.278566 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222bdda3-b731-46fd-85e7-0321cbbbf611 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:57.278638 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222bdda3-b731-46fd-85e7-0321cbbbf611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:57.312490 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:57.342457 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-222bdda3-b731-46fd-85e7-0321cbbbf611 None None] MFA Rules not processed for user `0c07a13d08ca407eaed6027aae600e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:57.343845 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-222bdda3-b731-46fd-85e7-0321cbbbf611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:57.404268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe545524-33dd-4723-9e24-ab8fb5e3049c admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:57.411916 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce142798-ab47-4cb0-9516-8961f238cc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:57.412707 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce142798-ab47-4cb0-9516-8961f238cc35 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:57.418631 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce142798-ab47-4cb0-9516-8961f238cc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:57.426030 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce142798-ab47-4cb0-9516-8961f238cc35 admin admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:57.427011 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce142798-ab47-4cb0-9516-8961f238cc35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:48:57.427430 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce142798-ab47-4cb0-9516-8961f238cc35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:57.435454 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce142798-ab47-4cb0-9516-8961f238cc35 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:57.477560 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 854/1713] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:48:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:48:57.480115 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce142798-ab47-4cb0-9516-8961f238cc35 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:57.503749 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 860/1714] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:57 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:57.503749 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222bdda3-b731-46fd-85e7-0321cbbbf611 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:57.513134 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce142798-ab47-4cb0-9516-8961f238cc35 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:57.525677 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222bdda3-b731-46fd-85e7-0321cbbbf611 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:57.533053 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b629fb7-d27b-497a-9c29-2be9a1dc2dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:57.533924 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b629fb7-d27b-497a-9c29-2be9a1dc2dbc admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:57.535076 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b629fb7-d27b-497a-9c29-2be9a1dc2dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:57.540938 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b629fb7-d27b-497a-9c29-2be9a1dc2dbc admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:57.542211 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b629fb7-d27b-497a-9c29-2be9a1dc2dbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:57.542905 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d0b1c-acf4-4488-9379-99eeabe40a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:57.543609 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d0b1c-acf4-4488-9379-99eeabe40a32 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:57.543892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d0b1c-acf4-4488-9379-99eeabe40a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:57.544232 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d0b1c-acf4-4488-9379-99eeabe40a32 admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:57.545686 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d0b1c-acf4-4488-9379-99eeabe40a32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:57.547446 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b629fb7-d27b-497a-9c29-2be9a1dc2dbc admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:57.549134 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d0b1c-acf4-4488-9379-99eeabe40a32 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:57.644747 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 861/1715] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:48:57 2022] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:48:57.645801 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d0b1c-acf4-4488-9379-99eeabe40a32 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:57.655002 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 855/1716] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:48:57 2022] POST /identity/v3/projects => generated 377 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:48:57.656064 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b629fb7-d27b-497a-9c29-2be9a1dc2dbc admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:57.859348 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d0b1c-acf4-4488-9379-99eeabe40a32 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:57.888426 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b629fb7-d27b-497a-9c29-2be9a1dc2dbc admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:57.915951 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7598d59-c99f-44f6-a57c-02dfdbedd64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:57.916657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7598d59-c99f-44f6-a57c-02dfdbedd64a admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:57.918094 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7598d59-c99f-44f6-a57c-02dfdbedd64a admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:57.918094 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7598d59-c99f-44f6-a57c-02dfdbedd64a admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:57.918808 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7598d59-c99f-44f6-a57c-02dfdbedd64a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:57.920770 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7598d59-c99f-44f6-a57c-02dfdbedd64a admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:57.995604 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 856/1717] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:48:57 2022] POST /identity/v3/users => generated 289 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:48:57.999306 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7598d59-c99f-44f6-a57c-02dfdbedd64a admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:58.023483 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7598d59-c99f-44f6-a57c-02dfdbedd64a admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:58.035482 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf213cf-6d8d-4114-8dce-a5163a22d7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:58.036386 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf213cf-6d8d-4114-8dce-a5163a22d7f8 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:58.040487 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf213cf-6d8d-4114-8dce-a5163a22d7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:58.041101 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf213cf-6d8d-4114-8dce-a5163a22d7f8 admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:58.042354 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf213cf-6d8d-4114-8dce-a5163a22d7f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:58.045276 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a878fc7-99ec-46d4-8bc2-e0bd21738ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:58.048536 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a878fc7-99ec-46d4-8bc2-e0bd21738ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:58.048642 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a878fc7-99ec-46d4-8bc2-e0bd21738ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:58.048876 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a878fc7-99ec-46d4-8bc2-e0bd21738ff3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:58.049592 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a878fc7-99ec-46d4-8bc2-e0bd21738ff3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:58.052736 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf213cf-6d8d-4114-8dce-a5163a22d7f8 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:58.056489 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a878fc7-99ec-46d4-8bc2-e0bd21738ff3 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:58.094513 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 857/1718] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:48:57 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:48:58.095703 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf213cf-6d8d-4114-8dce-a5163a22d7f8 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:58.096545 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:58.132934 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf213cf-6d8d-4114-8dce-a5163a22d7f8 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:58.142844 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1f181-44a1-48c9-b6ef-5579d2b4c1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:58.143521 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1f181-44a1-48c9-b6ef-5579d2b4c1cd admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:58.143904 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1f181-44a1-48c9-b6ef-5579d2b4c1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:58.146721 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1f181-44a1-48c9-b6ef-5579d2b4c1cd admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:58.147247 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab1f181-44a1-48c9-b6ef-5579d2b4c1cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:58.153135 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab1f181-44a1-48c9-b6ef-5579d2b4c1cd admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:58.159187 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 862/1719] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:48:57 2022] POST /identity/v3/projects => generated 355 bytes in 514 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:48:58.163635 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a878fc7-99ec-46d4-8bc2-e0bd21738ff3 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:58.179762 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 858/1720] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:48:58.181059 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1f181-44a1-48c9-b6ef-5579d2b4c1cd admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:58.219054 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1f181-44a1-48c9-b6ef-5579d2b4c1cd admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:58.347147 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f97b8c-1529-4b66-9956-d8a71300cea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:58.348071 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f97b8c-1529-4b66-9956-d8a71300cea3 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:58.348637 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f97b8c-1529-4b66-9956-d8a71300cea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:58.349013 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f97b8c-1529-4b66-9956-d8a71300cea3 admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:58.352332 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f97b8c-1529-4b66-9956-d8a71300cea3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:58.354427 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f97b8c-1529-4b66-9956-d8a71300cea3 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:58.374694 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:58.411878 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 859/1721] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:48:58 2022] POST /identity/v3/users => generated 284 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:48:58.413081 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f97b8c-1529-4b66-9956-d8a71300cea3 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:58.458770 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a878fc7-99ec-46d4-8bc2-e0bd21738ff3 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:58.470698 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f97b8c-1529-4b66-9956-d8a71300cea3 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:58.483120 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3873a7-62d3-40c8-a520-f0d0b2ac68d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:58.483826 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3873a7-62d3-40c8-a520-f0d0b2ac68d7 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:58.484109 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3873a7-62d3-40c8-a520-f0d0b2ac68d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:58.484379 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3873a7-62d3-40c8-a520-f0d0b2ac68d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:58.485181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3873a7-62d3-40c8-a520-f0d0b2ac68d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:58.490272 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3873a7-62d3-40c8-a520-f0d0b2ac68d7 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:58.490572 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5a9e4-f723-4d77-aef3-5e4ce4620399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:58.491622 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5a9e4-f723-4d77-aef3-5e4ce4620399 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:58.493129 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5a9e4-f723-4d77-aef3-5e4ce4620399 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:58.494233 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5a9e4-f723-4d77-aef3-5e4ce4620399 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:58.495727 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5a9e4-f723-4d77-aef3-5e4ce4620399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:58.500839 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5a9e4-f723-4d77-aef3-5e4ce4620399 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:58.521001 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 863/1722] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:48:58.521941 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3873a7-62d3-40c8-a520-f0d0b2ac68d7 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:58.559059 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 860/1723] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:48:58.561152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3317ec-d751-46f4-aca9-bb292f8173f9 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:58.563445 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3317ec-d751-46f4-aca9-bb292f8173f9 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:58.566283 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3317ec-d751-46f4-aca9-bb292f8173f9 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:58.570689 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 861/1724] 10.222.0.27 () {54 vars in 912 bytes} [Tue Jul 5 20:48:58 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:48:58.571593 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3317ec-d751-46f4-aca9-bb292f8173f9 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:58.577021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3873a7-62d3-40c8-a520-f0d0b2ac68d7 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:58.583134 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff93c9-ed3e-4634-a47a-5e96b3bdb675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:58.584085 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff93c9-ed3e-4634-a47a-5e96b3bdb675 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:58.584504 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff93c9-ed3e-4634-a47a-5e96b3bdb675 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:58.584918 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff93c9-ed3e-4634-a47a-5e96b3bdb675 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:58.585959 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff93c9-ed3e-4634-a47a-5e96b3bdb675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:58.587929 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff93c9-ed3e-4634-a47a-5e96b3bdb675 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:58.607881 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 864/1725] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:48:58.608839 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff93c9-ed3e-4634-a47a-5e96b3bdb675 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:58.617081 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3317ec-d751-46f4-aca9-bb292f8173f9 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:58.619937 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff93c9-ed3e-4634-a47a-5e96b3bdb675 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:58.625041 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee2d99-f963-4679-939d-db54ebaf6dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:58.626090 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee2d99-f963-4679-939d-db54ebaf6dc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:58.626446 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee2d99-f963-4679-939d-db54ebaf6dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:58.626792 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee2d99-f963-4679-939d-db54ebaf6dc7 admin admin] PATH_INFO: `/v3/projects/63f0c82305874582843a4e67a62e7e6a/users/505669e30e3c4c29b792a2faac0cafb5/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:58.634336 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535bc6e-9e7d-49e3-aa75-94d0849c9540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:58.635038 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535bc6e-9e7d-49e3-aa75-94d0849c9540 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:58.635464 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535bc6e-9e7d-49e3-aa75-94d0849c9540 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:58.635747 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535bc6e-9e7d-49e3-aa75-94d0849c9540 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:58.636484 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c535bc6e-9e7d-49e3-aa75-94d0849c9540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:58.638159 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c535bc6e-9e7d-49e3-aa75-94d0849c9540 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:58.648356 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee2d99-f963-4679-939d-db54ebaf6dc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63f0c82305874582843a4e67a62e7e6a, user_id=505669e30e3c4c29b792a2faac0cafb5, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:58.651241 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee2d99-f963-4679-939d-db54ebaf6dc7 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:58.681811 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 862/1726] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:48:58.681811 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9cfcd-b37a-4ada-9f97-31cfb40523d2 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:58.683160 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9cfcd-b37a-4ada-9f97-31cfb40523d2 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:58.684428 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9cfcd-b37a-4ada-9f97-31cfb40523d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:58.689790 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 865/1727] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:48:58 2022] PUT /identity/v3/projects/63f0c82305874582843a4e67a62e7e6a/users/505669e30e3c4c29b792a2faac0cafb5/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:48:58.690988 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee2d99-f963-4679-939d-db54ebaf6dc7 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:58.719955 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-13a9cfcd-b37a-4ada-9f97-31cfb40523d2 None None] MFA Rules not processed for user `157a258bcff642cb91a0a474f8f50941`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:58.721400 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-13a9cfcd-b37a-4ada-9f97-31cfb40523d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:58.863941 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee2d99-f963-4679-939d-db54ebaf6dc7 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:58.872141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4548ca-b776-42ac-aaa4-8537a69dd186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:58.875027 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4548ca-b776-42ac-aaa4-8537a69dd186 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:58.875367 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4548ca-b776-42ac-aaa4-8537a69dd186 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:58.875594 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4548ca-b776-42ac-aaa4-8537a69dd186 admin admin] PATH_INFO: `/v3/projects/a0de56e58d154dbb9e37f19d1a7644ca/users/9b50ef948fd84f6ab5537d78468e2022/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:58.895070 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 863/1728] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Jul 5 20:48:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:58.898833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9cfcd-b37a-4ada-9f97-31cfb40523d2 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:58.934787 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4548ca-b776-42ac-aaa4-8537a69dd186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0de56e58d154dbb9e37f19d1a7644ca, user_id=9b50ef948fd84f6ab5537d78468e2022, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:58.940747 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4548ca-b776-42ac-aaa4-8537a69dd186 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:58.948573 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9cfcd-b37a-4ada-9f97-31cfb40523d2 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:58.977429 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 866/1729] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:48:58 2022] PUT /identity/v3/projects/a0de56e58d154dbb9e37f19d1a7644ca/users/9b50ef948fd84f6ab5537d78468e2022/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:48:58.979712 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b2cc8-6527-435b-8ac1-62594d3f7b74 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:58.979991 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b2cc8-6527-435b-8ac1-62594d3f7b74 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:58.980469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b2cc8-6527-435b-8ac1-62594d3f7b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:59.040439 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-a39b2cc8-6527-435b-8ac1-62594d3f7b74 None None] MFA Rules not processed for user `505669e30e3c4c29b792a2faac0cafb5`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:59.042700 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-a39b2cc8-6527-435b-8ac1-62594d3f7b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:59.069311 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:59.186388 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 867/1730] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:59.187887 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b2cc8-6527-435b-8ac1-62594d3f7b74 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:59.189624 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-a39b2cc8-6527-435b-8ac1-62594d3f7b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:59.212117 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d6456-1864-400f-a9df-60695ef8bc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:59.213076 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d6456-1864-400f-a9df-60695ef8bc5f admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:59.213354 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d6456-1864-400f-a9df-60695ef8bc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:59.213627 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d6456-1864-400f-a9df-60695ef8bc5f admin admin] PATH_INFO: `/v3/projects/d287d9fdf3f84d099bb00b66c6821ac8/users/fd0de6b6ed4841b3bad01b95f219fba4/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:59.250650 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d6456-1864-400f-a9df-60695ef8bc5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d287d9fdf3f84d099bb00b66c6821ac8, user_id=fd0de6b6ed4841b3bad01b95f219fba4, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:59.253941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d6456-1864-400f-a9df-60695ef8bc5f admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:59.285494 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 864/1731] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:48:58 2022] PUT /identity/v3/projects/d287d9fdf3f84d099bb00b66c6821ac8/users/fd0de6b6ed4841b3bad01b95f219fba4/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:48:59.287496 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0643f5-7a32-4de4-a41c-a2d59412169a None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:59.287926 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0643f5-7a32-4de4-a41c-a2d59412169a None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:59.288372 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0643f5-7a32-4de4-a41c-a2d59412169a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:59.308709 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b2cc8-6527-435b-8ac1-62594d3f7b74 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:59.342521 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-4c0643f5-7a32-4de4-a41c-a2d59412169a None None] MFA Rules not processed for user `96c018ba46da45b3a079189aafdcdecd`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:59.343760 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-4c0643f5-7a32-4de4-a41c-a2d59412169a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:59.397278 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f76b7-d34f-443f-a0a4-373885af053a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:59.397867 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f76b7-d34f-443f-a0a4-373885af053a service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:59.398299 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f76b7-d34f-443f-a0a4-373885af053a service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:59.398576 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f76b7-d34f-443f-a0a4-373885af053a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:59.410157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f76b7-d34f-443f-a0a4-373885af053a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:59.412615 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f76b7-d34f-443f-a0a4-373885af053a service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:59.428071 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 868/1732] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:59.430350 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f76b7-d34f-443f-a0a4-373885af053a service neutron] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:59.518646 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 865/1733] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:59.520787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0643f5-7a32-4de4-a41c-a2d59412169a None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:59.523188 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-4c0643f5-7a32-4de4-a41c-a2d59412169a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:59.584645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:59.618297 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f76b7-d34f-443f-a0a4-373885af053a service neutron] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:59.625166 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a397dd5-80a8-4069-8010-d6313f8f11eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:59.626265 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a397dd5-80a8-4069-8010-d6313f8f11eb admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:59.628908 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a397dd5-80a8-4069-8010-d6313f8f11eb admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:59.629404 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a397dd5-80a8-4069-8010-d6313f8f11eb admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:59.630765 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a397dd5-80a8-4069-8010-d6313f8f11eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:59.632992 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a397dd5-80a8-4069-8010-d6313f8f11eb admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:59.655533 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 869/1734] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:48:59.657257 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b8427-57ea-4883-814b-183cb59154f5 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:59.657730 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b8427-57ea-4883-814b-183cb59154f5 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:59.658721 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b8427-57ea-4883-814b-183cb59154f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:59.735142 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-bf3b8427-57ea-4883-814b-183cb59154f5 None None] MFA Rules not processed for user `fd0de6b6ed4841b3bad01b95f219fba4`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:48:59.736676 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-bf3b8427-57ea-4883-814b-183cb59154f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:48:59.746342 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:48:59.747302 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0643f5-7a32-4de4-a41c-a2d59412169a None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:59.758136 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550745d-bc2d-400d-a77f-5efa87663285 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05f331339d143c09eaa12efe2b80653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:59.758908 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550745d-bc2d-400d-a77f-5efa87663285 service glance] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:59.759258 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550745d-bc2d-400d-a77f-5efa87663285 service glance] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:59.759856 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550745d-bc2d-400d-a77f-5efa87663285 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:59.921418 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 870/1735] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:48:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:48:59.927334 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b8427-57ea-4883-814b-183cb59154f5 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:48:59.927760 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550745d-bc2d-400d-a77f-5efa87663285 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:59.929321 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550745d-bc2d-400d-a77f-5efa87663285 service glance] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:48:59.947495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b8427-57ea-4883-814b-183cb59154f5 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:48:59.950521 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 866/1736] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:48:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:48:59.952369 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456624c-0872-4534-b510-0a4eaa475bca None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:59.952369 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456624c-0872-4534-b510-0a4eaa475bca None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:59.953391 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456624c-0872-4534-b510-0a4eaa475bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:59.968901 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929d649-15b6-4f1a-a179-9136f55d2938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:48:59.969942 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929d649-15b6-4f1a-a179-9136f55d2938 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:48:59.970262 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929d649-15b6-4f1a-a179-9136f55d2938 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:48:59.970736 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929d649-15b6-4f1a-a179-9136f55d2938 admin admin] PATH_INFO: `/v3/projects/a0de56e58d154dbb9e37f19d1a7644ca/users/9b50ef948fd84f6ab5537d78468e2022/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:48:59.973300 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7929d649-15b6-4f1a-a179-9136f55d2938 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0de56e58d154dbb9e37f19d1a7644ca, user_id=9b50ef948fd84f6ab5537d78468e2022, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:48:59.980305 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7929d649-15b6-4f1a-a179-9136f55d2938 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:00.022251 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-f456624c-0872-4534-b510-0a4eaa475bca None None] MFA Rules not processed for user `c9647d15389e49e6b7c43ea1b1538a13`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:00.026216 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 871/1737] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:48:59 2022] PUT /identity/v3/projects/a0de56e58d154dbb9e37f19d1a7644ca/users/9b50ef948fd84f6ab5537d78468e2022/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:00.044065 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929d649-15b6-4f1a-a179-9136f55d2938 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:00.045473 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-f456624c-0872-4534-b510-0a4eaa475bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:00.249748 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 867/1738] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Jul 5 20:48:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:00.253135 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb03634-fab9-413b-9a64-2caa557967e9 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:00.271003 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb03634-fab9-413b-9a64-2caa557967e9 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:00.271920 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb03634-fab9-413b-9a64-2caa557967e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:00.305998 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929d649-15b6-4f1a-a179-9136f55d2938 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:00.334606 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93758743-56e4-4ce0-aad6-39d696860df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:00.337733 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93758743-56e4-4ce0-aad6-39d696860df7 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:00.338984 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93758743-56e4-4ce0-aad6-39d696860df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:00.338984 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93758743-56e4-4ce0-aad6-39d696860df7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:00.341807 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93758743-56e4-4ce0-aad6-39d696860df7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:00.351087 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93758743-56e4-4ce0-aad6-39d696860df7 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:00.428673 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-ecb03634-fab9-413b-9a64-2caa557967e9 None None] MFA Rules not processed for user `9b50ef948fd84f6ab5537d78468e2022`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:00.435723 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-ecb03634-fab9-413b-9a64-2caa557967e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:00.478011 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 872/1739] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:49:00 2022] POST /identity/v3/projects => generated 373 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:49:00.485436 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93758743-56e4-4ce0-aad6-39d696860df7 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:00.589997 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:00.621559 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 868/1740] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:00 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:00.633871 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb03634-fab9-413b-9a64-2caa557967e9 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:00.637501 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-ecb03634-fab9-413b-9a64-2caa557967e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:00.673425 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93758743-56e4-4ce0-aad6-39d696860df7 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:00.686221 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a1099-4591-41f5-b895-8b57284676fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:00.687706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a1099-4591-41f5-b895-8b57284676fd admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:00.689211 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a1099-4591-41f5-b895-8b57284676fd admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:00.689698 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a1099-4591-41f5-b895-8b57284676fd admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:00.691670 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a1099-4591-41f5-b895-8b57284676fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:00.696856 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a1099-4591-41f5-b895-8b57284676fd admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:00.756187 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 873/1741] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:49:00 2022] POST /identity/v3/users => generated 293 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:49:00.757370 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a1099-4591-41f5-b895-8b57284676fd admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:00.762556 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-cd7a1099-4591-41f5-b895-8b57284676fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:00.796096 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb03634-fab9-413b-9a64-2caa557967e9 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:00.798076 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:00.971397 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a1099-4591-41f5-b895-8b57284676fd admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:00.987632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061a668-ac32-4d4c-a965-a0d6daf20de8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90aa580a2e10467a93c2d79d1906bd8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:00.989767 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061a668-ac32-4d4c-a965-a0d6daf20de8 service swift] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:00.993897 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061a668-ac32-4d4c-a965-a0d6daf20de8 service swift] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:00.994445 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061a668-ac32-4d4c-a965-a0d6daf20de8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:01.055108 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206667d8-f05e-412d-b68f-adf380adb0fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:01.059110 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206667d8-f05e-412d-b68f-adf380adb0fa service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:01.059594 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206667d8-f05e-412d-b68f-adf380adb0fa service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:01.059877 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206667d8-f05e-412d-b68f-adf380adb0fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:01.195852 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061a668-ac32-4d4c-a965-a0d6daf20de8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:01.200167 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061a668-ac32-4d4c-a965-a0d6daf20de8 service swift] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:01.227606 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 874/1742] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Jul 5 20:49:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 20:49:01.238288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061a668-ac32-4d4c-a965-a0d6daf20de8 service swift] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:01.280306 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061a668-ac32-4d4c-a965-a0d6daf20de8 service swift] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:01.299081 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f42c42-a2e1-4c5f-b279-3afc4a88b9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:01.301221 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f42c42-a2e1-4c5f-b279-3afc4a88b9ab admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:01.301996 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f42c42-a2e1-4c5f-b279-3afc4a88b9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:01.303153 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f42c42-a2e1-4c5f-b279-3afc4a88b9ab admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:01.304802 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f42c42-a2e1-4c5f-b279-3afc4a88b9ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:01.308279 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f42c42-a2e1-4c5f-b279-3afc4a88b9ab admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:01.367649 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 875/1743] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:49:01.375091 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea49494-107b-4cb4-bb93-e0840f536abf None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:01.375831 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea49494-107b-4cb4-bb93-e0840f536abf None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:01.376162 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea49494-107b-4cb4-bb93-e0840f536abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:01.408989 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206667d8-f05e-412d-b68f-adf380adb0fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:01.411853 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206667d8-f05e-412d-b68f-adf380adb0fa service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:01.481734 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-8ea49494-107b-4cb4-bb93-e0840f536abf None None] MFA Rules not processed for user `1f6d6f1250b14637bb24345550161cda`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:01.487055 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-8ea49494-107b-4cb4-bb93-e0840f536abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:01.490880 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 869/1744] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:00 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 858 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:49:01.496620 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206667d8-f05e-412d-b68f-adf380adb0fa service cinder] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:01.577700 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206667d8-f05e-412d-b68f-adf380adb0fa service cinder] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:01.606102 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddf33b-86d2-4e20-a613-af68f17bc47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:01.613084 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddf33b-86d2-4e20-a613-af68f17bc47e admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:01.614319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddf33b-86d2-4e20-a613-af68f17bc47e admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:01.616915 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddf33b-86d2-4e20-a613-af68f17bc47e admin admin] PATH_INFO: `/v3/projects/88ccb68ecccf4f21a3396f7c0a9e652f/users/06e7072377ec405d943d53b3ee8063cb/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:01.717322 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ddf33b-86d2-4e20-a613-af68f17bc47e admin admin] RBAC: Authorizing `identity:create_grant(project_id=88ccb68ecccf4f21a3396f7c0a9e652f, user_id=06e7072377ec405d943d53b3ee8063cb, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:01.734698 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ddf33b-86d2-4e20-a613-af68f17bc47e admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:01.791150 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 876/1745] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:01.792845 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 870/1746] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:49:01 2022] PUT /identity/v3/projects/88ccb68ecccf4f21a3396f7c0a9e652f/users/06e7072377ec405d943d53b3ee8063cb/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:01.800765 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea49494-107b-4cb4-bb93-e0840f536abf None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:01.802626 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddf33b-86d2-4e20-a613-af68f17bc47e admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:01.863921 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea49494-107b-4cb4-bb93-e0840f536abf None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:02.033478 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:02.070278 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:02.100915 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5012bdd-cbbf-4002-bdea-72225f438f68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:02.101589 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5012bdd-cbbf-4002-bdea-72225f438f68 service cinder] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:02.101894 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5012bdd-cbbf-4002-bdea-72225f438f68 service cinder] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:02.102174 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5012bdd-cbbf-4002-bdea-72225f438f68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:02.122863 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddf33b-86d2-4e20-a613-af68f17bc47e admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:02.141002 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b9b94-c04a-4a4d-99b6-c5a1eaa80b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:02.141775 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b9b94-c04a-4a4d-99b6-c5a1eaa80b85 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:02.142466 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b9b94-c04a-4a4d-99b6-c5a1eaa80b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:02.142466 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b9b94-c04a-4a4d-99b6-c5a1eaa80b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:02.143087 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b9b94-c04a-4a4d-99b6-c5a1eaa80b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:02.148566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b9b94-c04a-4a4d-99b6-c5a1eaa80b85 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:02.206749 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 871/1747] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:49:02.209741 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b9b94-c04a-4a4d-99b6-c5a1eaa80b85 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:02.248538 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b9b94-c04a-4a4d-99b6-c5a1eaa80b85 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:02.257958 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920edb89-dbe8-4772-9295-27967b6807db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:02.259720 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920edb89-dbe8-4772-9295-27967b6807db admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:02.260500 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920edb89-dbe8-4772-9295-27967b6807db admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:02.261402 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920edb89-dbe8-4772-9295-27967b6807db admin admin] PATH_INFO: `/v3/projects/88ccb68ecccf4f21a3396f7c0a9e652f/users/06e7072377ec405d943d53b3ee8063cb/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:02.265720 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920edb89-dbe8-4772-9295-27967b6807db admin admin] RBAC: Authorizing `identity:create_grant(project_id=88ccb68ecccf4f21a3396f7c0a9e652f, user_id=06e7072377ec405d943d53b3ee8063cb, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:02.269397 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5012bdd-cbbf-4002-bdea-72225f438f68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:02.271553 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920edb89-dbe8-4772-9295-27967b6807db admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:02.272077 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5012bdd-cbbf-4002-bdea-72225f438f68 service cinder] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:02.299193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 877/1748] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:01 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:49:02.329664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392efbef-b00c-4495-b3ee-ad2f76f9c2ce None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:02.330211 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392efbef-b00c-4495-b3ee-ad2f76f9c2ce None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:02.330633 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392efbef-b00c-4495-b3ee-ad2f76f9c2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:02.334099 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 872/1749] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:49:02 2022] PUT /identity/v3/projects/88ccb68ecccf4f21a3396f7c0a9e652f/users/06e7072377ec405d943d53b3ee8063cb/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:02.425330 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-392efbef-b00c-4495-b3ee-ad2f76f9c2ce None None] MFA Rules not processed for user `06e7072377ec405d943d53b3ee8063cb`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:02.430028 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-392efbef-b00c-4495-b3ee-ad2f76f9c2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:02.435989 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d0e78-0e4e-466e-a49d-27f7fc4e60bd None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:02.436488 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d0e78-0e4e-466e-a49d-27f7fc4e60bd None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:02.436904 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d0e78-0e4e-466e-a49d-27f7fc4e60bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:02.480885 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-a33d0e78-0e4e-466e-a49d-27f7fc4e60bd None None] MFA Rules not processed for user `c9647d15389e49e6b7c43ea1b1538a13`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:02.489962 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-a33d0e78-0e4e-466e-a49d-27f7fc4e60bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:02.815299 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 873/1750] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Jul 5 20:49:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 05 20:49:02.826791 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d0e78-0e4e-466e-a49d-27f7fc4e60bd None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:02.836443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 878/1751] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 508 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:02.870097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392efbef-b00c-4495-b3ee-ad2f76f9c2ce None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:02.871701 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-392efbef-b00c-4495-b3ee-ad2f76f9c2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:03.063683 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392efbef-b00c-4495-b3ee-ad2f76f9c2ce None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:03.073781 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7c282-de40-40f7-97aa-7151ed161727 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:03.085330 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7c282-de40-40f7-97aa-7151ed161727 service cinder] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:03.085681 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7c282-de40-40f7-97aa-7151ed161727 service cinder] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:03.085995 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7c282-de40-40f7-97aa-7151ed161727 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:03.090094 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d0e78-0e4e-466e-a49d-27f7fc4e60bd None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:03.112141 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9f4d5-a74e-4abd-a0ac-cb34a561e0ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90aa580a2e10467a93c2d79d1906bd8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:03.116336 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9f4d5-a74e-4abd-a0ac-cb34a561e0ac service swift] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:03.116698 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9f4d5-a74e-4abd-a0ac-cb34a561e0ac service swift] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:03.116994 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9f4d5-a74e-4abd-a0ac-cb34a561e0ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:03.133097 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c9f4d5-a74e-4abd-a0ac-cb34a561e0ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:03.187397 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c9f4d5-a74e-4abd-a0ac-cb34a561e0ac service swift] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:03.221797 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 874/1752] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Jul 5 20:49:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 05 20:49:03.324041 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:03.451435 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c7c282-de40-40f7-97aa-7151ed161727 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:03.454223 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c7c282-de40-40f7-97aa-7151ed161727 service cinder] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:03.510842 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 879/1753] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:49:04.901471 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49e649-07ed-46cb-b5da-3ad605671d89 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:04.902197 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49e649-07ed-46cb-b5da-3ad605671d89 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:04.902197 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49e649-07ed-46cb-b5da-3ad605671d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:04.958394 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-4a49e649-07ed-46cb-b5da-3ad605671d89 None None] MFA Rules not processed for user `157a258bcff642cb91a0a474f8f50941`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:04.960869 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-4a49e649-07ed-46cb-b5da-3ad605671d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:05.206867 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 875/1754] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Jul 5 20:49:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:05.387656 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7c282-de40-40f7-97aa-7151ed161727 service cinder] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:05.403507 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7c282-de40-40f7-97aa-7151ed161727 service cinder] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:05.424859 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168ceef-9b03-4179-900b-8997d911269e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:05.425989 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168ceef-9b03-4179-900b-8997d911269e service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:05.426286 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168ceef-9b03-4179-900b-8997d911269e service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:05.428345 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168ceef-9b03-4179-900b-8997d911269e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:05.458822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f168ceef-9b03-4179-900b-8997d911269e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:05.462078 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f168ceef-9b03-4179-900b-8997d911269e service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:05.502285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 880/1755] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:49:07.271720 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49e649-07ed-46cb-b5da-3ad605671d89 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:07.278762 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:07.284975 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49e649-07ed-46cb-b5da-3ad605671d89 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:07.297284 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2587d-b977-4adb-92ec-ee950e0c8e9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:07.297993 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2587d-b977-4adb-92ec-ee950e0c8e9d service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:07.303571 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2587d-b977-4adb-92ec-ee950e0c8e9d service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:07.305631 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2587d-b977-4adb-92ec-ee950e0c8e9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:07.349737 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2587d-b977-4adb-92ec-ee950e0c8e9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:07.369133 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2587d-b977-4adb-92ec-ee950e0c8e9d service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:07.430867 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 876/1756] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:07 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:49:08.924143 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca94ea-d8c3-4cd4-ad45-468012968042 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:08.925970 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca94ea-d8c3-4cd4-ad45-468012968042 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:08.926457 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca94ea-d8c3-4cd4-ad45-468012968042 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:08.928590 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 881/1757] 10.222.0.27 () {54 vars in 921 bytes} [Tue Jul 5 20:49:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:49:09.057442 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066044ea-2237-4d8a-9faa-b83be7f8e747 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:09.060812 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066044ea-2237-4d8a-9faa-b83be7f8e747 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:09.061100 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066044ea-2237-4d8a-9faa-b83be7f8e747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:09.129151 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-066044ea-2237-4d8a-9faa-b83be7f8e747 None None] MFA Rules not processed for user `814b675b98b844a2a12a39890ee69d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:09.130419 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-066044ea-2237-4d8a-9faa-b83be7f8e747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:09.382809 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 877/1758] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Jul 5 20:49:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:09.554403 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca94ea-d8c3-4cd4-ad45-468012968042 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:09.556317 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-c0ca94ea-d8c3-4cd4-ad45-468012968042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:09.577116 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca94ea-d8c3-4cd4-ad45-468012968042 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:09.585191 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547493f-029e-404e-bc27-923292e81816 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:09.586398 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547493f-029e-404e-bc27-923292e81816 service nova] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:09.586842 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547493f-029e-404e-bc27-923292e81816 service nova] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:09.587409 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547493f-029e-404e-bc27-923292e81816 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:09.605427 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547493f-029e-404e-bc27-923292e81816 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:09.609629 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547493f-029e-404e-bc27-923292e81816 service nova] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:09.647597 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 882/1759] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:49:11.296004 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6703f7-00f5-4de2-bd21-546c8b31e6d7 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:11.296913 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6703f7-00f5-4de2-bd21-546c8b31e6d7 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:11.297450 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6703f7-00f5-4de2-bd21-546c8b31e6d7 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:11.299142 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 878/1760] 10.222.0.27 () {54 vars in 921 bytes} [Tue Jul 5 20:49:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:49:11.343191 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872bbbc7-d232-49d2-8d2f-6dd4f765af7d None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:11.343733 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872bbbc7-d232-49d2-8d2f-6dd4f765af7d None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:11.343733 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872bbbc7-d232-49d2-8d2f-6dd4f765af7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:11.397288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-872bbbc7-d232-49d2-8d2f-6dd4f765af7d None None] MFA Rules not processed for user `814b675b98b844a2a12a39890ee69d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:11.402535 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-872bbbc7-d232-49d2-8d2f-6dd4f765af7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:11.429617 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 883/1761] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Jul 5 20:49:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:12.345100 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6703f7-00f5-4de2-bd21-546c8b31e6d7 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:12.380096 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6703f7-00f5-4de2-bd21-546c8b31e6d7 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:12.386538 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478669a-7b06-4654-bb07-975e90cd1fda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:12.387528 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478669a-7b06-4654-bb07-975e90cd1fda service nova] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:12.387957 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478669a-7b06-4654-bb07-975e90cd1fda service nova] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:12.388425 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478669a-7b06-4654-bb07-975e90cd1fda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:12.419344 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478669a-7b06-4654-bb07-975e90cd1fda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:12.422183 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478669a-7b06-4654-bb07-975e90cd1fda service nova] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:12.438317 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 879/1762] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:49:19.047190 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872bbbc7-d232-49d2-8d2f-6dd4f765af7d None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:19.048799 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-872bbbc7-d232-49d2-8d2f-6dd4f765af7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:19.113991 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872bbbc7-d232-49d2-8d2f-6dd4f765af7d None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:19.118811 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e851c-4f6b-4be8-b921-d1a383150721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:19.119725 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e851c-4f6b-4be8-b921-d1a383150721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:19.120003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e851c-4f6b-4be8-b921-d1a383150721 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:19.120279 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e851c-4f6b-4be8-b921-d1a383150721 admin admin] PATH_INFO: `/v3/users/47994775a2ce412793145808b1d8fbac` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:19.121549 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e851c-4f6b-4be8-b921-d1a383150721 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47994775a2ce412793145808b1d8fbac)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:19.123505 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e851c-4f6b-4be8-b921-d1a383150721 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:19.177698 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-ed9e851c-4f6b-4be8-b921-d1a383150721 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47994775a2ce412793145808b1d8fbac'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:19.195425 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-ed9e851c-4f6b-4be8-b921-d1a383150721 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47994775a2ce412793145808b1d8fbac'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:19.203409 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-ed9e851c-4f6b-4be8-b921-d1a383150721 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47994775a2ce412793145808b1d8fbac'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:19.204203 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-ed9e851c-4f6b-4be8-b921-d1a383150721 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47994775a2ce412793145808b1d8fbac'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:19.204883 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-ed9e851c-4f6b-4be8-b921-d1a383150721 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47994775a2ce412793145808b1d8fbac'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:19.224787 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 884/1763] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:49:19 2022] DELETE /identity/v3/users/47994775a2ce412793145808b1d8fbac => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:19.229376 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda81fc7-aaf3-4935-8e1d-014de3ce0726 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:19.229906 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda81fc7-aaf3-4935-8e1d-014de3ce0726 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:19.230008 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda81fc7-aaf3-4935-8e1d-014de3ce0726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:19.247413 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-eda81fc7-aaf3-4935-8e1d-014de3ce0726 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:19.248629 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-eda81fc7-aaf3-4935-8e1d-014de3ce0726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:19.310962 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 880/1764] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:49:19.342258 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e851c-4f6b-4be8-b921-d1a383150721 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:19.349117 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-ed9e851c-4f6b-4be8-b921-d1a383150721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:19.395335 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:19.434778 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e851c-4f6b-4be8-b921-d1a383150721 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:19.439320 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210797a-8fe5-4384-ae2a-f2386e7e6af0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:19.440157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210797a-8fe5-4384-ae2a-f2386e7e6af0 service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:19.440620 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210797a-8fe5-4384-ae2a-f2386e7e6af0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:19.440899 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210797a-8fe5-4384-ae2a-f2386e7e6af0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:19.453086 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210797a-8fe5-4384-ae2a-f2386e7e6af0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:19.454959 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210797a-8fe5-4384-ae2a-f2386e7e6af0 service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:19.470125 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 885/1765] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:49:19.964234 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda81fc7-aaf3-4935-8e1d-014de3ce0726 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:19.966275 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-eda81fc7-aaf3-4935-8e1d-014de3ce0726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:19.988721 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda81fc7-aaf3-4935-8e1d-014de3ce0726 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:19.998823 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920833b-b950-4f73-ae0d-b01982d8d01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:19.999744 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920833b-b950-4f73-ae0d-b01982d8d01e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:20.000185 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920833b-b950-4f73-ae0d-b01982d8d01e admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:20.000458 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920833b-b950-4f73-ae0d-b01982d8d01e admin admin] PATH_INFO: `/v3/projects/ddb1873b0486469980166145a8c9ec6e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:20.002776 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920833b-b950-4f73-ae0d-b01982d8d01e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddb1873b0486469980166145a8c9ec6e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:20.005812 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920833b-b950-4f73-ae0d-b01982d8d01e admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:20.066577 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-8920833b-b950-4f73-ae0d-b01982d8d01e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddb1873b0486469980166145a8c9ec6e', 'request_id': 'req-8920833b-b950-4f73-ae0d-b01982d8d01e'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:20.075261 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-8920833b-b950-4f73-ae0d-b01982d8d01e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddb1873b0486469980166145a8c9ec6e', 'request_id': 'req-8920833b-b950-4f73-ae0d-b01982d8d01e'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:20.086273 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-8920833b-b950-4f73-ae0d-b01982d8d01e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddb1873b0486469980166145a8c9ec6e', 'request_id': 'req-8920833b-b950-4f73-ae0d-b01982d8d01e'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:20.088896 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:20.101535 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-8920833b-b950-4f73-ae0d-b01982d8d01e admin admin] The token cache is being invalidate because project ddb1873b0486469980166145a8c9ec6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:49:20.101889 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-8920833b-b950-4f73-ae0d-b01982d8d01e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:20.102899 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-8920833b-b950-4f73-ae0d-b01982d8d01e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:20.104854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 881/1766] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:49:19 2022] DELETE /identity/v3/projects/ddb1873b0486469980166145a8c9ec6e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:20.109307 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210797a-8fe5-4384-ae2a-f2386e7e6af0 service neutron] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:20.119930 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210797a-8fe5-4384-ae2a-f2386e7e6af0 service neutron] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:20.197003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82f604-65f5-44d6-92ea-b7013209b5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:20.198145 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82f604-65f5-44d6-92ea-b7013209b5e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:20.198597 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82f604-65f5-44d6-92ea-b7013209b5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:20.198875 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82f604-65f5-44d6-92ea-b7013209b5e6 admin admin] PATH_INFO: `/v3/users/92eb98196d4a4837ad89d39da5999b15` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:20.208364 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82f604-65f5-44d6-92ea-b7013209b5e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92eb98196d4a4837ad89d39da5999b15)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:20.210871 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82f604-65f5-44d6-92ea-b7013209b5e6 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:20.259824 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-4e82f604-65f5-44d6-92ea-b7013209b5e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92eb98196d4a4837ad89d39da5999b15'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:20.271416 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-4e82f604-65f5-44d6-92ea-b7013209b5e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92eb98196d4a4837ad89d39da5999b15'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:20.278138 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-4e82f604-65f5-44d6-92ea-b7013209b5e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92eb98196d4a4837ad89d39da5999b15'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:20.278789 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-4e82f604-65f5-44d6-92ea-b7013209b5e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92eb98196d4a4837ad89d39da5999b15'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:20.279392 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-4e82f604-65f5-44d6-92ea-b7013209b5e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92eb98196d4a4837ad89d39da5999b15'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:20.292567 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 886/1767] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:49:20 2022] DELETE /identity/v3/users/92eb98196d4a4837ad89d39da5999b15 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:20.588684 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920833b-b950-4f73-ae0d-b01982d8d01e admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:20.590222 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-8920833b-b950-4f73-ae0d-b01982d8d01e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:20.603456 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920833b-b950-4f73-ae0d-b01982d8d01e admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:20.665881 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8908d6e-7cb8-43ed-830d-58e175010172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:20.667121 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8908d6e-7cb8-43ed-830d-58e175010172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:20.667406 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8908d6e-7cb8-43ed-830d-58e175010172 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:20.667681 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8908d6e-7cb8-43ed-830d-58e175010172 admin admin] PATH_INFO: `/v3/projects/d794fa340fa549a79422b80c01b10133` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:20.668864 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8908d6e-7cb8-43ed-830d-58e175010172 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d794fa340fa549a79422b80c01b10133)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:20.670840 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8908d6e-7cb8-43ed-830d-58e175010172 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:20.723239 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-e8908d6e-7cb8-43ed-830d-58e175010172 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd794fa340fa549a79422b80c01b10133', 'request_id': 'req-e8908d6e-7cb8-43ed-830d-58e175010172'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:20.733125 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-e8908d6e-7cb8-43ed-830d-58e175010172 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd794fa340fa549a79422b80c01b10133', 'request_id': 'req-e8908d6e-7cb8-43ed-830d-58e175010172'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:20.744190 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-e8908d6e-7cb8-43ed-830d-58e175010172 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd794fa340fa549a79422b80c01b10133', 'request_id': 'req-e8908d6e-7cb8-43ed-830d-58e175010172'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:20.756631 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-e8908d6e-7cb8-43ed-830d-58e175010172 admin admin] The token cache is being invalidate because project d794fa340fa549a79422b80c01b10133 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:49:20.756918 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-e8908d6e-7cb8-43ed-830d-58e175010172 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:20.757573 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-e8908d6e-7cb8-43ed-830d-58e175010172 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:20.759223 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 882/1768] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:49:20 2022] DELETE /identity/v3/projects/d794fa340fa549a79422b80c01b10133 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:20.766945 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d4021-270c-4f05-9e85-23dd033eae7c None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:20.766945 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d4021-270c-4f05-9e85-23dd033eae7c None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:20.766945 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d4021-270c-4f05-9e85-23dd033eae7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:20.786078 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-eb6d4021-270c-4f05-9e85-23dd033eae7c None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:20.787372 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-eb6d4021-270c-4f05-9e85-23dd033eae7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:20.842440 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:20.876347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 887/1769] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:20.884079 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ddb13-cf23-48d4-885b-0ca794763e39 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:20.884369 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ddb13-cf23-48d4-885b-0ca794763e39 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:20.884692 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ddb13-cf23-48d4-885b-0ca794763e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:20.918954 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-421ddb13-cf23-48d4-885b-0ca794763e39 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:20.920527 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-421ddb13-cf23-48d4-885b-0ca794763e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:20.940013 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 883/1770] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:20.944362 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d4021-270c-4f05-9e85-23dd033eae7c None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:20.967571 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d4021-270c-4f05-9e85-23dd033eae7c None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:20.994286 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540753e-8d2c-4c3e-9f08-d93c181c9fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:20.994974 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540753e-8d2c-4c3e-9f08-d93c181c9fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:20.995375 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540753e-8d2c-4c3e-9f08-d93c181c9fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:20.995669 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540753e-8d2c-4c3e-9f08-d93c181c9fa0 admin admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:20.996579 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3540753e-8d2c-4c3e-9f08-d93c181c9fa0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:49:20.996883 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3540753e-8d2c-4c3e-9f08-d93c181c9fa0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:20.998582 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3540753e-8d2c-4c3e-9f08-d93c181c9fa0 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:21.044197 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 888/1771] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:49:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:49:21.045681 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ddb13-cf23-48d4-885b-0ca794763e39 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:21.063149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ddb13-cf23-48d4-885b-0ca794763e39 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:21.080063 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce665fc-518b-4758-b83c-6a887c260992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:21.080756 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce665fc-518b-4758-b83c-6a887c260992 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:21.081036 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce665fc-518b-4758-b83c-6a887c260992 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:21.081406 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce665fc-518b-4758-b83c-6a887c260992 admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:21.082060 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce665fc-518b-4758-b83c-6a887c260992 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:21.092008 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce665fc-518b-4758-b83c-6a887c260992 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:21.173914 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 884/1772] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:49:21 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:49:21.179789 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540753e-8d2c-4c3e-9f08-d93c181c9fa0 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:21.202682 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540753e-8d2c-4c3e-9f08-d93c181c9fa0 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:21.377762 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed0585-7982-4aa2-8ccb-0dddb421111f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:21.380526 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed0585-7982-4aa2-8ccb-0dddb421111f admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:21.381220 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed0585-7982-4aa2-8ccb-0dddb421111f admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:21.381660 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed0585-7982-4aa2-8ccb-0dddb421111f admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:21.382536 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed0585-7982-4aa2-8ccb-0dddb421111f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:21.384653 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed0585-7982-4aa2-8ccb-0dddb421111f admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:21.431946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 889/1773] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:49:21 2022] POST /identity/v3/users => generated 290 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:49:21.436215 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce665fc-518b-4758-b83c-6a887c260992 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:21.455545 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce665fc-518b-4758-b83c-6a887c260992 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:21.468291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1da064-59cc-4cd7-980d-3199f145b43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:21.469276 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1da064-59cc-4cd7-980d-3199f145b43b admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:21.469746 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1da064-59cc-4cd7-980d-3199f145b43b admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:21.470242 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1da064-59cc-4cd7-980d-3199f145b43b admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:21.471143 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1da064-59cc-4cd7-980d-3199f145b43b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:21.476415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1da064-59cc-4cd7-980d-3199f145b43b admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:21.513872 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 885/1774] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:49:21.518881 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed0585-7982-4aa2-8ccb-0dddb421111f admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:21.542141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed0585-7982-4aa2-8ccb-0dddb421111f admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:21.551413 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d95ba-3f2e-4189-bb26-5c06066d2b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:21.553929 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d95ba-3f2e-4189-bb26-5c06066d2b98 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:21.554366 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d95ba-3f2e-4189-bb26-5c06066d2b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:21.556027 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d95ba-3f2e-4189-bb26-5c06066d2b98 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:21.558279 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d95ba-3f2e-4189-bb26-5c06066d2b98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:21.569699 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d95ba-3f2e-4189-bb26-5c06066d2b98 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:21.599116 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 890/1775] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:49:21.613939 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1da064-59cc-4cd7-980d-3199f145b43b admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:21.647427 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1da064-59cc-4cd7-980d-3199f145b43b admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:21.670727 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231af50-9404-4017-8214-a99013514f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:21.671736 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231af50-9404-4017-8214-a99013514f73 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:21.672022 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231af50-9404-4017-8214-a99013514f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:21.672300 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231af50-9404-4017-8214-a99013514f73 admin admin] PATH_INFO: `/v3/projects/a79c6c58f05c43b6aeb6e3000016eb74/users/51ff775790e141709263df2d3dd6d071/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:21.757328 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231af50-9404-4017-8214-a99013514f73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a79c6c58f05c43b6aeb6e3000016eb74, user_id=51ff775790e141709263df2d3dd6d071, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:21.760660 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231af50-9404-4017-8214-a99013514f73 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:21.782105 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 886/1776] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:49:21 2022] PUT /identity/v3/projects/a79c6c58f05c43b6aeb6e3000016eb74/users/51ff775790e141709263df2d3dd6d071/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:21.793696 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1f30e-12ee-404e-9ab9-2c02bfe748ca None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:21.794022 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1f30e-12ee-404e-9ab9-2c02bfe748ca None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:21.794304 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1f30e-12ee-404e-9ab9-2c02bfe748ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:21.838598 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-72f1f30e-12ee-404e-9ab9-2c02bfe748ca None None] MFA Rules not processed for user `51ff775790e141709263df2d3dd6d071`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:21.840154 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-72f1f30e-12ee-404e-9ab9-2c02bfe748ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:21.938909 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 891/1777] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:21.941122 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231af50-9404-4017-8214-a99013514f73 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:21.968904 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:22.066981 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231af50-9404-4017-8214-a99013514f73 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:22.073963 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae661366-a5f6-4249-a30f-f4e2e4f25114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:22.075985 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae661366-a5f6-4249-a30f-f4e2e4f25114 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:22.076271 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae661366-a5f6-4249-a30f-f4e2e4f25114 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:22.076540 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae661366-a5f6-4249-a30f-f4e2e4f25114 admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:22.077705 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae661366-a5f6-4249-a30f-f4e2e4f25114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:22.080271 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae661366-a5f6-4249-a30f-f4e2e4f25114 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:22.117333 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 887/1778] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:49:21 2022] POST /identity/v3/projects => generated 379 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:49:22.120381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1f30e-12ee-404e-9ab9-2c02bfe748ca None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:22.161312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1f30e-12ee-404e-9ab9-2c02bfe748ca None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:22.231170 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:22.253008 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1328a5-b24c-40fc-8810-e8c7697dba11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:22.253616 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1328a5-b24c-40fc-8810-e8c7697dba11 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:22.253920 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1328a5-b24c-40fc-8810-e8c7697dba11 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:22.254199 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1328a5-b24c-40fc-8810-e8c7697dba11 admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:22.254871 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1328a5-b24c-40fc-8810-e8c7697dba11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:22.256804 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1328a5-b24c-40fc-8810-e8c7697dba11 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:22.280251 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 892/1779] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:49:22 2022] POST /identity/v3/users => generated 296 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:49:22.281741 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae661366-a5f6-4249-a30f-f4e2e4f25114 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:22.293477 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae661366-a5f6-4249-a30f-f4e2e4f25114 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:22.298588 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f022d1d-a15a-428d-b10a-d42664afa4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:22.299228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f022d1d-a15a-428d-b10a-d42664afa4e2 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:22.299502 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f022d1d-a15a-428d-b10a-d42664afa4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:22.299897 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f022d1d-a15a-428d-b10a-d42664afa4e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:22.300626 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f022d1d-a15a-428d-b10a-d42664afa4e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:22.302346 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f022d1d-a15a-428d-b10a-d42664afa4e2 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:22.313872 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 888/1780] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:49:22.318149 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1328a5-b24c-40fc-8810-e8c7697dba11 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:22.329709 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1328a5-b24c-40fc-8810-e8c7697dba11 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:22.340375 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486b0a8-2c99-4a85-95e7-f2df174bdda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:22.341300 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486b0a8-2c99-4a85-95e7-f2df174bdda1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:22.341729 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486b0a8-2c99-4a85-95e7-f2df174bdda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:22.342031 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486b0a8-2c99-4a85-95e7-f2df174bdda1 admin admin] PATH_INFO: `/v3/projects/543d24d9da074e79a65c0b9e8d39bbb6/users/04e3949d9d864749b1fb70c28e8ed651/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:22.364569 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486b0a8-2c99-4a85-95e7-f2df174bdda1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=543d24d9da074e79a65c0b9e8d39bbb6, user_id=04e3949d9d864749b1fb70c28e8ed651, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:22.367546 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486b0a8-2c99-4a85-95e7-f2df174bdda1 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:22.381630 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 893/1781] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:49:22 2022] PUT /identity/v3/projects/543d24d9da074e79a65c0b9e8d39bbb6/users/04e3949d9d864749b1fb70c28e8ed651/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:49:22.385665 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f022d1d-a15a-428d-b10a-d42664afa4e2 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:22.401162 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f022d1d-a15a-428d-b10a-d42664afa4e2 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:22.468719 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ddf343-2638-41fd-a957-cec06a3d0218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:22.469471 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddf343-2638-41fd-a957-cec06a3d0218 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:22.469754 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddf343-2638-41fd-a957-cec06a3d0218 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:22.470109 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddf343-2638-41fd-a957-cec06a3d0218 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:22.470954 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ddf343-2638-41fd-a957-cec06a3d0218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:22.472849 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ddf343-2638-41fd-a957-cec06a3d0218 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:22.493803 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 889/1782] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:49:22.495014 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486b0a8-2c99-4a85-95e7-f2df174bdda1 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:22.507995 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486b0a8-2c99-4a85-95e7-f2df174bdda1 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:22.513277 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd3fc2-b8c8-4732-b02e-667a7d226ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:22.514212 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd3fc2-b8c8-4732-b02e-667a7d226ca6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:22.514643 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd3fc2-b8c8-4732-b02e-667a7d226ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:22.514928 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd3fc2-b8c8-4732-b02e-667a7d226ca6 admin admin] PATH_INFO: `/v3/projects/543d24d9da074e79a65c0b9e8d39bbb6/users/04e3949d9d864749b1fb70c28e8ed651/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:22.516999 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd3fc2-b8c8-4732-b02e-667a7d226ca6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=543d24d9da074e79a65c0b9e8d39bbb6, user_id=04e3949d9d864749b1fb70c28e8ed651, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:22.519835 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd3fc2-b8c8-4732-b02e-667a7d226ca6 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:22.534263 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 894/1783] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:49:22 2022] PUT /identity/v3/projects/543d24d9da074e79a65c0b9e8d39bbb6/users/04e3949d9d864749b1fb70c28e8ed651/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:22.544638 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0d306-ce4d-4e92-b61f-e2e99784b8c2 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:22.545079 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0d306-ce4d-4e92-b61f-e2e99784b8c2 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:22.545451 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0d306-ce4d-4e92-b61f-e2e99784b8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:22.584182 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-0aa0d306-ce4d-4e92-b61f-e2e99784b8c2 None None] MFA Rules not processed for user `04e3949d9d864749b1fb70c28e8ed651`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:22.585816 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-0aa0d306-ce4d-4e92-b61f-e2e99784b8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:22.678329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 890/1784] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:22 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:49:22.691400 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd3fc2-b8c8-4732-b02e-667a7d226ca6 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:22.693974 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-b0fd3fc2-b8c8-4732-b02e-667a7d226ca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:22.793076 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd3fc2-b8c8-4732-b02e-667a7d226ca6 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:22.796757 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03488847-a8a8-4198-96b8-b774fd8bc92a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:22.797412 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03488847-a8a8-4198-96b8-b774fd8bc92a service cinder] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:22.797693 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03488847-a8a8-4198-96b8-b774fd8bc92a service cinder] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:22.798075 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03488847-a8a8-4198-96b8-b774fd8bc92a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:22.897196 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03488847-a8a8-4198-96b8-b774fd8bc92a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:22.898947 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03488847-a8a8-4198-96b8-b774fd8bc92a service cinder] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:22.910487 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 895/1785] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:49:23.319438 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0d306-ce4d-4e92-b61f-e2e99784b8c2 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:23.321187 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-0aa0d306-ce4d-4e92-b61f-e2e99784b8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:23.356765 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:23.431584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0d306-ce4d-4e92-b61f-e2e99784b8c2 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:23.437225 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6571c1e-11b6-40ab-b3bc-2f37870717e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:23.438701 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6571c1e-11b6-40ab-b3bc-2f37870717e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:23.439199 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6571c1e-11b6-40ab-b3bc-2f37870717e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:23.439396 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6571c1e-11b6-40ab-b3bc-2f37870717e5 admin admin] PATH_INFO: `/v3/users/0c07a13d08ca407eaed6027aae600e9f` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:23.440704 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6571c1e-11b6-40ab-b3bc-2f37870717e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c07a13d08ca407eaed6027aae600e9f)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:23.443039 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6571c1e-11b6-40ab-b3bc-2f37870717e5 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:23.494716 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-b6571c1e-11b6-40ab-b3bc-2f37870717e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c07a13d08ca407eaed6027aae600e9f'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:23.501750 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-b6571c1e-11b6-40ab-b3bc-2f37870717e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c07a13d08ca407eaed6027aae600e9f'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:23.513349 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-b6571c1e-11b6-40ab-b3bc-2f37870717e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c07a13d08ca407eaed6027aae600e9f'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:23.514075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-b6571c1e-11b6-40ab-b3bc-2f37870717e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c07a13d08ca407eaed6027aae600e9f'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:23.514685 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-b6571c1e-11b6-40ab-b3bc-2f37870717e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c07a13d08ca407eaed6027aae600e9f'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:23.528824 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 891/1786] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:49:23 2022] DELETE /identity/v3/users/0c07a13d08ca407eaed6027aae600e9f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:23.533610 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed31fcb-fc03-4c33-9b49-17fc01a1bb40 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:23.534142 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed31fcb-fc03-4c33-9b49-17fc01a1bb40 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:23.534232 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed31fcb-fc03-4c33-9b49-17fc01a1bb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:23.552040 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-2ed31fcb-fc03-4c33-9b49-17fc01a1bb40 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:23.553488 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-2ed31fcb-fc03-4c33-9b49-17fc01a1bb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:23.599601 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:23.616218 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 896/1787] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:23.626956 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6571c1e-11b6-40ab-b3bc-2f37870717e5 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:23.628681 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-b6571c1e-11b6-40ab-b3bc-2f37870717e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:23.690199 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6571c1e-11b6-40ab-b3bc-2f37870717e5 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:23.693952 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868a902-2552-4c96-a41b-efb3a7e016ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:23.694700 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868a902-2552-4c96-a41b-efb3a7e016ab service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:23.695051 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868a902-2552-4c96-a41b-efb3a7e016ab service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:23.695397 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868a902-2552-4c96-a41b-efb3a7e016ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:23.706598 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a868a902-2552-4c96-a41b-efb3a7e016ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:23.708130 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a868a902-2552-4c96-a41b-efb3a7e016ab service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:23.718736 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 892/1788] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:49:24.011862 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed31fcb-fc03-4c33-9b49-17fc01a1bb40 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:24.013760 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-2ed31fcb-fc03-4c33-9b49-17fc01a1bb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:24.034896 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed31fcb-fc03-4c33-9b49-17fc01a1bb40 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:24.058191 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f016694-4952-4e96-a36e-7119694622da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:24.059107 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f016694-4952-4e96-a36e-7119694622da admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:24.059357 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f016694-4952-4e96-a36e-7119694622da admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:24.059631 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f016694-4952-4e96-a36e-7119694622da admin admin] PATH_INFO: `/v3/projects/629fb8d0485f4628b5e78d5079bd75a5` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:24.062208 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f016694-4952-4e96-a36e-7119694622da admin admin] RBAC: Authorizing `identity:delete_project(project_id=629fb8d0485f4628b5e78d5079bd75a5)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:24.064319 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f016694-4952-4e96-a36e-7119694622da admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:24.093676 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868a902-2552-4c96-a41b-efb3a7e016ab service neutron] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:24.094901 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-a868a902-2552-4c96-a41b-efb3a7e016ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:24.108437 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868a902-2552-4c96-a41b-efb3a7e016ab service neutron] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:24.125259 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-3f016694-4952-4e96-a36e-7119694622da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '629fb8d0485f4628b5e78d5079bd75a5', 'request_id': 'req-3f016694-4952-4e96-a36e-7119694622da'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:24.131771 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-3f016694-4952-4e96-a36e-7119694622da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '629fb8d0485f4628b5e78d5079bd75a5', 'request_id': 'req-3f016694-4952-4e96-a36e-7119694622da'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:24.141182 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-3f016694-4952-4e96-a36e-7119694622da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '629fb8d0485f4628b5e78d5079bd75a5', 'request_id': 'req-3f016694-4952-4e96-a36e-7119694622da'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:24.147565 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:24.173817 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-3f016694-4952-4e96-a36e-7119694622da admin admin] The token cache is being invalidate because project 629fb8d0485f4628b5e78d5079bd75a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:49:24.173817 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-3f016694-4952-4e96-a36e-7119694622da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:24.174596 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-3f016694-4952-4e96-a36e-7119694622da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:24.191498 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 897/1789] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:49:24 2022] DELETE /identity/v3/projects/629fb8d0485f4628b5e78d5079bd75a5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:24.191650 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f99a8-958c-481d-a34e-9869439650cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:24.191650 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f99a8-958c-481d-a34e-9869439650cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:24.191650 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f99a8-958c-481d-a34e-9869439650cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:24.191650 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f99a8-958c-481d-a34e-9869439650cd admin admin] PATH_INFO: `/v3/users/fd0de6b6ed4841b3bad01b95f219fba4` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:24.192080 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f99a8-958c-481d-a34e-9869439650cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd0de6b6ed4841b3bad01b95f219fba4)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:24.192951 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f016694-4952-4e96-a36e-7119694622da admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:24.193753 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f99a8-958c-481d-a34e-9869439650cd admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:24.194739 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-3f016694-4952-4e96-a36e-7119694622da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:24.213479 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f016694-4952-4e96-a36e-7119694622da admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:24.218886 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5e3c5-2d50-4c0a-b23f-e1ac71370e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:24.219844 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5e3c5-2d50-4c0a-b23f-e1ac71370e0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:24.220190 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5e3c5-2d50-4c0a-b23f-e1ac71370e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:24.220535 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5e3c5-2d50-4c0a-b23f-e1ac71370e0b admin admin] PATH_INFO: `/v3/users/9b50ef948fd84f6ab5537d78468e2022` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:24.221903 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f5e3c5-2d50-4c0a-b23f-e1ac71370e0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b50ef948fd84f6ab5537d78468e2022)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:24.223950 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f5e3c5-2d50-4c0a-b23f-e1ac71370e0b admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:24.272334 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-855f99a8-958c-481d-a34e-9869439650cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd0de6b6ed4841b3bad01b95f219fba4'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:24.284547 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-855f99a8-958c-481d-a34e-9869439650cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd0de6b6ed4841b3bad01b95f219fba4'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:24.288491 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-46f5e3c5-2d50-4c0a-b23f-e1ac71370e0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b50ef948fd84f6ab5537d78468e2022'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:24.304475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-46f5e3c5-2d50-4c0a-b23f-e1ac71370e0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b50ef948fd84f6ab5537d78468e2022'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:24.318445 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-855f99a8-958c-481d-a34e-9869439650cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd0de6b6ed4841b3bad01b95f219fba4'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:24.320389 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-855f99a8-958c-481d-a34e-9869439650cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd0de6b6ed4841b3bad01b95f219fba4'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:24.321248 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-855f99a8-958c-481d-a34e-9869439650cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd0de6b6ed4841b3bad01b95f219fba4'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:24.328701 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-46f5e3c5-2d50-4c0a-b23f-e1ac71370e0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b50ef948fd84f6ab5537d78468e2022'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:24.329604 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-46f5e3c5-2d50-4c0a-b23f-e1ac71370e0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b50ef948fd84f6ab5537d78468e2022'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:24.331337 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-46f5e3c5-2d50-4c0a-b23f-e1ac71370e0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b50ef948fd84f6ab5537d78468e2022'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:24.356123 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 898/1790] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:49:24 2022] DELETE /identity/v3/users/9b50ef948fd84f6ab5537d78468e2022 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:24.362416 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 893/1791] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:49:24 2022] DELETE /identity/v3/users/fd0de6b6ed4841b3bad01b95f219fba4 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:49:24.371482 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcafd42-9436-4868-b5b0-ce2f73892d04 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:24.372012 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcafd42-9436-4868-b5b0-ce2f73892d04 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:24.372534 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcafd42-9436-4868-b5b0-ce2f73892d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:24.392796 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-fdcafd42-9436-4868-b5b0-ce2f73892d04 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:24.394311 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-fdcafd42-9436-4868-b5b0-ce2f73892d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:24.396165 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e058b-c3cb-4c93-a518-0b09d667c2ca None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:24.396453 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e058b-c3cb-4c93-a518-0b09d667c2ca None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:24.396745 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e058b-c3cb-4c93-a518-0b09d667c2ca None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:24.398962 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 894/1792] 10.222.0.27 () {54 vars in 921 bytes} [Tue Jul 5 20:49:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:49:24.411233 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3a8b8-039b-4ad0-bcf2-dda32fb12d2b None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:24.411814 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3a8b8-039b-4ad0-bcf2-dda32fb12d2b None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:24.412293 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3a8b8-039b-4ad0-bcf2-dda32fb12d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:24.444210 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-88a3a8b8-039b-4ad0-bcf2-dda32fb12d2b None None] MFA Rules not processed for user `814b675b98b844a2a12a39890ee69d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:24.446005 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-88a3a8b8-039b-4ad0-bcf2-dda32fb12d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:24.499172 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:24.543712 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 899/1793] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:24.581721 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcafd42-9436-4868-b5b0-ce2f73892d04 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:24.583362 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-fdcafd42-9436-4868-b5b0-ce2f73892d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:24.665898 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 895/1794] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Jul 5 20:49:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:49:24.667474 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a3a8b8-039b-4ad0-bcf2-dda32fb12d2b None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:24.676257 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-88a3a8b8-039b-4ad0-bcf2-dda32fb12d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:24.742163 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcafd42-9436-4868-b5b0-ce2f73892d04 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:24.758729 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67df8ec-339c-4638-8197-1871f4e79926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:24.759669 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67df8ec-339c-4638-8197-1871f4e79926 service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:24.760787 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67df8ec-339c-4638-8197-1871f4e79926 service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:24.760787 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67df8ec-339c-4638-8197-1871f4e79926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:24.786400 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:24.788823 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67df8ec-339c-4638-8197-1871f4e79926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:24.790782 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67df8ec-339c-4638-8197-1871f4e79926 service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:24.793307 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a3a8b8-039b-4ad0-bcf2-dda32fb12d2b None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:24.799050 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b50791-46d3-478e-b613-a2ad7c2de84a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:24.802293 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b50791-46d3-478e-b613-a2ad7c2de84a service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:24.802696 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b50791-46d3-478e-b613-a2ad7c2de84a service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:24.803490 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b50791-46d3-478e-b613-a2ad7c2de84a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:24.805570 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-c6b50791-46d3-478e-b613-a2ad7c2de84a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:24.819365 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 900/1795] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:49:24.823505 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67df8ec-339c-4638-8197-1871f4e79926 service neutron] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:24.826828 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-c67df8ec-339c-4638-8197-1871f4e79926 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:24.857465 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67df8ec-339c-4638-8197-1871f4e79926 service neutron] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:24.864594 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedccdc3-1ec9-4df7-8be2-bae7efb3a7e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:24.865509 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedccdc3-1ec9-4df7-8be2-bae7efb3a7e0 service nova] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:24.865957 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedccdc3-1ec9-4df7-8be2-bae7efb3a7e0 service nova] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:24.866731 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedccdc3-1ec9-4df7-8be2-bae7efb3a7e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:24.884274 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedccdc3-1ec9-4df7-8be2-bae7efb3a7e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:24.886769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedccdc3-1ec9-4df7-8be2-bae7efb3a7e0 service nova] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:24.899847 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b50791-46d3-478e-b613-a2ad7c2de84a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:24.903502 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b50791-46d3-478e-b613-a2ad7c2de84a service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:24.904410 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 901/1796] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:49:24.924993 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 896/1797] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:24 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:49:25.098697 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedccdc3-1ec9-4df7-8be2-bae7efb3a7e0 service nova] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:25.100763 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-cedccdc3-1ec9-4df7-8be2-bae7efb3a7e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:25.142982 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedccdc3-1ec9-4df7-8be2-bae7efb3a7e0 service nova] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:25.156718 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c19eb-6c3e-4940-a028-099e13517fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:25.158763 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c19eb-6c3e-4940-a028-099e13517fa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:25.160023 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c19eb-6c3e-4940-a028-099e13517fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:25.161742 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c19eb-6c3e-4940-a028-099e13517fa6 admin admin] PATH_INFO: `/v3/projects/a0de56e58d154dbb9e37f19d1a7644ca` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:25.166650 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c19eb-6c3e-4940-a028-099e13517fa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0de56e58d154dbb9e37f19d1a7644ca)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:25.168842 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c19eb-6c3e-4940-a028-099e13517fa6 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:25.264392 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-831c19eb-6c3e-4940-a028-099e13517fa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0de56e58d154dbb9e37f19d1a7644ca', 'request_id': 'req-831c19eb-6c3e-4940-a028-099e13517fa6'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:25.272503 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-831c19eb-6c3e-4940-a028-099e13517fa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0de56e58d154dbb9e37f19d1a7644ca', 'request_id': 'req-831c19eb-6c3e-4940-a028-099e13517fa6'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:25.281481 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-831c19eb-6c3e-4940-a028-099e13517fa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0de56e58d154dbb9e37f19d1a7644ca', 'request_id': 'req-831c19eb-6c3e-4940-a028-099e13517fa6'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:25.294133 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-831c19eb-6c3e-4940-a028-099e13517fa6 admin admin] The token cache is being invalidate because project a0de56e58d154dbb9e37f19d1a7644ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:49:25.294405 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-831c19eb-6c3e-4940-a028-099e13517fa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:25.295065 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-831c19eb-6c3e-4940-a028-099e13517fa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:25.296837 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 902/1798] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:49:25 2022] DELETE /identity/v3/projects/a0de56e58d154dbb9e37f19d1a7644ca => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:25.302440 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fcf99-de89-433c-8fcf-9ad20df100f2 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:25.305889 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fcf99-de89-433c-8fcf-9ad20df100f2 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:25.305889 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fcf99-de89-433c-8fcf-9ad20df100f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:25.323284 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-f34fcf99-de89-433c-8fcf-9ad20df100f2 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:25.325322 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-f34fcf99-de89-433c-8fcf-9ad20df100f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:25.418571 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 897/1799] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:25.422116 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1b98e-27fd-4b9d-afaf-db99bb18fd6f None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:25.423940 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1b98e-27fd-4b9d-afaf-db99bb18fd6f None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:25.424387 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1b98e-27fd-4b9d-afaf-db99bb18fd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:25.451192 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-10e1b98e-27fd-4b9d-afaf-db99bb18fd6f None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:25.452604 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-10e1b98e-27fd-4b9d-afaf-db99bb18fd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:25.462957 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 903/1800] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:25.467300 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34fcf99-de89-433c-8fcf-9ad20df100f2 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:25.481396 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34fcf99-de89-433c-8fcf-9ad20df100f2 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:25.487039 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858cb868-5324-48c2-90db-245fb8d9d1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:25.487784 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858cb868-5324-48c2-90db-245fb8d9d1a2 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:25.488056 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858cb868-5324-48c2-90db-245fb8d9d1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:25.488405 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858cb868-5324-48c2-90db-245fb8d9d1a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:25.489152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858cb868-5324-48c2-90db-245fb8d9d1a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:49:25.489459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858cb868-5324-48c2-90db-245fb8d9d1a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:25.491212 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858cb868-5324-48c2-90db-245fb8d9d1a2 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:25.497023 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1b98e-27fd-4b9d-afaf-db99bb18fd6f None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:25.501968 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-10e1b98e-27fd-4b9d-afaf-db99bb18fd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:25.508295 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 898/1801] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:49:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:49:25.509239 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858cb868-5324-48c2-90db-245fb8d9d1a2 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:25.522916 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1b98e-27fd-4b9d-afaf-db99bb18fd6f None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:25.528315 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a1597-39f8-419b-b40c-e726a3618892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:25.529312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a1597-39f8-419b-b40c-e726a3618892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:25.529571 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a1597-39f8-419b-b40c-e726a3618892 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:25.529925 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a1597-39f8-419b-b40c-e726a3618892 admin admin] PATH_INFO: `/v3/projects/d287d9fdf3f84d099bb00b66c6821ac8` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:25.531272 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a1597-39f8-419b-b40c-e726a3618892 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d287d9fdf3f84d099bb00b66c6821ac8)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:25.532650 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858cb868-5324-48c2-90db-245fb8d9d1a2 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:25.533355 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a1597-39f8-419b-b40c-e726a3618892 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:25.538854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a97f1-8fc0-4748-ac21-387d9d3e4ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:25.539530 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a97f1-8fc0-4748-ac21-387d9d3e4ef2 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:25.540014 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a97f1-8fc0-4748-ac21-387d9d3e4ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:25.540979 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a97f1-8fc0-4748-ac21-387d9d3e4ef2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:25.542315 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a97f1-8fc0-4748-ac21-387d9d3e4ef2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:25.544345 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a97f1-8fc0-4748-ac21-387d9d3e4ef2 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:25.582204 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 899/1802] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:49:25 2022] POST /identity/v3/projects => generated 401 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:49:25.583602 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a97f1-8fc0-4748-ac21-387d9d3e4ef2 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:25.588847 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:25.593291 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-117a1597-39f8-419b-b40c-e726a3618892 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd287d9fdf3f84d099bb00b66c6821ac8', 'request_id': 'req-117a1597-39f8-419b-b40c-e726a3618892'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:25.602849 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-117a1597-39f8-419b-b40c-e726a3618892 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd287d9fdf3f84d099bb00b66c6821ac8', 'request_id': 'req-117a1597-39f8-419b-b40c-e726a3618892'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:25.615428 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-117a1597-39f8-419b-b40c-e726a3618892 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd287d9fdf3f84d099bb00b66c6821ac8', 'request_id': 'req-117a1597-39f8-419b-b40c-e726a3618892'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:25.641395 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-117a1597-39f8-419b-b40c-e726a3618892 admin admin] The token cache is being invalidate because project d287d9fdf3f84d099bb00b66c6821ac8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:49:25.641697 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-117a1597-39f8-419b-b40c-e726a3618892 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:25.646758 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-117a1597-39f8-419b-b40c-e726a3618892 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:25.650765 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 904/1803] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:49:25 2022] DELETE /identity/v3/projects/d287d9fdf3f84d099bb00b66c6821ac8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:25.654267 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a97f1-8fc0-4748-ac21-387d9d3e4ef2 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:25.654407 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a1597-39f8-419b-b40c-e726a3618892 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:25.655775 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-117a1597-39f8-419b-b40c-e726a3618892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:25.665307 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad08060-2f49-47f3-8a3d-04cb5acfb6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:25.666370 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad08060-2f49-47f3-8a3d-04cb5acfb6a2 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:25.666651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad08060-2f49-47f3-8a3d-04cb5acfb6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:25.666914 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad08060-2f49-47f3-8a3d-04cb5acfb6a2 admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:25.667606 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad08060-2f49-47f3-8a3d-04cb5acfb6a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:25.669616 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad08060-2f49-47f3-8a3d-04cb5acfb6a2 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:25.680829 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:25.700141 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 900/1804] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:49:25 2022] POST /identity/v3/users => generated 301 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:49:25.702894 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad08060-2f49-47f3-8a3d-04cb5acfb6a2 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:25.704599 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-aad08060-2f49-47f3-8a3d-04cb5acfb6a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:25.716485 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad08060-2f49-47f3-8a3d-04cb5acfb6a2 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:25.721308 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb05a88-c931-498a-a2af-fda87588edd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:25.722025 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb05a88-c931-498a-a2af-fda87588edd6 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:25.722304 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb05a88-c931-498a-a2af-fda87588edd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:25.722601 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb05a88-c931-498a-a2af-fda87588edd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:25.723450 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb05a88-c931-498a-a2af-fda87588edd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:25.725079 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb05a88-c931-498a-a2af-fda87588edd6 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:25.734534 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a1597-39f8-419b-b40c-e726a3618892 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:25.735732 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 901/1805] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:49:25.739462 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f59ea-b62e-4d51-a6dc-15f5815bd639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:25.739657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb05a88-c931-498a-a2af-fda87588edd6 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:25.740341 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f59ea-b62e-4d51-a6dc-15f5815bd639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:25.740614 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f59ea-b62e-4d51-a6dc-15f5815bd639 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:25.740879 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f59ea-b62e-4d51-a6dc-15f5815bd639 admin admin] PATH_INFO: `/v3/users/06e7072377ec405d943d53b3ee8063cb` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:25.742116 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f59ea-b62e-4d51-a6dc-15f5815bd639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06e7072377ec405d943d53b3ee8063cb)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:25.744053 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f59ea-b62e-4d51-a6dc-15f5815bd639 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:25.750086 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb05a88-c931-498a-a2af-fda87588edd6 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:25.754702 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f5cef-acd3-4394-96bb-581cb137f7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:25.755358 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f5cef-acd3-4394-96bb-581cb137f7f2 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:25.755636 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f5cef-acd3-4394-96bb-581cb137f7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:25.755904 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f5cef-acd3-4394-96bb-581cb137f7f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:25.756740 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f5cef-acd3-4394-96bb-581cb137f7f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:25.758373 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f5cef-acd3-4394-96bb-581cb137f7f2 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:25.769985 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 902/1806] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:49:25.774176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f5cef-acd3-4394-96bb-581cb137f7f2 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:25.784281 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f5cef-acd3-4394-96bb-581cb137f7f2 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:25.789023 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d47ca0-7fb7-4c94-b965-2ccae27262c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:25.789950 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d47ca0-7fb7-4c94-b965-2ccae27262c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:25.790214 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d47ca0-7fb7-4c94-b965-2ccae27262c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:25.790492 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d47ca0-7fb7-4c94-b965-2ccae27262c7 admin admin] PATH_INFO: `/v3/projects/611c0f28e2f44195a7e71ed2816a0322/users/a7c3d416c04945d597b3a9f45d325795/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:25.795630 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-f51f59ea-b62e-4d51-a6dc-15f5815bd639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06e7072377ec405d943d53b3ee8063cb'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:25.808073 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-f51f59ea-b62e-4d51-a6dc-15f5815bd639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06e7072377ec405d943d53b3ee8063cb'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:25.813519 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d47ca0-7fb7-4c94-b965-2ccae27262c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=611c0f28e2f44195a7e71ed2816a0322, user_id=a7c3d416c04945d597b3a9f45d325795, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:25.816280 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d47ca0-7fb7-4c94-b965-2ccae27262c7 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:25.820662 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-f51f59ea-b62e-4d51-a6dc-15f5815bd639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06e7072377ec405d943d53b3ee8063cb'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:25.821456 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-f51f59ea-b62e-4d51-a6dc-15f5815bd639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06e7072377ec405d943d53b3ee8063cb'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:25.822117 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-f51f59ea-b62e-4d51-a6dc-15f5815bd639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06e7072377ec405d943d53b3ee8063cb'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:25.836757 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 903/1807] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:49:25 2022] PUT /identity/v3/projects/611c0f28e2f44195a7e71ed2816a0322/users/a7c3d416c04945d597b3a9f45d325795/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:49:25.840107 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 905/1808] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:49:25 2022] DELETE /identity/v3/users/06e7072377ec405d943d53b3ee8063cb => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:49:25.848262 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa45cf-3e52-496a-b45d-7b77cb649c36 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:25.848558 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa45cf-3e52-496a-b45d-7b77cb649c36 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:25.848972 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa45cf-3e52-496a-b45d-7b77cb649c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:25.877382 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-42fa45cf-3e52-496a-b45d-7b77cb649c36 None None] MFA Rules not processed for user `a7c3d416c04945d597b3a9f45d325795`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:25.878987 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-42fa45cf-3e52-496a-b45d-7b77cb649c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:25.956064 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 904/1809] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:25 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:25.960573 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f59ea-b62e-4d51-a6dc-15f5815bd639 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:25.962058 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-f51f59ea-b62e-4d51-a6dc-15f5815bd639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:26.026167 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:26.031896 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f59ea-b62e-4d51-a6dc-15f5815bd639 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:26.043148 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082364a-0969-4a65-a407-1437eafa0698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:26.043849 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082364a-0969-4a65-a407-1437eafa0698 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:26.044132 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082364a-0969-4a65-a407-1437eafa0698 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:26.044414 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082364a-0969-4a65-a407-1437eafa0698 admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:26.045106 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6082364a-0969-4a65-a407-1437eafa0698 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:26.047232 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6082364a-0969-4a65-a407-1437eafa0698 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:26.081265 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 906/1810] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:49:25 2022] POST /identity/v3/projects => generated 401 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:49:26.082486 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa45cf-3e52-496a-b45d-7b77cb649c36 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:26.116085 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa45cf-3e52-496a-b45d-7b77cb649c36 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:26.180510 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7092a081-7dd0-416d-85f2-9e0b8db61fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:26.181214 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092a081-7dd0-416d-85f2-9e0b8db61fc9 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:26.181493 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092a081-7dd0-416d-85f2-9e0b8db61fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:26.181769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092a081-7dd0-416d-85f2-9e0b8db61fc9 admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:26.182513 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7092a081-7dd0-416d-85f2-9e0b8db61fc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:26.184465 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7092a081-7dd0-416d-85f2-9e0b8db61fc9 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:26.214514 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 905/1811] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:49:26 2022] POST /identity/v3/users => generated 307 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:49:26.220578 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082364a-0969-4a65-a407-1437eafa0698 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:26.231903 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082364a-0969-4a65-a407-1437eafa0698 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:26.236641 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac0a61-fc04-4eaf-9d88-877c9c1c4e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:26.237430 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac0a61-fc04-4eaf-9d88-877c9c1c4e0a admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:26.237718 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac0a61-fc04-4eaf-9d88-877c9c1c4e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:26.238036 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac0a61-fc04-4eaf-9d88-877c9c1c4e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:26.238768 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac0a61-fc04-4eaf-9d88-877c9c1c4e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:26.240371 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac0a61-fc04-4eaf-9d88-877c9c1c4e0a admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:26.257066 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 907/1812] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:49:26.274042 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7092a081-7dd0-416d-85f2-9e0b8db61fc9 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:26.285658 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7092a081-7dd0-416d-85f2-9e0b8db61fc9 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:26.290780 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5a037-2929-4fe0-833d-5841d5c01539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:26.292300 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5a037-2929-4fe0-833d-5841d5c01539 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:26.292572 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5a037-2929-4fe0-833d-5841d5c01539 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:26.292841 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5a037-2929-4fe0-833d-5841d5c01539 admin admin] PATH_INFO: `/v3/projects/f3f38a32bf47443eac88f057c98660d6/users/a49c5f69e6dd478d9550cab34477de08/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:26.312168 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf5a037-2929-4fe0-833d-5841d5c01539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3f38a32bf47443eac88f057c98660d6, user_id=a49c5f69e6dd478d9550cab34477de08, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:26.315470 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf5a037-2929-4fe0-833d-5841d5c01539 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:26.348450 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 906/1813] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:49:26 2022] PUT /identity/v3/projects/f3f38a32bf47443eac88f057c98660d6/users/a49c5f69e6dd478d9550cab34477de08/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:26.352510 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac0a61-fc04-4eaf-9d88-877c9c1c4e0a admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:26.366375 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac0a61-fc04-4eaf-9d88-877c9c1c4e0a admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:26.496384 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9b8fb-2a20-4196-9578-53bc4478b425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:26.497076 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9b8fb-2a20-4196-9578-53bc4478b425 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:26.497365 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9b8fb-2a20-4196-9578-53bc4478b425 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:26.497635 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9b8fb-2a20-4196-9578-53bc4478b425 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:26.498400 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe9b8fb-2a20-4196-9578-53bc4478b425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:26.500092 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe9b8fb-2a20-4196-9578-53bc4478b425 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:26.530815 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 908/1814] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:49:26.532310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5a037-2929-4fe0-833d-5841d5c01539 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:26.538910 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:26.551355 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5a037-2929-4fe0-833d-5841d5c01539 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:26.569487 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879d820-061a-4642-a8b8-d5a75cc244b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:26.571192 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879d820-061a-4642-a8b8-d5a75cc244b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:26.571570 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879d820-061a-4642-a8b8-d5a75cc244b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:26.571867 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879d820-061a-4642-a8b8-d5a75cc244b6 admin admin] PATH_INFO: `/v3/projects/f3f38a32bf47443eac88f057c98660d6/users/a49c5f69e6dd478d9550cab34477de08/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:26.575044 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879d820-061a-4642-a8b8-d5a75cc244b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3f38a32bf47443eac88f057c98660d6, user_id=a49c5f69e6dd478d9550cab34477de08, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:26.580142 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879d820-061a-4642-a8b8-d5a75cc244b6 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:26.580291 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9b8fb-2a20-4196-9578-53bc4478b425 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:26.582256 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-9fe9b8fb-2a20-4196-9578-53bc4478b425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:26.617899 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9b8fb-2a20-4196-9578-53bc4478b425 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:26.651302 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 907/1815] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:49:26 2022] PUT /identity/v3/projects/f3f38a32bf47443eac88f057c98660d6/users/a49c5f69e6dd478d9550cab34477de08/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:26.657176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6583b-b597-49e5-97f8-bb62175a26de None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:26.659072 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6583b-b597-49e5-97f8-bb62175a26de None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:26.659360 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6583b-b597-49e5-97f8-bb62175a26de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:26.706977 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-3da6583b-b597-49e5-97f8-bb62175a26de None None] MFA Rules not processed for user `a49c5f69e6dd478d9550cab34477de08`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:26.708580 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-3da6583b-b597-49e5-97f8-bb62175a26de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:26.764246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ec843-6f1e-4f3d-a331-5219166ffe7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:26.765221 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ec843-6f1e-4f3d-a331-5219166ffe7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:26.766119 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ec843-6f1e-4f3d-a331-5219166ffe7f admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:26.766374 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ec843-6f1e-4f3d-a331-5219166ffe7f admin admin] PATH_INFO: `/v3/projects/88ccb68ecccf4f21a3396f7c0a9e652f` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:26.769873 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ec843-6f1e-4f3d-a331-5219166ffe7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=88ccb68ecccf4f21a3396f7c0a9e652f)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:26.771811 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ec843-6f1e-4f3d-a331-5219166ffe7f admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:26.815785 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 908/1816] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:26 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:26.826748 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6583b-b597-49e5-97f8-bb62175a26de None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:26.829164 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-3da6583b-b597-49e5-97f8-bb62175a26de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:26.842470 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-626ec843-6f1e-4f3d-a331-5219166ffe7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88ccb68ecccf4f21a3396f7c0a9e652f', 'request_id': 'req-626ec843-6f1e-4f3d-a331-5219166ffe7f'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:26.850576 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-626ec843-6f1e-4f3d-a331-5219166ffe7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88ccb68ecccf4f21a3396f7c0a9e652f', 'request_id': 'req-626ec843-6f1e-4f3d-a331-5219166ffe7f'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:26.862806 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-626ec843-6f1e-4f3d-a331-5219166ffe7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88ccb68ecccf4f21a3396f7c0a9e652f', 'request_id': 'req-626ec843-6f1e-4f3d-a331-5219166ffe7f'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:26.864833 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:26.892472 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-626ec843-6f1e-4f3d-a331-5219166ffe7f admin admin] The token cache is being invalidate because project 88ccb68ecccf4f21a3396f7c0a9e652f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:49:26.892943 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-626ec843-6f1e-4f3d-a331-5219166ffe7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:26.893615 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-626ec843-6f1e-4f3d-a331-5219166ffe7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:26.897897 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 909/1817] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:49:26 2022] DELETE /identity/v3/projects/88ccb68ecccf4f21a3396f7c0a9e652f => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:26.900983 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2435775-612c-44a0-8092-43086144ad26 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:26.901488 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2435775-612c-44a0-8092-43086144ad26 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:26.901769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2435775-612c-44a0-8092-43086144ad26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:26.917600 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6583b-b597-49e5-97f8-bb62175a26de None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:26.922640 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-a2435775-612c-44a0-8092-43086144ad26 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:26.923867 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-a2435775-612c-44a0-8092-43086144ad26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:26.979540 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea254c30-99b1-403f-a5d4-268514f1c5aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:26.980200 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea254c30-99b1-403f-a5d4-268514f1c5aa service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:26.980482 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea254c30-99b1-403f-a5d4-268514f1c5aa service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:26.980973 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea254c30-99b1-403f-a5d4-268514f1c5aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:26.983230 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-ea254c30-99b1-403f-a5d4-268514f1c5aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:26.993233 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 910/1818] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:27.001770 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f61ac-c501-4652-8915-f0b0e426be0d None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:27.002409 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f61ac-c501-4652-8915-f0b0e426be0d None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:27.002994 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f61ac-c501-4652-8915-f0b0e426be0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:27.022691 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-8c0f61ac-c501-4652-8915-f0b0e426be0d None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:27.023901 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-8c0f61ac-c501-4652-8915-f0b0e426be0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:27.031882 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 911/1819] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:49:27.033673 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:27.036076 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f61ac-c501-4652-8915-f0b0e426be0d None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:27.046465 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f61ac-c501-4652-8915-f0b0e426be0d None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:27.051048 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac2e43-ec95-4b40-aa31-1442cf34873f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:27.051698 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac2e43-ec95-4b40-aa31-1442cf34873f admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:27.051980 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac2e43-ec95-4b40-aa31-1442cf34873f admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:27.052248 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac2e43-ec95-4b40-aa31-1442cf34873f admin admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:27.053125 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac2e43-ec95-4b40-aa31-1442cf34873f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:49:27.053428 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac2e43-ec95-4b40-aa31-1442cf34873f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:27.054706 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea254c30-99b1-403f-a5d4-268514f1c5aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:27.055060 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac2e43-ec95-4b40-aa31-1442cf34873f admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:27.056251 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea254c30-99b1-403f-a5d4-268514f1c5aa service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:27.068542 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 909/1820] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:26 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:49:27.070456 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 912/1821] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:49:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:49:27.075837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea254c30-99b1-403f-a5d4-268514f1c5aa service cinder] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:27.087695 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea254c30-99b1-403f-a5d4-268514f1c5aa service cinder] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:27.092912 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653f1e6-716e-4770-812d-ff7d17972433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:27.093875 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653f1e6-716e-4770-812d-ff7d17972433 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:27.094162 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653f1e6-716e-4770-812d-ff7d17972433 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:27.094437 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653f1e6-716e-4770-812d-ff7d17972433 admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:27.095150 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653f1e6-716e-4770-812d-ff7d17972433 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:27.097066 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653f1e6-716e-4770-812d-ff7d17972433 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:27.126802 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 910/1822] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:49:27 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:49:27.131463 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac2e43-ec95-4b40-aa31-1442cf34873f admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:27.151269 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac2e43-ec95-4b40-aa31-1442cf34873f admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:27.161333 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653f1e6-716e-4770-812d-ff7d17972433 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:27.163892 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-4653f1e6-716e-4770-812d-ff7d17972433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:27.228162 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e0468-30c7-4bbe-ab2a-4ab37ded36c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:27.229105 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e0468-30c7-4bbe-ab2a-4ab37ded36c7 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:27.229546 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e0468-30c7-4bbe-ab2a-4ab37ded36c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:27.229820 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e0468-30c7-4bbe-ab2a-4ab37ded36c7 admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:27.230171 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653f1e6-716e-4770-812d-ff7d17972433 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:27.230573 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e0468-30c7-4bbe-ab2a-4ab37ded36c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:27.232520 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e0468-30c7-4bbe-ab2a-4ab37ded36c7 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:27.234174 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886abd5-2c5c-4645-837d-295773f73db2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:27.234828 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886abd5-2c5c-4645-837d-295773f73db2 service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:27.235110 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886abd5-2c5c-4645-837d-295773f73db2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:27.235387 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886abd5-2c5c-4645-837d-295773f73db2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:27.237464 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-e886abd5-2c5c-4645-837d-295773f73db2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:27.256428 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 913/1823] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:49:27 2022] POST /identity/v3/users => generated 294 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:49:27.257581 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e0468-30c7-4bbe-ab2a-4ab37ded36c7 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:27.267193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e0468-30c7-4bbe-ab2a-4ab37ded36c7 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:27.271632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875c887-e3d5-4feb-98b3-e22d673f677e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:27.272275 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875c887-e3d5-4feb-98b3-e22d673f677e admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:27.272557 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875c887-e3d5-4feb-98b3-e22d673f677e admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:27.272829 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875c887-e3d5-4feb-98b3-e22d673f677e admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:27.273538 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875c887-e3d5-4feb-98b3-e22d673f677e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:27.275187 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875c887-e3d5-4feb-98b3-e22d673f677e admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:27.287968 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 914/1824] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:49:27.288979 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875c887-e3d5-4feb-98b3-e22d673f677e admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:27.304200 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875c887-e3d5-4feb-98b3-e22d673f677e admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:27.304413 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886abd5-2c5c-4645-837d-295773f73db2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:27.305848 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886abd5-2c5c-4645-837d-295773f73db2 service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:27.317387 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 911/1825] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:27 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:49:27.319038 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c1b45-1258-4cf5-bc19-36f65f1d91fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:27.320091 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c1b45-1258-4cf5-bc19-36f65f1d91fe admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:27.320571 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c1b45-1258-4cf5-bc19-36f65f1d91fe admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:27.321062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c1b45-1258-4cf5-bc19-36f65f1d91fe admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:27.322621 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c1b45-1258-4cf5-bc19-36f65f1d91fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:27.324992 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c1b45-1258-4cf5-bc19-36f65f1d91fe admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:27.342187 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 915/1826] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:49:27.343472 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886abd5-2c5c-4645-837d-295773f73db2 service cinder] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:27.355601 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886abd5-2c5c-4645-837d-295773f73db2 service cinder] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:27.361969 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bbcd64-2e83-4cb1-9180-f743af0b7e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:27.362987 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbcd64-2e83-4cb1-9180-f743af0b7e94 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:27.363332 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbcd64-2e83-4cb1-9180-f743af0b7e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:27.363729 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbcd64-2e83-4cb1-9180-f743af0b7e94 admin admin] PATH_INFO: `/v3/projects/6a6df4ffd523416c882b2062c0c30b2e/users/db0f8af484bc488b8cc37002c903204b/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:27.386721 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bbcd64-2e83-4cb1-9180-f743af0b7e94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a6df4ffd523416c882b2062c0c30b2e, user_id=db0f8af484bc488b8cc37002c903204b, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:27.390380 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bbcd64-2e83-4cb1-9180-f743af0b7e94 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:27.406406 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 912/1827] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:49:27 2022] PUT /identity/v3/projects/6a6df4ffd523416c882b2062c0c30b2e/users/db0f8af484bc488b8cc37002c903204b/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:27.417269 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b1316-161b-4d51-9eb4-7c235c50fc16 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:27.417637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b1316-161b-4d51-9eb4-7c235c50fc16 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:27.418006 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b1316-161b-4d51-9eb4-7c235c50fc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:27.449076 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-799b1316-161b-4d51-9eb4-7c235c50fc16 None None] MFA Rules not processed for user `db0f8af484bc488b8cc37002c903204b`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:27.450396 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-799b1316-161b-4d51-9eb4-7c235c50fc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:27.484932 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:27.522163 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 916/1828] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:49:27.526818 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bbcd64-2e83-4cb1-9180-f743af0b7e94 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:27.588040 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:27.610264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bbcd64-2e83-4cb1-9180-f743af0b7e94 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:27.615691 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73fa632-f30b-4a11-b542-0ce6307eb56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:27.617755 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fa632-f30b-4a11-b542-0ce6307eb56c admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:27.618167 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fa632-f30b-4a11-b542-0ce6307eb56c admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:27.618539 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fa632-f30b-4a11-b542-0ce6307eb56c admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:27.619445 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73fa632-f30b-4a11-b542-0ce6307eb56c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:27.621452 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73fa632-f30b-4a11-b542-0ce6307eb56c admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:27.657741 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 913/1829] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:49:27 2022] POST /identity/v3/projects => generated 387 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:49:27.664130 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b1316-161b-4d51-9eb4-7c235c50fc16 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:27.691402 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b1316-161b-4d51-9eb4-7c235c50fc16 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:27.789858 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d2174f-7b67-48b2-af6e-6ef740a18971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:27.790741 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2174f-7b67-48b2-af6e-6ef740a18971 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:27.791526 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2174f-7b67-48b2-af6e-6ef740a18971 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:27.791902 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2174f-7b67-48b2-af6e-6ef740a18971 admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:27.792659 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d2174f-7b67-48b2-af6e-6ef740a18971 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:27.794807 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d2174f-7b67-48b2-af6e-6ef740a18971 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:27.829740 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 917/1830] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:49:27 2022] POST /identity/v3/users => generated 300 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:49:27.831178 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73fa632-f30b-4a11-b542-0ce6307eb56c admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:27.848126 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73fa632-f30b-4a11-b542-0ce6307eb56c admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:27.860719 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d95b4-7bef-4d6d-bd9c-0cbd400b633c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:27.862383 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d95b4-7bef-4d6d-bd9c-0cbd400b633c admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:27.862987 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d95b4-7bef-4d6d-bd9c-0cbd400b633c admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:27.863438 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d95b4-7bef-4d6d-bd9c-0cbd400b633c admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:27.865584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d95b4-7bef-4d6d-bd9c-0cbd400b633c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:27.867520 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d95b4-7bef-4d6d-bd9c-0cbd400b633c admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:27.916974 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 914/1831] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:49:27.920434 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d2174f-7b67-48b2-af6e-6ef740a18971 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:27.934601 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d2174f-7b67-48b2-af6e-6ef740a18971 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:27.949470 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ec365-7dec-4ec2-b27f-b177de3a3a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:27.958214 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ec365-7dec-4ec2-b27f-b177de3a3a51 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:27.960165 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ec365-7dec-4ec2-b27f-b177de3a3a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:27.962487 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ec365-7dec-4ec2-b27f-b177de3a3a51 admin admin] PATH_INFO: `/v3/projects/df1010c280254b79a4b3711bbced1a33/users/6d0805fa21b942e3b711ec828f41c120/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:28.015118 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ec365-7dec-4ec2-b27f-b177de3a3a51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df1010c280254b79a4b3711bbced1a33, user_id=6d0805fa21b942e3b711ec828f41c120, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:28.019582 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ec365-7dec-4ec2-b27f-b177de3a3a51 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:28.045364 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 918/1832] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:49:27 2022] PUT /identity/v3/projects/df1010c280254b79a4b3711bbced1a33/users/6d0805fa21b942e3b711ec828f41c120/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:28.049271 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d95b4-7bef-4d6d-bd9c-0cbd400b633c admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:28.071533 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d95b4-7bef-4d6d-bd9c-0cbd400b633c admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:28.182044 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d56add-b66c-4cfa-a2f9-3b838b107678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:28.183193 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d56add-b66c-4cfa-a2f9-3b838b107678 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:28.183193 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d56add-b66c-4cfa-a2f9-3b838b107678 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:28.183381 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d56add-b66c-4cfa-a2f9-3b838b107678 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:28.184015 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d56add-b66c-4cfa-a2f9-3b838b107678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:28.185901 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d56add-b66c-4cfa-a2f9-3b838b107678 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:28.199660 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 915/1833] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:49:28.203872 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ec365-7dec-4ec2-b27f-b177de3a3a51 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:28.214495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ec365-7dec-4ec2-b27f-b177de3a3a51 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:28.220526 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c86994-a3a0-48e3-be20-65b216fe6c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:28.221517 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c86994-a3a0-48e3-be20-65b216fe6c90 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:28.221800 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c86994-a3a0-48e3-be20-65b216fe6c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:28.222122 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c86994-a3a0-48e3-be20-65b216fe6c90 admin admin] PATH_INFO: `/v3/projects/df1010c280254b79a4b3711bbced1a33/users/6d0805fa21b942e3b711ec828f41c120/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:28.224844 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c86994-a3a0-48e3-be20-65b216fe6c90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df1010c280254b79a4b3711bbced1a33, user_id=6d0805fa21b942e3b711ec828f41c120, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:28.227521 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c86994-a3a0-48e3-be20-65b216fe6c90 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:28.245892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 919/1834] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:49:28 2022] PUT /identity/v3/projects/df1010c280254b79a4b3711bbced1a33/users/6d0805fa21b942e3b711ec828f41c120/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:49:28.256133 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ea985-d831-47bb-a60b-88c42127cb35 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:28.256923 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ea985-d831-47bb-a60b-88c42127cb35 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:28.257691 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ea985-d831-47bb-a60b-88c42127cb35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:28.302983 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-8e4ea985-d831-47bb-a60b-88c42127cb35 None None] MFA Rules not processed for user `6d0805fa21b942e3b711ec828f41c120`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:28.304198 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-8e4ea985-d831-47bb-a60b-88c42127cb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:28.380595 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 916/1835] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:28.394143 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c86994-a3a0-48e3-be20-65b216fe6c90 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:28.397540 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-42c86994-a3a0-48e3-be20-65b216fe6c90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:28.459813 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c86994-a3a0-48e3-be20-65b216fe6c90 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:28.463349 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b08a8e-1892-413b-81e2-7aa64bb39186 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:28.464016 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b08a8e-1892-413b-81e2-7aa64bb39186 service cinder] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:28.464293 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b08a8e-1892-413b-81e2-7aa64bb39186 service cinder] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:28.464563 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b08a8e-1892-413b-81e2-7aa64bb39186 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:28.473867 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b08a8e-1892-413b-81e2-7aa64bb39186 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:28.475297 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b08a8e-1892-413b-81e2-7aa64bb39186 service cinder] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:28.485675 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 920/1836] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:49:28.554876 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ea985-d831-47bb-a60b-88c42127cb35 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:28.602112 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:28.620055 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ea985-d831-47bb-a60b-88c42127cb35 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:28.624703 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32607d-4e93-4734-98c1-789f530c1519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:28.625574 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32607d-4e93-4734-98c1-789f530c1519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:28.625869 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32607d-4e93-4734-98c1-789f530c1519 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:28.626151 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32607d-4e93-4734-98c1-789f530c1519 admin admin] PATH_INFO: `/v3/users/db0f8af484bc488b8cc37002c903204b` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:28.627359 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a32607d-4e93-4734-98c1-789f530c1519 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db0f8af484bc488b8cc37002c903204b)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:28.629401 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a32607d-4e93-4734-98c1-789f530c1519 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:28.679101 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-7a32607d-4e93-4734-98c1-789f530c1519 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db0f8af484bc488b8cc37002c903204b'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:28.687251 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-7a32607d-4e93-4734-98c1-789f530c1519 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db0f8af484bc488b8cc37002c903204b'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:28.700038 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-7a32607d-4e93-4734-98c1-789f530c1519 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db0f8af484bc488b8cc37002c903204b'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:28.700804 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-7a32607d-4e93-4734-98c1-789f530c1519 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db0f8af484bc488b8cc37002c903204b'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:28.701530 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-7a32607d-4e93-4734-98c1-789f530c1519 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db0f8af484bc488b8cc37002c903204b'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:28.715353 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 917/1837] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:49:28 2022] DELETE /identity/v3/users/db0f8af484bc488b8cc37002c903204b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:28.720200 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02744503-127d-46fe-8f76-c6dbc161b339 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:28.720723 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02744503-127d-46fe-8f76-c6dbc161b339 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:28.720880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02744503-127d-46fe-8f76-c6dbc161b339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:28.738793 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-02744503-127d-46fe-8f76-c6dbc161b339 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:28.739979 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-02744503-127d-46fe-8f76-c6dbc161b339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:28.760565 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:28.801034 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 921/1838] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:28.811029 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32607d-4e93-4734-98c1-789f530c1519 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:28.812539 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-7a32607d-4e93-4734-98c1-789f530c1519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:28.879946 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32607d-4e93-4734-98c1-789f530c1519 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:28.884343 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0203d-af89-4099-8a02-a3a1f0e38e6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:28.885031 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0203d-af89-4099-8a02-a3a1f0e38e6c service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:28.885315 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0203d-af89-4099-8a02-a3a1f0e38e6c service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:28.885633 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0203d-af89-4099-8a02-a3a1f0e38e6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:28.899292 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0203d-af89-4099-8a02-a3a1f0e38e6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:28.900799 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0203d-af89-4099-8a02-a3a1f0e38e6c service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:28.911577 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 918/1839] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:49:29.144966 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02744503-127d-46fe-8f76-c6dbc161b339 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:29.149240 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-02744503-127d-46fe-8f76-c6dbc161b339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:29.161195 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02744503-127d-46fe-8f76-c6dbc161b339 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:29.166363 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e688be4-3158-4061-bcdc-6276204526d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:29.167243 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e688be4-3158-4061-bcdc-6276204526d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:29.167517 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e688be4-3158-4061-bcdc-6276204526d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:29.167782 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e688be4-3158-4061-bcdc-6276204526d8 admin admin] PATH_INFO: `/v3/users/51ff775790e141709263df2d3dd6d071` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:29.168972 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e688be4-3158-4061-bcdc-6276204526d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51ff775790e141709263df2d3dd6d071)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:29.170930 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e688be4-3158-4061-bcdc-6276204526d8 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:29.228116 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-0e688be4-3158-4061-bcdc-6276204526d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51ff775790e141709263df2d3dd6d071'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:29.245182 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-0e688be4-3158-4061-bcdc-6276204526d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51ff775790e141709263df2d3dd6d071'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:29.252813 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-0e688be4-3158-4061-bcdc-6276204526d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51ff775790e141709263df2d3dd6d071'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:29.253545 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-0e688be4-3158-4061-bcdc-6276204526d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51ff775790e141709263df2d3dd6d071'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:29.254182 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-0e688be4-3158-4061-bcdc-6276204526d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51ff775790e141709263df2d3dd6d071'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:29.277832 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 922/1840] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:49:29 2022] DELETE /identity/v3/users/51ff775790e141709263df2d3dd6d071 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:29.280415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad6325-9879-489e-a10c-dd076352a552 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:29.281515 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad6325-9879-489e-a10c-dd076352a552 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:29.281891 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad6325-9879-489e-a10c-dd076352a552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:29.302945 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-52ad6325-9879-489e-a10c-dd076352a552 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:29.304239 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-52ad6325-9879-489e-a10c-dd076352a552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:29.335661 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e688be4-3158-4061-bcdc-6276204526d8 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:29.337901 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-0e688be4-3158-4061-bcdc-6276204526d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:29.384495 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 919/1841] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:29.393987 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad6325-9879-489e-a10c-dd076352a552 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:29.395376 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-52ad6325-9879-489e-a10c-dd076352a552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:29.404961 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:29.408947 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e688be4-3158-4061-bcdc-6276204526d8 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:29.413903 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29482e-ab5f-4bc5-9b8b-c988be4545e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:29.414895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29482e-ab5f-4bc5-9b8b-c988be4545e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:29.415430 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29482e-ab5f-4bc5-9b8b-c988be4545e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:29.415763 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29482e-ab5f-4bc5-9b8b-c988be4545e5 admin admin] PATH_INFO: `/v3/projects/6a6df4ffd523416c882b2062c0c30b2e` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:29.418682 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba29482e-ab5f-4bc5-9b8b-c988be4545e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a6df4ffd523416c882b2062c0c30b2e)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:29.420878 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba29482e-ab5f-4bc5-9b8b-c988be4545e5 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:29.473769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad6325-9879-489e-a10c-dd076352a552 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:29.478100 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1702ea5-6088-4654-ad39-99a535725995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:29.478698 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1702ea5-6088-4654-ad39-99a535725995 service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:29.478982 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1702ea5-6088-4654-ad39-99a535725995 service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:29.479260 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1702ea5-6088-4654-ad39-99a535725995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:29.484429 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:29.489091 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1702ea5-6088-4654-ad39-99a535725995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:29.490635 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1702ea5-6088-4654-ad39-99a535725995 service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:29.492201 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-ba29482e-ab5f-4bc5-9b8b-c988be4545e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a6df4ffd523416c882b2062c0c30b2e', 'request_id': 'req-ba29482e-ab5f-4bc5-9b8b-c988be4545e5'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:29.500022 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-ba29482e-ab5f-4bc5-9b8b-c988be4545e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a6df4ffd523416c882b2062c0c30b2e', 'request_id': 'req-ba29482e-ab5f-4bc5-9b8b-c988be4545e5'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:29.504577 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 920/1842] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:49:29.507439 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-ba29482e-ab5f-4bc5-9b8b-c988be4545e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a6df4ffd523416c882b2062c0c30b2e', 'request_id': 'req-ba29482e-ab5f-4bc5-9b8b-c988be4545e5'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:29.519093 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-ba29482e-ab5f-4bc5-9b8b-c988be4545e5 admin admin] The token cache is being invalidate because project 6a6df4ffd523416c882b2062c0c30b2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:49:29.519381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-ba29482e-ab5f-4bc5-9b8b-c988be4545e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:29.520034 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-ba29482e-ab5f-4bc5-9b8b-c988be4545e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:29.521627 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 923/1843] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:49:29 2022] DELETE /identity/v3/projects/6a6df4ffd523416c882b2062c0c30b2e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:29.525914 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1702ea5-6088-4654-ad39-99a535725995 service neutron] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:29.536381 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1702ea5-6088-4654-ad39-99a535725995 service neutron] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:29.611192 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88a3de-ac64-40bc-9554-7dcc5417b5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:29.612081 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88a3de-ac64-40bc-9554-7dcc5417b5ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:29.612387 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88a3de-ac64-40bc-9554-7dcc5417b5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:29.612661 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88a3de-ac64-40bc-9554-7dcc5417b5ae admin admin] PATH_INFO: `/v3/users/6d0805fa21b942e3b711ec828f41c120` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:29.613877 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a88a3de-ac64-40bc-9554-7dcc5417b5ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d0805fa21b942e3b711ec828f41c120)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:29.615861 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a88a3de-ac64-40bc-9554-7dcc5417b5ae admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:29.668331 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-0a88a3de-ac64-40bc-9554-7dcc5417b5ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d0805fa21b942e3b711ec828f41c120'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:29.675930 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-0a88a3de-ac64-40bc-9554-7dcc5417b5ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d0805fa21b942e3b711ec828f41c120'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:29.688350 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-0a88a3de-ac64-40bc-9554-7dcc5417b5ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d0805fa21b942e3b711ec828f41c120'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:29.689099 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-0a88a3de-ac64-40bc-9554-7dcc5417b5ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d0805fa21b942e3b711ec828f41c120'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:29.690081 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-0a88a3de-ac64-40bc-9554-7dcc5417b5ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d0805fa21b942e3b711ec828f41c120'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:29.708580 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 921/1844] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:49:29 2022] DELETE /identity/v3/users/6d0805fa21b942e3b711ec828f41c120 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:49:29.879934 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29482e-ab5f-4bc5-9b8b-c988be4545e5 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:29.883482 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-ba29482e-ab5f-4bc5-9b8b-c988be4545e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:29.901814 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29482e-ab5f-4bc5-9b8b-c988be4545e5 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:29.979306 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44e36c-f62b-4b2c-9844-a5e6e0fc3d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:29.980190 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44e36c-f62b-4b2c-9844-a5e6e0fc3d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:29.980469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44e36c-f62b-4b2c-9844-a5e6e0fc3d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:29.980745 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44e36c-f62b-4b2c-9844-a5e6e0fc3d9b admin admin] PATH_INFO: `/v3/projects/a79c6c58f05c43b6aeb6e3000016eb74` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:29.981971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b44e36c-f62b-4b2c-9844-a5e6e0fc3d9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a79c6c58f05c43b6aeb6e3000016eb74)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:29.984119 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b44e36c-f62b-4b2c-9844-a5e6e0fc3d9b admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:30.038649 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-0b44e36c-f62b-4b2c-9844-a5e6e0fc3d9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a79c6c58f05c43b6aeb6e3000016eb74', 'request_id': 'req-0b44e36c-f62b-4b2c-9844-a5e6e0fc3d9b'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:30.049718 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-0b44e36c-f62b-4b2c-9844-a5e6e0fc3d9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a79c6c58f05c43b6aeb6e3000016eb74', 'request_id': 'req-0b44e36c-f62b-4b2c-9844-a5e6e0fc3d9b'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:30.068131 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-0b44e36c-f62b-4b2c-9844-a5e6e0fc3d9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a79c6c58f05c43b6aeb6e3000016eb74', 'request_id': 'req-0b44e36c-f62b-4b2c-9844-a5e6e0fc3d9b'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:30.088123 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-0b44e36c-f62b-4b2c-9844-a5e6e0fc3d9b admin admin] The token cache is being invalidate because project a79c6c58f05c43b6aeb6e3000016eb74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:49:30.088123 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-0b44e36c-f62b-4b2c-9844-a5e6e0fc3d9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:30.088732 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-0b44e36c-f62b-4b2c-9844-a5e6e0fc3d9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:30.090875 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 924/1845] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:49:29 2022] DELETE /identity/v3/projects/a79c6c58f05c43b6aeb6e3000016eb74 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:30.094718 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88a3de-ac64-40bc-9554-7dcc5417b5ae admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:30.096167 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-0a88a3de-ac64-40bc-9554-7dcc5417b5ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:30.112137 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88a3de-ac64-40bc-9554-7dcc5417b5ae admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:30.121724 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44e36c-f62b-4b2c-9844-a5e6e0fc3d9b admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:30.123434 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-0b44e36c-f62b-4b2c-9844-a5e6e0fc3d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:30.163051 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:30.219863 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac16ae-73ec-490d-b37d-bb1231b8e734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:30.220750 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac16ae-73ec-490d-b37d-bb1231b8e734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:30.221027 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac16ae-73ec-490d-b37d-bb1231b8e734 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:30.221295 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac16ae-73ec-490d-b37d-bb1231b8e734 admin admin] PATH_INFO: `/v3/users/04e3949d9d864749b1fb70c28e8ed651` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:30.222533 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac16ae-73ec-490d-b37d-bb1231b8e734 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04e3949d9d864749b1fb70c28e8ed651)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:30.224615 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac16ae-73ec-490d-b37d-bb1231b8e734 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:30.234804 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44e36c-f62b-4b2c-9844-a5e6e0fc3d9b admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:30.239998 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa4239-bf3c-4e99-bd9c-69e5b3878cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:30.240997 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa4239-bf3c-4e99-bd9c-69e5b3878cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:30.241274 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa4239-bf3c-4e99-bd9c-69e5b3878cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:30.241545 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa4239-bf3c-4e99-bd9c-69e5b3878cbb admin admin] PATH_INFO: `/v3/projects/df1010c280254b79a4b3711bbced1a33` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:30.243086 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa4239-bf3c-4e99-bd9c-69e5b3878cbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=df1010c280254b79a4b3711bbced1a33)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:30.245108 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa4239-bf3c-4e99-bd9c-69e5b3878cbb admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:30.247020 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:30.341860 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-47fa4239-bf3c-4e99-bd9c-69e5b3878cbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df1010c280254b79a4b3711bbced1a33', 'request_id': 'req-47fa4239-bf3c-4e99-bd9c-69e5b3878cbb'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:30.350882 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-55ac16ae-73ec-490d-b37d-bb1231b8e734 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04e3949d9d864749b1fb70c28e8ed651'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:30.357528 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-47fa4239-bf3c-4e99-bd9c-69e5b3878cbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df1010c280254b79a4b3711bbced1a33', 'request_id': 'req-47fa4239-bf3c-4e99-bd9c-69e5b3878cbb'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:30.377601 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-47fa4239-bf3c-4e99-bd9c-69e5b3878cbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df1010c280254b79a4b3711bbced1a33', 'request_id': 'req-47fa4239-bf3c-4e99-bd9c-69e5b3878cbb'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:30.388111 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-55ac16ae-73ec-490d-b37d-bb1231b8e734 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04e3949d9d864749b1fb70c28e8ed651'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:30.391311 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-47fa4239-bf3c-4e99-bd9c-69e5b3878cbb admin admin] The token cache is being invalidate because project df1010c280254b79a4b3711bbced1a33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:49:30.391689 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-47fa4239-bf3c-4e99-bd9c-69e5b3878cbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:30.392782 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-47fa4239-bf3c-4e99-bd9c-69e5b3878cbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:30.394844 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 925/1846] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:49:30 2022] DELETE /identity/v3/projects/df1010c280254b79a4b3711bbced1a33 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:30.405575 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bb5ff-d2d8-49ff-be98-870e9e897692 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:30.405894 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bb5ff-d2d8-49ff-be98-870e9e897692 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:30.406259 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bb5ff-d2d8-49ff-be98-870e9e897692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:30.417712 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-55ac16ae-73ec-490d-b37d-bb1231b8e734 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04e3949d9d864749b1fb70c28e8ed651'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:30.418587 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-55ac16ae-73ec-490d-b37d-bb1231b8e734 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04e3949d9d864749b1fb70c28e8ed651'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:30.419831 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-55ac16ae-73ec-490d-b37d-bb1231b8e734 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04e3949d9d864749b1fb70c28e8ed651'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:30.433422 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-269bb5ff-d2d8-49ff-be98-870e9e897692 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:30.434691 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-269bb5ff-d2d8-49ff-be98-870e9e897692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:30.441434 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 922/1847] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:49:30 2022] DELETE /identity/v3/users/04e3949d9d864749b1fb70c28e8ed651 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:30.502535 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 926/1848] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:30.510919 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b982a-f5b5-4fdf-9734-19f9f86475fa None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:30.511169 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b982a-f5b5-4fdf-9734-19f9f86475fa None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:30.511461 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b982a-f5b5-4fdf-9734-19f9f86475fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:30.530539 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-497b982a-f5b5-4fdf-9734-19f9f86475fa None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:30.531745 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-497b982a-f5b5-4fdf-9734-19f9f86475fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:30.599216 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 923/1849] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:30.603412 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269bb5ff-d2d8-49ff-be98-870e9e897692 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:30.616887 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269bb5ff-d2d8-49ff-be98-870e9e897692 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:30.623117 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3606f-e264-444a-a39e-0a724871a368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:30.624492 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3606f-e264-444a-a39e-0a724871a368 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:30.624831 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3606f-e264-444a-a39e-0a724871a368 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:30.625167 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3606f-e264-444a-a39e-0a724871a368 admin admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:30.626050 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b3606f-e264-444a-a39e-0a724871a368 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:49:30.626424 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b3606f-e264-444a-a39e-0a724871a368 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:30.628202 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b3606f-e264-444a-a39e-0a724871a368 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:30.645308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 927/1850] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:49:30.649316 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b982a-f5b5-4fdf-9734-19f9f86475fa None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:30.663169 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b982a-f5b5-4fdf-9734-19f9f86475fa None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:30.669792 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bec33c-f6f3-418d-8fe4-75ed3f242e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:30.670755 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bec33c-f6f3-418d-8fe4-75ed3f242e1d admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:30.671367 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bec33c-f6f3-418d-8fe4-75ed3f242e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:30.671709 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bec33c-f6f3-418d-8fe4-75ed3f242e1d admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:30.672528 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bec33c-f6f3-418d-8fe4-75ed3f242e1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:30.675984 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bec33c-f6f3-418d-8fe4-75ed3f242e1d admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:30.707061 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 924/1851] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:49:30 2022] POST /identity/v3/projects => generated 369 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:49:30.711373 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3606f-e264-444a-a39e-0a724871a368 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:30.724458 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3606f-e264-444a-a39e-0a724871a368 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:30.829110 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac5de9-c3c1-48e5-8cfb-56a0dd94fa47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:30.829930 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac5de9-c3c1-48e5-8cfb-56a0dd94fa47 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:30.830403 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac5de9-c3c1-48e5-8cfb-56a0dd94fa47 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:30.830970 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac5de9-c3c1-48e5-8cfb-56a0dd94fa47 admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:30.831764 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fac5de9-c3c1-48e5-8cfb-56a0dd94fa47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:30.834882 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fac5de9-c3c1-48e5-8cfb-56a0dd94fa47 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:30.859685 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 928/1852] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:49:30 2022] POST /identity/v3/users => generated 285 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:49:30.863551 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bec33c-f6f3-418d-8fe4-75ed3f242e1d admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:30.876677 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bec33c-f6f3-418d-8fe4-75ed3f242e1d admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:30.882842 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e06a57-66df-43f8-8370-02fbe54272cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:30.883365 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e06a57-66df-43f8-8370-02fbe54272cd admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:30.883799 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e06a57-66df-43f8-8370-02fbe54272cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:30.884183 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e06a57-66df-43f8-8370-02fbe54272cd admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:30.885151 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e06a57-66df-43f8-8370-02fbe54272cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:30.886854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e06a57-66df-43f8-8370-02fbe54272cd admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:30.890116 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac5de9-c3c1-48e5-8cfb-56a0dd94fa47 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:30.892121 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-6fac5de9-c3c1-48e5-8cfb-56a0dd94fa47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:30.903672 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 925/1853] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:49:30.904469 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e06a57-66df-43f8-8370-02fbe54272cd admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:30.908091 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac5de9-c3c1-48e5-8cfb-56a0dd94fa47 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:30.922366 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83921de-b262-47e5-851e-d5c5abaf109d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:30.923346 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83921de-b262-47e5-851e-d5c5abaf109d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:30.923715 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83921de-b262-47e5-851e-d5c5abaf109d admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:30.924229 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83921de-b262-47e5-851e-d5c5abaf109d admin admin] PATH_INFO: `/v3/projects/543d24d9da074e79a65c0b9e8d39bbb6` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:30.925724 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83921de-b262-47e5-851e-d5c5abaf109d admin admin] RBAC: Authorizing `identity:delete_project(project_id=543d24d9da074e79a65c0b9e8d39bbb6)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:30.927547 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e06a57-66df-43f8-8370-02fbe54272cd admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:30.928020 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83921de-b262-47e5-851e-d5c5abaf109d admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:30.930141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:30.935649 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5174671-bfe6-4573-ac09-1f933051848f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:30.936896 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5174671-bfe6-4573-ac09-1f933051848f admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:30.937338 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5174671-bfe6-4573-ac09-1f933051848f admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:30.937967 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5174671-bfe6-4573-ac09-1f933051848f admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:30.938857 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5174671-bfe6-4573-ac09-1f933051848f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:30.941703 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5174671-bfe6-4573-ac09-1f933051848f admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:30.958534 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 926/1854] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:49:30.963276 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5174671-bfe6-4573-ac09-1f933051848f admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:30.972074 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:30.977356 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5174671-bfe6-4573-ac09-1f933051848f admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:30.991548 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f6913-e5ad-453b-a021-b9add209896d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:30.993231 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f6913-e5ad-453b-a021-b9add209896d admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:30.993869 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f6913-e5ad-453b-a021-b9add209896d admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:30.996519 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f6913-e5ad-453b-a021-b9add209896d admin admin] PATH_INFO: `/v3/projects/50b7da054278448da90178dddc0a71de/users/f4cebab0e8bc4bbd8d65b0d1e557e60c/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:31.019441 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f6913-e5ad-453b-a021-b9add209896d admin admin] RBAC: Authorizing `identity:create_grant(project_id=50b7da054278448da90178dddc0a71de, user_id=f4cebab0e8bc4bbd8d65b0d1e557e60c, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:31.022160 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f6913-e5ad-453b-a021-b9add209896d admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:31.023768 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c83921de-b262-47e5-851e-d5c5abaf109d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '543d24d9da074e79a65c0b9e8d39bbb6', 'request_id': 'req-c83921de-b262-47e5-851e-d5c5abaf109d'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:31.030440 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c83921de-b262-47e5-851e-d5c5abaf109d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '543d24d9da074e79a65c0b9e8d39bbb6', 'request_id': 'req-c83921de-b262-47e5-851e-d5c5abaf109d'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:31.047558 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c83921de-b262-47e5-851e-d5c5abaf109d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '543d24d9da074e79a65c0b9e8d39bbb6', 'request_id': 'req-c83921de-b262-47e5-851e-d5c5abaf109d'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:31.047803 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 927/1855] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:49:30 2022] PUT /identity/v3/projects/50b7da054278448da90178dddc0a71de/users/f4cebab0e8bc4bbd8d65b0d1e557e60c/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:49:31.049543 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe61760-07db-4b3e-b565-18bc7383be5e None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:31.049809 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe61760-07db-4b3e-b565-18bc7383be5e None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:31.050179 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe61760-07db-4b3e-b565-18bc7383be5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:31.063069 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c83921de-b262-47e5-851e-d5c5abaf109d admin admin] The token cache is being invalidate because project 543d24d9da074e79a65c0b9e8d39bbb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:49:31.063360 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c83921de-b262-47e5-851e-d5c5abaf109d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:31.064096 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c83921de-b262-47e5-851e-d5c5abaf109d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:31.065960 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 929/1856] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:49:30 2022] DELETE /identity/v3/projects/543d24d9da074e79a65c0b9e8d39bbb6 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:49:31.070847 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d3f9b-c217-4269-b528-edc4df51fad2 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:31.071135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d3f9b-c217-4269-b528-edc4df51fad2 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:31.071399 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d3f9b-c217-4269-b528-edc4df51fad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:31.082246 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-9fe61760-07db-4b3e-b565-18bc7383be5e None None] MFA Rules not processed for user `f4cebab0e8bc4bbd8d65b0d1e557e60c`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:31.083917 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-9fe61760-07db-4b3e-b565-18bc7383be5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:31.103669 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-d32d3f9b-c217-4269-b528-edc4df51fad2 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:31.107206 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-d32d3f9b-c217-4269-b528-edc4df51fad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:31.157947 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 928/1857] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:31 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:31.170107 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe61760-07db-4b3e-b565-18bc7383be5e None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:31.171453 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-9fe61760-07db-4b3e-b565-18bc7383be5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:31.186983 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 930/1858] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:31.194426 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578de39f-4234-4be9-a0df-8cddb6417cf8 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:31.194720 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578de39f-4234-4be9-a0df-8cddb6417cf8 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:31.195002 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578de39f-4234-4be9-a0df-8cddb6417cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:31.212824 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-578de39f-4234-4be9-a0df-8cddb6417cf8 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:31.214062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-578de39f-4234-4be9-a0df-8cddb6417cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:31.222500 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 931/1859] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:49:31.226684 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578de39f-4234-4be9-a0df-8cddb6417cf8 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:31.234834 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe61760-07db-4b3e-b565-18bc7383be5e None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:31.235322 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578de39f-4234-4be9-a0df-8cddb6417cf8 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:31.238488 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca282b71-901b-4f21-94b3-a191e829e968 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05f331339d143c09eaa12efe2b80653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:31.239145 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca282b71-901b-4f21-94b3-a191e829e968 service glance] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:31.239424 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca282b71-901b-4f21-94b3-a191e829e968 service glance] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:31.239697 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca282b71-901b-4f21-94b3-a191e829e968 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:31.239815 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80cc51-ef5b-45e0-a66c-ee53d6c8ff98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:31.240478 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80cc51-ef5b-45e0-a66c-ee53d6c8ff98 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:31.240760 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80cc51-ef5b-45e0-a66c-ee53d6c8ff98 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:31.241026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80cc51-ef5b-45e0-a66c-ee53d6c8ff98 admin admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:31.241781 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80cc51-ef5b-45e0-a66c-ee53d6c8ff98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:49:31.242107 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80cc51-ef5b-45e0-a66c-ee53d6c8ff98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:31.243729 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80cc51-ef5b-45e0-a66c-ee53d6c8ff98 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:31.248123 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca282b71-901b-4f21-94b3-a191e829e968 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:31.249929 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca282b71-901b-4f21-94b3-a191e829e968 service glance] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:31.255623 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 932/1860] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:49:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:49:31.259990 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80cc51-ef5b-45e0-a66c-ee53d6c8ff98 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:31.260495 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 929/1861] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:31 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:49:31.270366 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80cc51-ef5b-45e0-a66c-ee53d6c8ff98 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:31.275107 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d5842-a715-454f-803e-5fd631387922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:31.275900 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d5842-a715-454f-803e-5fd631387922 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:31.276281 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d5842-a715-454f-803e-5fd631387922 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:31.276560 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d5842-a715-454f-803e-5fd631387922 admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:31.277280 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d5842-a715-454f-803e-5fd631387922 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:31.279200 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d5842-a715-454f-803e-5fd631387922 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:31.306883 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 933/1862] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:49:31 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:49:31.311045 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca282b71-901b-4f21-94b3-a191e829e968 service glance] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:31.322425 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca282b71-901b-4f21-94b3-a191e829e968 service glance] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:31.388860 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd8626-9b22-47a3-a16e-978de47d279b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:31.389533 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd8626-9b22-47a3-a16e-978de47d279b admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:31.389883 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd8626-9b22-47a3-a16e-978de47d279b admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:31.390163 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd8626-9b22-47a3-a16e-978de47d279b admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:31.390858 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dd8626-9b22-47a3-a16e-978de47d279b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:31.392950 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dd8626-9b22-47a3-a16e-978de47d279b admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:31.423977 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 930/1863] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:49:31 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:49:31.426394 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d5842-a715-454f-803e-5fd631387922 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:31.453864 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d5842-a715-454f-803e-5fd631387922 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:31.460297 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3cbbb-1259-4a15-a1c6-93519aa3caa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:31.460987 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3cbbb-1259-4a15-a1c6-93519aa3caa1 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:31.462183 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3cbbb-1259-4a15-a1c6-93519aa3caa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:31.462495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3cbbb-1259-4a15-a1c6-93519aa3caa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:31.464554 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3cbbb-1259-4a15-a1c6-93519aa3caa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:31.468471 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3cbbb-1259-4a15-a1c6-93519aa3caa1 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:31.483744 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 934/1864] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:49:31.486652 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd8626-9b22-47a3-a16e-978de47d279b admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:31.492288 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:31.502211 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd8626-9b22-47a3-a16e-978de47d279b admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:31.507771 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71aed16-34e4-4d72-9a0c-11e089ce9cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:31.508481 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71aed16-34e4-4d72-9a0c-11e089ce9cef admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:31.509060 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71aed16-34e4-4d72-9a0c-11e089ce9cef admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:31.509166 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71aed16-34e4-4d72-9a0c-11e089ce9cef admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:31.509834 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71aed16-34e4-4d72-9a0c-11e089ce9cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:31.511622 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71aed16-34e4-4d72-9a0c-11e089ce9cef admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:31.543350 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 931/1865] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:49:31.546299 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3cbbb-1259-4a15-a1c6-93519aa3caa1 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:31.564027 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3cbbb-1259-4a15-a1c6-93519aa3caa1 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:31.590434 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d47254-a7ed-430f-b701-ac84c0dc6b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:31.594718 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d47254-a7ed-430f-b701-ac84c0dc6b3a admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:31.595124 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d47254-a7ed-430f-b701-ac84c0dc6b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:31.595600 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d47254-a7ed-430f-b701-ac84c0dc6b3a admin admin] PATH_INFO: `/v3/projects/e78ab54e11484721a28338464b8c7863/users/d474bdce35124adda88f9a558486bfe2/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:31.632275 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d47254-a7ed-430f-b701-ac84c0dc6b3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e78ab54e11484721a28338464b8c7863, user_id=d474bdce35124adda88f9a558486bfe2, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:31.636218 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d47254-a7ed-430f-b701-ac84c0dc6b3a admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:31.665660 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 935/1866] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:49:31 2022] PUT /identity/v3/projects/e78ab54e11484721a28338464b8c7863/users/d474bdce35124adda88f9a558486bfe2/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:31.677914 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e06bd-026a-4683-96a1-4fec8dc84340 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:31.678206 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e06bd-026a-4683-96a1-4fec8dc84340 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:31.678487 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e06bd-026a-4683-96a1-4fec8dc84340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:31.698946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d47254-a7ed-430f-b701-ac84c0dc6b3a admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:31.700857 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-68d47254-a7ed-430f-b701-ac84c0dc6b3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:31.727912 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:31.742261 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-985e06bd-026a-4683-96a1-4fec8dc84340 None None] MFA Rules not processed for user `d474bdce35124adda88f9a558486bfe2`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:31.744218 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-985e06bd-026a-4683-96a1-4fec8dc84340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:31.831812 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d47254-a7ed-430f-b701-ac84c0dc6b3a admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:31.838406 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763432de-9e35-4320-bc2d-9ba32a5d3102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:31.839505 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763432de-9e35-4320-bc2d-9ba32a5d3102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:31.839846 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763432de-9e35-4320-bc2d-9ba32a5d3102 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:31.840185 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763432de-9e35-4320-bc2d-9ba32a5d3102 admin admin] PATH_INFO: `/v3/users/a7c3d416c04945d597b3a9f45d325795` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:31.841701 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763432de-9e35-4320-bc2d-9ba32a5d3102 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7c3d416c04945d597b3a9f45d325795)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:31.843956 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763432de-9e35-4320-bc2d-9ba32a5d3102 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:31.851121 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 932/1867] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:31.855512 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e06bd-026a-4683-96a1-4fec8dc84340 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:31.870010 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e06bd-026a-4683-96a1-4fec8dc84340 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:31.876179 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c77b1-8c13-4cfd-b8ca-e47f816043c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:31.877124 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c77b1-8c13-4cfd-b8ca-e47f816043c3 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:31.877548 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c77b1-8c13-4cfd-b8ca-e47f816043c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:31.878496 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c77b1-8c13-4cfd-b8ca-e47f816043c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:31.879407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c77b1-8c13-4cfd-b8ca-e47f816043c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:31.882617 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c77b1-8c13-4cfd-b8ca-e47f816043c3 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:31.932353 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 933/1868] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:49:31 2022] POST /identity/v3/projects => generated 387 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:49:31.936205 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c77b1-8c13-4cfd-b8ca-e47f816043c3 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:31.951285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-763432de-9e35-4320-bc2d-9ba32a5d3102 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7c3d416c04945d597b3a9f45d325795'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:31.983047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-763432de-9e35-4320-bc2d-9ba32a5d3102 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7c3d416c04945d597b3a9f45d325795'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:31.999263 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-763432de-9e35-4320-bc2d-9ba32a5d3102 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7c3d416c04945d597b3a9f45d325795'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:32.000225 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-763432de-9e35-4320-bc2d-9ba32a5d3102 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7c3d416c04945d597b3a9f45d325795'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:32.001152 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-763432de-9e35-4320-bc2d-9ba32a5d3102 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7c3d416c04945d597b3a9f45d325795'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:32.043798 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 936/1869] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:49:31 2022] DELETE /identity/v3/users/a7c3d416c04945d597b3a9f45d325795 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:49:32.045525 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c56c9-f74f-403c-b928-beae5e5cba93 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:32.045975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c56c9-f74f-403c-b928-beae5e5cba93 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:32.046386 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c56c9-f74f-403c-b928-beae5e5cba93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:32.078182 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-5f5c56c9-f74f-403c-b928-beae5e5cba93 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:32.079613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-5f5c56c9-f74f-403c-b928-beae5e5cba93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:32.088938 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c77b1-8c13-4cfd-b8ca-e47f816043c3 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:32.178607 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 937/1870] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:32.199512 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c56c9-f74f-403c-b928-beae5e5cba93 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:32.201506 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-5f5c56c9-f74f-403c-b928-beae5e5cba93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:32.202609 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf5686-1130-4fb7-95e7-1c84770ed97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:32.203391 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf5686-1130-4fb7-95e7-1c84770ed97d admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:32.203676 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf5686-1130-4fb7-95e7-1c84770ed97d admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:32.203971 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf5686-1130-4fb7-95e7-1c84770ed97d admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:32.205243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf5686-1130-4fb7-95e7-1c84770ed97d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:32.207611 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf5686-1130-4fb7-95e7-1c84770ed97d admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:32.232680 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:32.251558 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 934/1871] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:49:31 2022] POST /identity/v3/users => generated 294 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:49:32.252339 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf5686-1130-4fb7-95e7-1c84770ed97d admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:32.254102 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-64cf5686-1130-4fb7-95e7-1c84770ed97d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:32.269202 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf5686-1130-4fb7-95e7-1c84770ed97d admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:32.279137 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:32.282732 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0157c-c8f8-40bf-b72d-7b80eaa10ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:32.283609 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0157c-c8f8-40bf-b72d-7b80eaa10ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:32.283901 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0157c-c8f8-40bf-b72d-7b80eaa10ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:32.284184 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0157c-c8f8-40bf-b72d-7b80eaa10ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:32.284928 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0157c-c8f8-40bf-b72d-7b80eaa10ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:32.291538 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0157c-c8f8-40bf-b72d-7b80eaa10ae4 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:32.314264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 935/1872] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:49:32.316334 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c56c9-f74f-403c-b928-beae5e5cba93 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:32.318385 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0157c-c8f8-40bf-b72d-7b80eaa10ae4 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:32.326772 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773614a-b6f9-407b-b01d-a331699af62b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:32.327569 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773614a-b6f9-407b-b01d-a331699af62b service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:32.327947 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773614a-b6f9-407b-b01d-a331699af62b service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:32.328307 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773614a-b6f9-407b-b01d-a331699af62b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:32.330318 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0157c-c8f8-40bf-b72d-7b80eaa10ae4 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:32.336336 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984048a-f69f-4810-8301-5e0f38fa1d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:32.337091 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984048a-f69f-4810-8301-5e0f38fa1d08 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:32.337439 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984048a-f69f-4810-8301-5e0f38fa1d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:32.337782 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984048a-f69f-4810-8301-5e0f38fa1d08 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:32.338607 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984048a-f69f-4810-8301-5e0f38fa1d08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:32.339037 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773614a-b6f9-407b-b01d-a331699af62b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:32.340415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984048a-f69f-4810-8301-5e0f38fa1d08 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:32.340871 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773614a-b6f9-407b-b01d-a331699af62b service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:32.352344 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 936/1873] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:49:32.353256 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 938/1874] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:49:32.356148 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773614a-b6f9-407b-b01d-a331699af62b service neutron] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:32.366096 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773614a-b6f9-407b-b01d-a331699af62b service neutron] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:32.370715 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37cc972-1991-4183-ba9e-5ec148893adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:32.371622 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37cc972-1991-4183-ba9e-5ec148893adf admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:32.371894 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37cc972-1991-4183-ba9e-5ec148893adf admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:32.372162 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37cc972-1991-4183-ba9e-5ec148893adf admin admin] PATH_INFO: `/v3/projects/efccc67bc3144f14a4bb9846a7633403/users/fe1c6e1e7a8b40ad8a438655befc99b2/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:32.388627 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37cc972-1991-4183-ba9e-5ec148893adf admin admin] RBAC: Authorizing `identity:create_grant(project_id=efccc67bc3144f14a4bb9846a7633403, user_id=fe1c6e1e7a8b40ad8a438655befc99b2, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:32.391348 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37cc972-1991-4183-ba9e-5ec148893adf admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:32.407328 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 939/1875] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:49:32 2022] PUT /identity/v3/projects/efccc67bc3144f14a4bb9846a7633403/users/fe1c6e1e7a8b40ad8a438655befc99b2/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:32.419778 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfd3f8-3f31-4141-bd65-0745e38f435a None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:32.420068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfd3f8-3f31-4141-bd65-0745e38f435a None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:32.420348 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfd3f8-3f31-4141-bd65-0745e38f435a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:32.450137 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-d3bfd3f8-3f31-4141-bd65-0745e38f435a None None] MFA Rules not processed for user `fe1c6e1e7a8b40ad8a438655befc99b2`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:32.451429 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-d3bfd3f8-3f31-4141-bd65-0745e38f435a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:32.519055 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 937/1876] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:32.523730 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37cc972-1991-4183-ba9e-5ec148893adf admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:32.593494 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37cc972-1991-4183-ba9e-5ec148893adf admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:32.598790 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f7999-d873-4d6c-a044-4a8e651f3142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:32.599476 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f7999-d873-4d6c-a044-4a8e651f3142 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:32.599758 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f7999-d873-4d6c-a044-4a8e651f3142 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:32.600059 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f7999-d873-4d6c-a044-4a8e651f3142 admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:32.600750 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f7999-d873-4d6c-a044-4a8e651f3142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:32.602709 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f7999-d873-4d6c-a044-4a8e651f3142 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:32.634650 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 940/1877] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:49:32 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:49:32.635874 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bfd3f8-3f31-4141-bd65-0745e38f435a None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:32.646786 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bfd3f8-3f31-4141-bd65-0745e38f435a None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:32.679306 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f7999-d873-4d6c-a044-4a8e651f3142 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:32.681089 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-e96f7999-d873-4d6c-a044-4a8e651f3142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:32.727850 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc196e-b6ae-4a13-acbd-66ea0ffd556d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:32.728514 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc196e-b6ae-4a13-acbd-66ea0ffd556d admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:32.728796 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc196e-b6ae-4a13-acbd-66ea0ffd556d admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:32.729073 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc196e-b6ae-4a13-acbd-66ea0ffd556d admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:32.729771 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc196e-b6ae-4a13-acbd-66ea0ffd556d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:32.731773 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc196e-b6ae-4a13-acbd-66ea0ffd556d admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:32.760197 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 938/1878] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:49:32 2022] POST /identity/v3/users => generated 298 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:49:32.761834 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc196e-b6ae-4a13-acbd-66ea0ffd556d admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:32.766867 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f7999-d873-4d6c-a044-4a8e651f3142 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:32.772392 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a07a6-7d93-4094-b8bb-3dfc2ccef82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:32.775091 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a07a6-7d93-4094-b8bb-3dfc2ccef82c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:32.775091 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a07a6-7d93-4094-b8bb-3dfc2ccef82c admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:32.775091 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a07a6-7d93-4094-b8bb-3dfc2ccef82c admin admin] PATH_INFO: `/v3/projects/611c0f28e2f44195a7e71ed2816a0322` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:32.777417 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a07a6-7d93-4094-b8bb-3dfc2ccef82c admin admin] RBAC: Authorizing `identity:delete_project(project_id=611c0f28e2f44195a7e71ed2816a0322)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:32.777524 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a07a6-7d93-4094-b8bb-3dfc2ccef82c admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:32.782072 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc196e-b6ae-4a13-acbd-66ea0ffd556d admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:32.790091 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448e53f-c69a-4b00-bdc6-4d27a6394c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:32.791697 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448e53f-c69a-4b00-bdc6-4d27a6394c7f admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:32.791983 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448e53f-c69a-4b00-bdc6-4d27a6394c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:32.792261 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448e53f-c69a-4b00-bdc6-4d27a6394c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:32.793007 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4448e53f-c69a-4b00-bdc6-4d27a6394c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:32.794666 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4448e53f-c69a-4b00-bdc6-4d27a6394c7f admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:32.805948 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 939/1879] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:49:32.810223 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448e53f-c69a-4b00-bdc6-4d27a6394c7f admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:32.820787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448e53f-c69a-4b00-bdc6-4d27a6394c7f admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:32.827195 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da16f31e-6bce-4b4c-8b26-ffbd246fc417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:32.828239 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16f31e-6bce-4b4c-8b26-ffbd246fc417 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:32.828528 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16f31e-6bce-4b4c-8b26-ffbd246fc417 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:32.828845 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16f31e-6bce-4b4c-8b26-ffbd246fc417 admin admin] PATH_INFO: `/v3/projects/8c113f94f5e64be486226d1867a8e46e/users/0ac6582207a1452e818e0d9748c5948a/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:32.844876 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:32.860494 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-ce2a07a6-7d93-4094-b8bb-3dfc2ccef82c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '611c0f28e2f44195a7e71ed2816a0322', 'request_id': 'req-ce2a07a6-7d93-4094-b8bb-3dfc2ccef82c'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:32.863269 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-ce2a07a6-7d93-4094-b8bb-3dfc2ccef82c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '611c0f28e2f44195a7e71ed2816a0322', 'request_id': 'req-ce2a07a6-7d93-4094-b8bb-3dfc2ccef82c'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:32.872017 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-ce2a07a6-7d93-4094-b8bb-3dfc2ccef82c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '611c0f28e2f44195a7e71ed2816a0322', 'request_id': 'req-ce2a07a6-7d93-4094-b8bb-3dfc2ccef82c'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:32.872855 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da16f31e-6bce-4b4c-8b26-ffbd246fc417 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c113f94f5e64be486226d1867a8e46e, user_id=0ac6582207a1452e818e0d9748c5948a, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:32.877654 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da16f31e-6bce-4b4c-8b26-ffbd246fc417 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:32.884879 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-ce2a07a6-7d93-4094-b8bb-3dfc2ccef82c admin admin] The token cache is being invalidate because project 611c0f28e2f44195a7e71ed2816a0322 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:49:32.885162 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-ce2a07a6-7d93-4094-b8bb-3dfc2ccef82c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:32.885864 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-ce2a07a6-7d93-4094-b8bb-3dfc2ccef82c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:32.887448 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 941/1880] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:49:32 2022] DELETE /identity/v3/projects/611c0f28e2f44195a7e71ed2816a0322 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:49:32.891549 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a07a6-7d93-4094-b8bb-3dfc2ccef82c admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:32.893241 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-ce2a07a6-7d93-4094-b8bb-3dfc2ccef82c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:32.894934 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 940/1881] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:49:32 2022] PUT /identity/v3/projects/8c113f94f5e64be486226d1867a8e46e/users/0ac6582207a1452e818e0d9748c5948a/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:49:32.898700 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da16f31e-6bce-4b4c-8b26-ffbd246fc417 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:32.900243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-da16f31e-6bce-4b4c-8b26-ffbd246fc417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:32.919535 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:32.962764 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a07a6-7d93-4094-b8bb-3dfc2ccef82c admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:33.011047 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da16f31e-6bce-4b4c-8b26-ffbd246fc417 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:33.024761 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42020d8c-ed8a-43d1-ac10-a9b39ae87ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:33.029679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42020d8c-ed8a-43d1-ac10-a9b39ae87ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:33.029679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42020d8c-ed8a-43d1-ac10-a9b39ae87ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:33.029679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42020d8c-ed8a-43d1-ac10-a9b39ae87ea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:33.030031 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42020d8c-ed8a-43d1-ac10-a9b39ae87ea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:33.035676 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42020d8c-ed8a-43d1-ac10-a9b39ae87ea2 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:33.065889 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ffcf88-291b-4afa-85e1-fdaac6e4e684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:33.066837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 941/1882] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:49:33.068382 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffcf88-291b-4afa-85e1-fdaac6e4e684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:33.068819 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffcf88-291b-4afa-85e1-fdaac6e4e684 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:33.070180 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffcf88-291b-4afa-85e1-fdaac6e4e684 admin admin] PATH_INFO: `/v3/users/a49c5f69e6dd478d9550cab34477de08` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:33.071245 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42020d8c-ed8a-43d1-ac10-a9b39ae87ea2 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:33.071983 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ffcf88-291b-4afa-85e1-fdaac6e4e684 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a49c5f69e6dd478d9550cab34477de08)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:33.074393 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ffcf88-291b-4afa-85e1-fdaac6e4e684 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:33.095626 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42020d8c-ed8a-43d1-ac10-a9b39ae87ea2 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:33.108114 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c3ae5-28ca-468a-ae5a-eb592bb6de3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:33.109248 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c3ae5-28ca-468a-ae5a-eb592bb6de3f admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:33.110904 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c3ae5-28ca-468a-ae5a-eb592bb6de3f admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:33.111285 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c3ae5-28ca-468a-ae5a-eb592bb6de3f admin admin] PATH_INFO: `/v3/projects/8c113f94f5e64be486226d1867a8e46e/users/0ac6582207a1452e818e0d9748c5948a/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:33.121410 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c3ae5-28ca-468a-ae5a-eb592bb6de3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c113f94f5e64be486226d1867a8e46e, user_id=0ac6582207a1452e818e0d9748c5948a, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:33.130899 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c3ae5-28ca-468a-ae5a-eb592bb6de3f admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:33.173930 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 942/1883] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:49:33 2022] PUT /identity/v3/projects/8c113f94f5e64be486226d1867a8e46e/users/0ac6582207a1452e818e0d9748c5948a/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:49:33.176645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5e9e7-e0ba-4a3b-9214-30dc066b2bcb None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:33.176853 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5e9e7-e0ba-4a3b-9214-30dc066b2bcb None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:33.177165 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5e9e7-e0ba-4a3b-9214-30dc066b2bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:33.210793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-31e5e9e7-e0ba-4a3b-9214-30dc066b2bcb None None] MFA Rules not processed for user `0ac6582207a1452e818e0d9748c5948a`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:33.212030 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-31e5e9e7-e0ba-4a3b-9214-30dc066b2bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:33.213270 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c4ffcf88-291b-4afa-85e1-fdaac6e4e684 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a49c5f69e6dd478d9550cab34477de08'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:33.227187 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c4ffcf88-291b-4afa-85e1-fdaac6e4e684 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a49c5f69e6dd478d9550cab34477de08'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:33.247726 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c4ffcf88-291b-4afa-85e1-fdaac6e4e684 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a49c5f69e6dd478d9550cab34477de08'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:33.250253 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c4ffcf88-291b-4afa-85e1-fdaac6e4e684 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a49c5f69e6dd478d9550cab34477de08'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:33.251145 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c4ffcf88-291b-4afa-85e1-fdaac6e4e684 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a49c5f69e6dd478d9550cab34477de08'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:33.254670 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:33.281528 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 942/1884] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:49:32 2022] DELETE /identity/v3/users/a49c5f69e6dd478d9550cab34477de08 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:49:33.332019 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 943/1885] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:49:33.348477 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ffcf88-291b-4afa-85e1-fdaac6e4e684 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:33.350066 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-c4ffcf88-291b-4afa-85e1-fdaac6e4e684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:33.432005 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ffcf88-291b-4afa-85e1-fdaac6e4e684 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:33.435699 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7bb48-9fea-4120-9ead-34aaeceb9244 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:33.436352 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7bb48-9fea-4120-9ead-34aaeceb9244 service cinder] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:33.436730 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7bb48-9fea-4120-9ead-34aaeceb9244 service cinder] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:33.437009 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7bb48-9fea-4120-9ead-34aaeceb9244 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:33.521349 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b7bb48-9fea-4120-9ead-34aaeceb9244 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:33.523107 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b7bb48-9fea-4120-9ead-34aaeceb9244 service cinder] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:33.537772 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 943/1886] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:49:33.790591 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5e9e7-e0ba-4a3b-9214-30dc066b2bcb None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:33.792618 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-31e5e9e7-e0ba-4a3b-9214-30dc066b2bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:33.893661 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5e9e7-e0ba-4a3b-9214-30dc066b2bcb None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:33.944900 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:33.988256 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47271be8-2a1e-43d6-8e90-641459847d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:33.989405 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47271be8-2a1e-43d6-8e90-641459847d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:33.990094 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47271be8-2a1e-43d6-8e90-641459847d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:33.990413 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47271be8-2a1e-43d6-8e90-641459847d03 admin admin] PATH_INFO: `/v3/projects/f3f38a32bf47443eac88f057c98660d6` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:33.991750 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47271be8-2a1e-43d6-8e90-641459847d03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3f38a32bf47443eac88f057c98660d6)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:33.994065 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47271be8-2a1e-43d6-8e90-641459847d03 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:34.065179 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-47271be8-2a1e-43d6-8e90-641459847d03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3f38a32bf47443eac88f057c98660d6', 'request_id': 'req-47271be8-2a1e-43d6-8e90-641459847d03'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:34.074082 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-47271be8-2a1e-43d6-8e90-641459847d03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3f38a32bf47443eac88f057c98660d6', 'request_id': 'req-47271be8-2a1e-43d6-8e90-641459847d03'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:34.094714 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-47271be8-2a1e-43d6-8e90-641459847d03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3f38a32bf47443eac88f057c98660d6', 'request_id': 'req-47271be8-2a1e-43d6-8e90-641459847d03'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:34.104998 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-47271be8-2a1e-43d6-8e90-641459847d03 admin admin] The token cache is being invalidate because project f3f38a32bf47443eac88f057c98660d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:49:34.105415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-47271be8-2a1e-43d6-8e90-641459847d03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:34.106357 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-47271be8-2a1e-43d6-8e90-641459847d03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:34.109883 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 944/1887] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:49:33 2022] DELETE /identity/v3/projects/f3f38a32bf47443eac88f057c98660d6 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:49:34.114468 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecadadc-0dce-4fa8-842f-1624dafac70c None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:34.115596 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecadadc-0dce-4fa8-842f-1624dafac70c None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:34.115879 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecadadc-0dce-4fa8-842f-1624dafac70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:34.168519 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-3ecadadc-0dce-4fa8-842f-1624dafac70c None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:34.169541 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-3ecadadc-0dce-4fa8-842f-1624dafac70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:34.273042 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 944/1888] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:49:34.275509 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0a5de-bc9d-4f6a-9f8c-8bf634f2a492 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:34.276595 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0a5de-bc9d-4f6a-9f8c-8bf634f2a492 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:34.277035 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0a5de-bc9d-4f6a-9f8c-8bf634f2a492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:34.302826 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-dcf0a5de-bc9d-4f6a-9f8c-8bf634f2a492 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:34.305508 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-dcf0a5de-bc9d-4f6a-9f8c-8bf634f2a492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:34.330132 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 945/1889] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:34.330945 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecadadc-0dce-4fa8-842f-1624dafac70c None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:34.345493 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecadadc-0dce-4fa8-842f-1624dafac70c None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:34.351401 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f124f2-bd6b-4d55-a612-a8757ea21847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:34.352283 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f124f2-bd6b-4d55-a612-a8757ea21847 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:34.352996 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f124f2-bd6b-4d55-a612-a8757ea21847 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:34.353287 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f124f2-bd6b-4d55-a612-a8757ea21847 admin admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:34.354117 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f124f2-bd6b-4d55-a612-a8757ea21847 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:49:34.354428 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f124f2-bd6b-4d55-a612-a8757ea21847 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:34.354536 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0a5de-bc9d-4f6a-9f8c-8bf634f2a492 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:34.356416 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f124f2-bd6b-4d55-a612-a8757ea21847 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:34.356854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-dcf0a5de-bc9d-4f6a-9f8c-8bf634f2a492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:34.373763 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 945/1890] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:49:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:49:34.379226 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f124f2-bd6b-4d55-a612-a8757ea21847 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:34.391116 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f124f2-bd6b-4d55-a612-a8757ea21847 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:34.396999 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaee552-1730-4d15-b505-ebdededd4cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:34.397766 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaee552-1730-4d15-b505-ebdededd4cf7 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:34.414682 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaee552-1730-4d15-b505-ebdededd4cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:34.415057 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaee552-1730-4d15-b505-ebdededd4cf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:34.416238 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaee552-1730-4d15-b505-ebdededd4cf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:34.418986 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaee552-1730-4d15-b505-ebdededd4cf7 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:34.444919 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0a5de-bc9d-4f6a-9f8c-8bf634f2a492 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:34.450581 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c61907-da2b-443e-810b-60c2e3471cb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:34.451211 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c61907-da2b-443e-810b-60c2e3471cb2 service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:34.451515 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c61907-da2b-443e-810b-60c2e3471cb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:34.452044 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c61907-da2b-443e-810b-60c2e3471cb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:34.454122 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-a1c61907-da2b-443e-810b-60c2e3471cb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:34.471920 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 946/1891] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:49:34 2022] POST /identity/v3/projects => generated 379 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:49:34.473608 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaee552-1730-4d15-b505-ebdededd4cf7 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:34.498055 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:34.552164 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c61907-da2b-443e-810b-60c2e3471cb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:34.553732 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c61907-da2b-443e-810b-60c2e3471cb2 service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:34.563160 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 946/1892] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:49:34.568321 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaee552-1730-4d15-b505-ebdededd4cf7 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:34.573264 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6aeca6-5ec0-4910-a571-22531b46720a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:34.573964 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6aeca6-5ec0-4910-a571-22531b46720a admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:34.574248 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6aeca6-5ec0-4910-a571-22531b46720a admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:34.574518 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6aeca6-5ec0-4910-a571-22531b46720a admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:34.575577 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6aeca6-5ec0-4910-a571-22531b46720a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:34.577580 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6aeca6-5ec0-4910-a571-22531b46720a admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:34.599355 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 947/1893] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:49:34 2022] POST /identity/v3/users => generated 290 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:49:34.603950 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c61907-da2b-443e-810b-60c2e3471cb2 service cinder] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:34.620449 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c61907-da2b-443e-810b-60c2e3471cb2 service cinder] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:34.626318 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958a61a-540f-4362-9db8-5648efaf1012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:34.627029 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958a61a-540f-4362-9db8-5648efaf1012 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:34.627307 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958a61a-540f-4362-9db8-5648efaf1012 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:34.627610 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958a61a-540f-4362-9db8-5648efaf1012 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:34.628720 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958a61a-540f-4362-9db8-5648efaf1012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:34.629981 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958a61a-540f-4362-9db8-5648efaf1012 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:34.639164 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:34.650041 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6aeca6-5ec0-4910-a571-22531b46720a admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:34.656703 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 947/1894] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:49:34.665599 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6aeca6-5ec0-4910-a571-22531b46720a admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:34.672770 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215525c-4664-4a5e-aa14-c3637cb3db5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:34.675255 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215525c-4664-4a5e-aa14-c3637cb3db5c admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:34.675255 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215525c-4664-4a5e-aa14-c3637cb3db5c admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:34.675255 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215525c-4664-4a5e-aa14-c3637cb3db5c admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:34.676383 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215525c-4664-4a5e-aa14-c3637cb3db5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:34.679114 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215525c-4664-4a5e-aa14-c3637cb3db5c admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:34.694028 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 948/1895] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:49:34.695547 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958a61a-540f-4362-9db8-5648efaf1012 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:34.706072 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958a61a-540f-4362-9db8-5648efaf1012 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:34.710948 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df53b8-41b4-4792-a1c7-8be62bae71b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:34.711921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df53b8-41b4-4792-a1c7-8be62bae71b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:34.712119 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df53b8-41b4-4792-a1c7-8be62bae71b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:34.712391 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df53b8-41b4-4792-a1c7-8be62bae71b4 admin admin] PATH_INFO: `/v3/projects/226a65b053cf49e7951c2c4397256272/users/8a80dd67601943f889be2bde7c68b920/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:34.730421 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df53b8-41b4-4792-a1c7-8be62bae71b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=226a65b053cf49e7951c2c4397256272, user_id=8a80dd67601943f889be2bde7c68b920, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:34.732995 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df53b8-41b4-4792-a1c7-8be62bae71b4 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:34.748999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 948/1896] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:49:34 2022] PUT /identity/v3/projects/226a65b053cf49e7951c2c4397256272/users/8a80dd67601943f889be2bde7c68b920/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:49:34.760188 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76994f-2850-40be-8bd2-3d497312f535 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:34.760701 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76994f-2850-40be-8bd2-3d497312f535 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:34.761089 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76994f-2850-40be-8bd2-3d497312f535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:34.790536 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-3e76994f-2850-40be-8bd2-3d497312f535 None None] MFA Rules not processed for user `8a80dd67601943f889be2bde7c68b920`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:34.792067 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-3e76994f-2850-40be-8bd2-3d497312f535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:34.896239 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df53b8-41b4-4792-a1c7-8be62bae71b4 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:34.898655 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 949/1897] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:34.995302 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df53b8-41b4-4792-a1c7-8be62bae71b4 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:35.003917 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9abea3-4d69-4e35-89c0-48b4a4319884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:35.006184 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9abea3-4d69-4e35-89c0-48b4a4319884 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:35.007274 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9abea3-4d69-4e35-89c0-48b4a4319884 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:35.007605 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9abea3-4d69-4e35-89c0-48b4a4319884 admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:35.008389 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9abea3-4d69-4e35-89c0-48b4a4319884 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:35.014213 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9abea3-4d69-4e35-89c0-48b4a4319884 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:35.058668 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 949/1898] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:49:34 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:49:35.062526 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76994f-2850-40be-8bd2-3d497312f535 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:35.073988 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76994f-2850-40be-8bd2-3d497312f535 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:35.148453 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe7d14-ffd2-43e2-a2ea-030b72551a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:35.149145 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe7d14-ffd2-43e2-a2ea-030b72551a6d admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:35.149418 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe7d14-ffd2-43e2-a2ea-030b72551a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:35.149687 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe7d14-ffd2-43e2-a2ea-030b72551a6d admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:35.150434 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe7d14-ffd2-43e2-a2ea-030b72551a6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:35.152370 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe7d14-ffd2-43e2-a2ea-030b72551a6d admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:35.177243 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 950/1899] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:49:35 2022] POST /identity/v3/users => generated 290 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:49:35.181307 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9abea3-4d69-4e35-89c0-48b4a4319884 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:35.193791 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9abea3-4d69-4e35-89c0-48b4a4319884 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:35.199118 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428e8eb-10d5-4696-a795-ce8f0f6c7e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:35.199596 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428e8eb-10d5-4696-a795-ce8f0f6c7e4d admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:35.199958 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428e8eb-10d5-4696-a795-ce8f0f6c7e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:35.200238 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428e8eb-10d5-4696-a795-ce8f0f6c7e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:35.200976 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428e8eb-10d5-4696-a795-ce8f0f6c7e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:35.202846 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0428e8eb-10d5-4696-a795-ce8f0f6c7e4d admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:35.217633 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 950/1900] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:49:35.218919 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe7d14-ffd2-43e2-a2ea-030b72551a6d admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:35.233007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe7d14-ffd2-43e2-a2ea-030b72551a6d admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:35.238492 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270678fe-a5a3-40e1-9869-9fd4018c8bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:35.239175 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270678fe-a5a3-40e1-9869-9fd4018c8bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:35.239501 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270678fe-a5a3-40e1-9869-9fd4018c8bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:35.239777 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270678fe-a5a3-40e1-9869-9fd4018c8bf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:35.240506 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270678fe-a5a3-40e1-9869-9fd4018c8bf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:35.242319 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270678fe-a5a3-40e1-9869-9fd4018c8bf5 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:35.244097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:35.276896 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 951/1901] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:49:35.281714 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428e8eb-10d5-4696-a795-ce8f0f6c7e4d admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:35.294151 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0428e8eb-10d5-4696-a795-ce8f0f6c7e4d admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:35.300028 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b419d-dbae-42e5-a371-3b36b18a7556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:35.301373 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b419d-dbae-42e5-a371-3b36b18a7556 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:35.301745 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b419d-dbae-42e5-a371-3b36b18a7556 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:35.302223 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b419d-dbae-42e5-a371-3b36b18a7556 admin admin] PATH_INFO: `/v3/projects/b5a2db863194415384f1a7e37584ee27/users/cbc70a27369742ffb5ef8451ba4f7cee/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:35.338683 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b419d-dbae-42e5-a371-3b36b18a7556 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5a2db863194415384f1a7e37584ee27, user_id=cbc70a27369742ffb5ef8451ba4f7cee, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:35.343092 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b419d-dbae-42e5-a371-3b36b18a7556 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:35.374122 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 951/1902] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:49:35 2022] PUT /identity/v3/projects/b5a2db863194415384f1a7e37584ee27/users/cbc70a27369742ffb5ef8451ba4f7cee/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:35.385298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d53fc-7a2b-4dda-8059-4b199742f8ae None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:35.385656 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d53fc-7a2b-4dda-8059-4b199742f8ae None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:35.385974 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d53fc-7a2b-4dda-8059-4b199742f8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:35.415653 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-0e4d53fc-7a2b-4dda-8059-4b199742f8ae None None] MFA Rules not processed for user `cbc70a27369742ffb5ef8451ba4f7cee`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:35.417440 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-0e4d53fc-7a2b-4dda-8059-4b199742f8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:35.517876 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 952/1903] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:35.520887 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b419d-dbae-42e5-a371-3b36b18a7556 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:35.625812 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b419d-dbae-42e5-a371-3b36b18a7556 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:35.634667 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04d3d8-37ef-481e-8e0b-4d01a79a7c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:35.635456 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04d3d8-37ef-481e-8e0b-4d01a79a7c8f admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:35.637270 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04d3d8-37ef-481e-8e0b-4d01a79a7c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:35.637454 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04d3d8-37ef-481e-8e0b-4d01a79a7c8f admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:35.638366 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc04d3d8-37ef-481e-8e0b-4d01a79a7c8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:35.640591 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc04d3d8-37ef-481e-8e0b-4d01a79a7c8f admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:35.686165 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 952/1904] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:49:35 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:49:35.687454 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d53fc-7a2b-4dda-8059-4b199742f8ae None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:35.698563 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d53fc-7a2b-4dda-8059-4b199742f8ae None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:35.769041 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3acbc-5530-453d-8c33-bdb2dc3e4594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:35.769627 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3acbc-5530-453d-8c33-bdb2dc3e4594 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:35.769936 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3acbc-5530-453d-8c33-bdb2dc3e4594 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:35.770214 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3acbc-5530-453d-8c33-bdb2dc3e4594 admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:35.770962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3acbc-5530-453d-8c33-bdb2dc3e4594 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:35.772983 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3acbc-5530-453d-8c33-bdb2dc3e4594 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:35.797499 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 953/1905] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:49:35 2022] POST /identity/v3/users => generated 295 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:49:35.801491 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04d3d8-37ef-481e-8e0b-4d01a79a7c8f admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:35.812773 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04d3d8-37ef-481e-8e0b-4d01a79a7c8f admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:35.821136 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d0755-d5fa-4162-80d5-2e95895aabdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:35.823275 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d0755-d5fa-4162-80d5-2e95895aabdf admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:35.823642 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d0755-d5fa-4162-80d5-2e95895aabdf admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:35.824170 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d0755-d5fa-4162-80d5-2e95895aabdf admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:35.825430 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64d0755-d5fa-4162-80d5-2e95895aabdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:35.827610 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64d0755-d5fa-4162-80d5-2e95895aabdf admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:35.835868 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:35.849886 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3acbc-5530-453d-8c33-bdb2dc3e4594 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:35.857802 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 953/1906] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:49:35.870405 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3acbc-5530-453d-8c33-bdb2dc3e4594 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:35.876664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba643084-a05f-4bda-86ea-e668cc143e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:35.878289 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba643084-a05f-4bda-86ea-e668cc143e72 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:35.878658 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba643084-a05f-4bda-86ea-e668cc143e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:35.879167 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba643084-a05f-4bda-86ea-e668cc143e72 admin admin] PATH_INFO: `/v3/projects/dc986e3a24dd4470a98dde18f1cc4bcb/users/6f7e7985409645b4800c7d531cdd66e2/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:35.901376 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba643084-a05f-4bda-86ea-e668cc143e72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc986e3a24dd4470a98dde18f1cc4bcb, user_id=6f7e7985409645b4800c7d531cdd66e2, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:35.905292 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba643084-a05f-4bda-86ea-e668cc143e72 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:35.925800 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 954/1907] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:49:35 2022] PUT /identity/v3/projects/dc986e3a24dd4470a98dde18f1cc4bcb/users/6f7e7985409645b4800c7d531cdd66e2/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:35.929811 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d0755-d5fa-4162-80d5-2e95895aabdf admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:35.954822 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d0755-d5fa-4162-80d5-2e95895aabdf admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:36.067736 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a5794-c685-40bc-96af-1dae9f88aec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:36.069319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a5794-c685-40bc-96af-1dae9f88aec3 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:36.070202 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a5794-c685-40bc-96af-1dae9f88aec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:36.070677 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a5794-c685-40bc-96af-1dae9f88aec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:36.071946 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a5794-c685-40bc-96af-1dae9f88aec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:36.075263 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a5794-c685-40bc-96af-1dae9f88aec3 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:36.089818 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 954/1908] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:49:36.094098 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba643084-a05f-4bda-86ea-e668cc143e72 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:36.109542 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba643084-a05f-4bda-86ea-e668cc143e72 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:36.118963 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad15a88-c395-4166-99fe-b2e15e82bff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:36.120441 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad15a88-c395-4166-99fe-b2e15e82bff8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:36.121097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad15a88-c395-4166-99fe-b2e15e82bff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:36.121568 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad15a88-c395-4166-99fe-b2e15e82bff8 admin admin] PATH_INFO: `/v3/projects/dc986e3a24dd4470a98dde18f1cc4bcb/users/6f7e7985409645b4800c7d531cdd66e2/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:36.124015 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad15a88-c395-4166-99fe-b2e15e82bff8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc986e3a24dd4470a98dde18f1cc4bcb, user_id=6f7e7985409645b4800c7d531cdd66e2, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:36.127561 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad15a88-c395-4166-99fe-b2e15e82bff8 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:36.158101 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 955/1909] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:49:36 2022] PUT /identity/v3/projects/dc986e3a24dd4470a98dde18f1cc4bcb/users/6f7e7985409645b4800c7d531cdd66e2/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:36.170320 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d277c7-5bf4-4889-ba8b-1856fc8b2e10 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:36.171353 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d277c7-5bf4-4889-ba8b-1856fc8b2e10 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:36.171880 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d277c7-5bf4-4889-ba8b-1856fc8b2e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:36.210687 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-51d277c7-5bf4-4889-ba8b-1856fc8b2e10 None None] MFA Rules not processed for user `6f7e7985409645b4800c7d531cdd66e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:36.212034 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-51d277c7-5bf4-4889-ba8b-1856fc8b2e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:36.335955 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 955/1910] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:36 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:36.351652 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad15a88-c395-4166-99fe-b2e15e82bff8 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:36.358238 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-aad15a88-c395-4166-99fe-b2e15e82bff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:36.418067 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:36.441344 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad15a88-c395-4166-99fe-b2e15e82bff8 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:36.445867 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0d6b1-5803-49f9-83fb-20c4aa610c7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:36.446568 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0d6b1-5803-49f9-83fb-20c4aa610c7d service cinder] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:36.446847 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0d6b1-5803-49f9-83fb-20c4aa610c7d service cinder] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:36.447150 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0d6b1-5803-49f9-83fb-20c4aa610c7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:36.458571 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be0d6b1-5803-49f9-83fb-20c4aa610c7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:36.460038 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be0d6b1-5803-49f9-83fb-20c4aa610c7d service cinder] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:36.475720 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 956/1911] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:36 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:49:36.537399 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d277c7-5bf4-4889-ba8b-1856fc8b2e10 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:36.558361 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d277c7-5bf4-4889-ba8b-1856fc8b2e10 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:36.565364 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737a8fc-fddf-4d5e-a4ac-6dc1dac05662 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:36.566021 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737a8fc-fddf-4d5e-a4ac-6dc1dac05662 service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:36.566341 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737a8fc-fddf-4d5e-a4ac-6dc1dac05662 service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:36.566594 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737a8fc-fddf-4d5e-a4ac-6dc1dac05662 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:36.711507 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737a8fc-fddf-4d5e-a4ac-6dc1dac05662 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:36.713466 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737a8fc-fddf-4d5e-a4ac-6dc1dac05662 service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:36.727994 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 956/1912] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:49:38.910951 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0d6b1-5803-49f9-83fb-20c4aa610c7d service cinder] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:38.920182 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0d6b1-5803-49f9-83fb-20c4aa610c7d service cinder] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:38.923758 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da05a91-9004-472f-b9f6-5559bcede483 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:38.924391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da05a91-9004-472f-b9f6-5559bcede483 service cinder] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:38.924661 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da05a91-9004-472f-b9f6-5559bcede483 service cinder] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:38.924934 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da05a91-9004-472f-b9f6-5559bcede483 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:38.926665 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-3da05a91-9004-472f-b9f6-5559bcede483 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:38.988438 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da05a91-9004-472f-b9f6-5559bcede483 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:38.989914 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da05a91-9004-472f-b9f6-5559bcede483 service cinder] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:38.999801 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 957/1913] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:49:39.730386 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737a8fc-fddf-4d5e-a4ac-6dc1dac05662 service cinder] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:39.751105 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:39.796477 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737a8fc-fddf-4d5e-a4ac-6dc1dac05662 service cinder] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:39.801543 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908658d-f216-4330-830a-b213f31bf892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:39.802664 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908658d-f216-4330-830a-b213f31bf892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:39.802946 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908658d-f216-4330-830a-b213f31bf892 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:39.803219 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908658d-f216-4330-830a-b213f31bf892 admin admin] PATH_INFO: `/v3/users/8a80dd67601943f889be2bde7c68b920` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:39.804463 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908658d-f216-4330-830a-b213f31bf892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a80dd67601943f889be2bde7c68b920)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:39.806603 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908658d-f216-4330-830a-b213f31bf892 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:39.855432 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-8908658d-f216-4330-830a-b213f31bf892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a80dd67601943f889be2bde7c68b920'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:39.862547 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-8908658d-f216-4330-830a-b213f31bf892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a80dd67601943f889be2bde7c68b920'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:39.875714 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-8908658d-f216-4330-830a-b213f31bf892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a80dd67601943f889be2bde7c68b920'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:39.876406 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-8908658d-f216-4330-830a-b213f31bf892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a80dd67601943f889be2bde7c68b920'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:39.876998 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-8908658d-f216-4330-830a-b213f31bf892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a80dd67601943f889be2bde7c68b920'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:39.895201 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 957/1914] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:49:39 2022] DELETE /identity/v3/users/8a80dd67601943f889be2bde7c68b920 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:39.899943 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bed7fd-1843-4371-8a89-79f3a533018c None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:39.900246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bed7fd-1843-4371-8a89-79f3a533018c None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:39.900550 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bed7fd-1843-4371-8a89-79f3a533018c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:39.918370 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-90bed7fd-1843-4371-8a89-79f3a533018c None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:39.919655 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-90bed7fd-1843-4371-8a89-79f3a533018c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:39.998692 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 958/1915] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:40.005379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908658d-f216-4330-830a-b213f31bf892 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:40.007154 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-8908658d-f216-4330-830a-b213f31bf892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:40.066846 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908658d-f216-4330-830a-b213f31bf892 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:40.073012 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b8217-f057-476f-814f-c2ab9508c0cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:40.073753 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b8217-f057-476f-814f-c2ab9508c0cb service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:40.073975 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b8217-f057-476f-814f-c2ab9508c0cb service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:40.074277 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b8217-f057-476f-814f-c2ab9508c0cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:40.086152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b8217-f057-476f-814f-c2ab9508c0cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:40.087650 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b8217-f057-476f-814f-c2ab9508c0cb service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:40.098445 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 958/1916] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:49:40.443846 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bed7fd-1843-4371-8a89-79f3a533018c None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:40.445411 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-90bed7fd-1843-4371-8a89-79f3a533018c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:40.458906 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bed7fd-1843-4371-8a89-79f3a533018c None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:40.464284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67986718-a57e-4741-802f-948bcb7d0504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:40.465168 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67986718-a57e-4741-802f-948bcb7d0504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:40.465447 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67986718-a57e-4741-802f-948bcb7d0504 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:40.466282 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67986718-a57e-4741-802f-948bcb7d0504 admin admin] PATH_INFO: `/v3/projects/226a65b053cf49e7951c2c4397256272` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:40.466957 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67986718-a57e-4741-802f-948bcb7d0504 admin admin] RBAC: Authorizing `identity:delete_project(project_id=226a65b053cf49e7951c2c4397256272)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:40.469089 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67986718-a57e-4741-802f-948bcb7d0504 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:40.541550 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-67986718-a57e-4741-802f-948bcb7d0504 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '226a65b053cf49e7951c2c4397256272', 'request_id': 'req-67986718-a57e-4741-802f-948bcb7d0504'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:40.549606 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-67986718-a57e-4741-802f-948bcb7d0504 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '226a65b053cf49e7951c2c4397256272', 'request_id': 'req-67986718-a57e-4741-802f-948bcb7d0504'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:40.569238 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-67986718-a57e-4741-802f-948bcb7d0504 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '226a65b053cf49e7951c2c4397256272', 'request_id': 'req-67986718-a57e-4741-802f-948bcb7d0504'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:40.591688 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-67986718-a57e-4741-802f-948bcb7d0504 admin admin] The token cache is being invalidate because project 226a65b053cf49e7951c2c4397256272 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:49:40.592476 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-67986718-a57e-4741-802f-948bcb7d0504 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:40.592987 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-67986718-a57e-4741-802f-948bcb7d0504 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:40.596672 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 959/1917] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:49:40 2022] DELETE /identity/v3/projects/226a65b053cf49e7951c2c4397256272 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:40.600449 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b8217-f057-476f-814f-c2ab9508c0cb service neutron] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:40.610960 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b8217-f057-476f-814f-c2ab9508c0cb service neutron] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:40.682121 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:40.699769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2b896-90d8-446e-a31d-1a7d992d794b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:40.700823 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2b896-90d8-446e-a31d-1a7d992d794b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:40.701475 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2b896-90d8-446e-a31d-1a7d992d794b admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:40.701898 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2b896-90d8-446e-a31d-1a7d992d794b admin admin] PATH_INFO: `/v3/users/cbc70a27369742ffb5ef8451ba4f7cee` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:40.703206 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2b896-90d8-446e-a31d-1a7d992d794b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbc70a27369742ffb5ef8451ba4f7cee)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:40.705406 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2b896-90d8-446e-a31d-1a7d992d794b admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:40.767772 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-94b2b896-90d8-446e-a31d-1a7d992d794b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbc70a27369742ffb5ef8451ba4f7cee'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:40.786988 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-94b2b896-90d8-446e-a31d-1a7d992d794b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbc70a27369742ffb5ef8451ba4f7cee'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:40.816452 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-94b2b896-90d8-446e-a31d-1a7d992d794b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbc70a27369742ffb5ef8451ba4f7cee'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:40.817670 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-94b2b896-90d8-446e-a31d-1a7d992d794b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbc70a27369742ffb5ef8451ba4f7cee'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:40.820149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-94b2b896-90d8-446e-a31d-1a7d992d794b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbc70a27369742ffb5ef8451ba4f7cee'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:40.856801 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 959/1918] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:49:40 2022] DELETE /identity/v3/users/cbc70a27369742ffb5ef8451ba4f7cee => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:41.351318 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67986718-a57e-4741-802f-948bcb7d0504 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:41.355275 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-67986718-a57e-4741-802f-948bcb7d0504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:41.372320 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:41.384745 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67986718-a57e-4741-802f-948bcb7d0504 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:41.451376 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2b896-90d8-446e-a31d-1a7d992d794b admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:41.453299 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-94b2b896-90d8-446e-a31d-1a7d992d794b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:41.468351 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dea680-5712-4200-8141-8361a7f1b7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:41.469053 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dea680-5712-4200-8141-8361a7f1b7d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:41.469398 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dea680-5712-4200-8141-8361a7f1b7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:41.469819 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dea680-5712-4200-8141-8361a7f1b7d9 admin admin] PATH_INFO: `/v3/users/d474bdce35124adda88f9a558486bfe2` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:41.471181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dea680-5712-4200-8141-8361a7f1b7d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d474bdce35124adda88f9a558486bfe2)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:41.473525 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dea680-5712-4200-8141-8361a7f1b7d9 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:41.539171 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-d3dea680-5712-4200-8141-8361a7f1b7d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd474bdce35124adda88f9a558486bfe2'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:41.544794 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2b896-90d8-446e-a31d-1a7d992d794b admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:41.549317 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5abfd17-cc53-4f97-98b2-9a292719d8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:41.550213 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abfd17-cc53-4f97-98b2-9a292719d8af admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:41.550496 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abfd17-cc53-4f97-98b2-9a292719d8af admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:41.550769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abfd17-cc53-4f97-98b2-9a292719d8af admin admin] PATH_INFO: `/v3/projects/b5a2db863194415384f1a7e37584ee27` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:41.551112 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-d3dea680-5712-4200-8141-8361a7f1b7d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd474bdce35124adda88f9a558486bfe2'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:41.551974 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5abfd17-cc53-4f97-98b2-9a292719d8af admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5a2db863194415384f1a7e37584ee27)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:41.553918 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5abfd17-cc53-4f97-98b2-9a292719d8af admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:41.559522 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-d3dea680-5712-4200-8141-8361a7f1b7d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd474bdce35124adda88f9a558486bfe2'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:41.560637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-d3dea680-5712-4200-8141-8361a7f1b7d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd474bdce35124adda88f9a558486bfe2'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:41.561291 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-d3dea680-5712-4200-8141-8361a7f1b7d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd474bdce35124adda88f9a558486bfe2'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:41.574830 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 960/1919] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:49:41 2022] DELETE /identity/v3/users/d474bdce35124adda88f9a558486bfe2 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:41.579359 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc433f7-307b-4fc2-bae1-6d58990a9872 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:41.579633 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc433f7-307b-4fc2-bae1-6d58990a9872 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:41.579892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc433f7-307b-4fc2-bae1-6d58990a9872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:41.596806 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-dbc433f7-307b-4fc2-bae1-6d58990a9872 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:41.598047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-dbc433f7-307b-4fc2-bae1-6d58990a9872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:41.606574 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-d5abfd17-cc53-4f97-98b2-9a292719d8af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5a2db863194415384f1a7e37584ee27', 'request_id': 'req-d5abfd17-cc53-4f97-98b2-9a292719d8af'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:41.612306 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-d5abfd17-cc53-4f97-98b2-9a292719d8af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5a2db863194415384f1a7e37584ee27', 'request_id': 'req-d5abfd17-cc53-4f97-98b2-9a292719d8af'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:41.616236 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:41.625700 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-d5abfd17-cc53-4f97-98b2-9a292719d8af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5a2db863194415384f1a7e37584ee27', 'request_id': 'req-d5abfd17-cc53-4f97-98b2-9a292719d8af'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:41.650160 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-d5abfd17-cc53-4f97-98b2-9a292719d8af admin admin] The token cache is being invalidate because project b5a2db863194415384f1a7e37584ee27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:49:41.650605 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-d5abfd17-cc53-4f97-98b2-9a292719d8af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:41.651264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-d5abfd17-cc53-4f97-98b2-9a292719d8af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:41.653118 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 960/1920] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:49:41 2022] DELETE /identity/v3/projects/b5a2db863194415384f1a7e37584ee27 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:49:41.657248 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5abfd17-cc53-4f97-98b2-9a292719d8af admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:41.658788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-d5abfd17-cc53-4f97-98b2-9a292719d8af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:41.689950 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 961/1921] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:49:41.703244 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc433f7-307b-4fc2-bae1-6d58990a9872 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:41.704713 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-dbc433f7-307b-4fc2-bae1-6d58990a9872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:41.733936 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5abfd17-cc53-4f97-98b2-9a292719d8af admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:41.736737 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:41.739189 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75125809-397c-4091-bd46-f7700f32d4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:41.740113 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75125809-397c-4091-bd46-f7700f32d4d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:41.740393 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75125809-397c-4091-bd46-f7700f32d4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:41.740669 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75125809-397c-4091-bd46-f7700f32d4d2 admin admin] PATH_INFO: `/v3/users/6f7e7985409645b4800c7d531cdd66e2` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:41.741881 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75125809-397c-4091-bd46-f7700f32d4d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f7e7985409645b4800c7d531cdd66e2)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:41.743911 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75125809-397c-4091-bd46-f7700f32d4d2 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:41.776059 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc433f7-307b-4fc2-bae1-6d58990a9872 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:41.785051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d990ccc3-03e1-4d53-9feb-9c538e94835b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:41.786328 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990ccc3-03e1-4d53-9feb-9c538e94835b service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:41.787109 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990ccc3-03e1-4d53-9feb-9c538e94835b service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:41.787801 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990ccc3-03e1-4d53-9feb-9c538e94835b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:41.803924 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d990ccc3-03e1-4d53-9feb-9c538e94835b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:41.806628 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d990ccc3-03e1-4d53-9feb-9c538e94835b service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:41.813973 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-75125809-397c-4091-bd46-f7700f32d4d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f7e7985409645b4800c7d531cdd66e2'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:41.821693 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-75125809-397c-4091-bd46-f7700f32d4d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f7e7985409645b4800c7d531cdd66e2'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:41.821834 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 962/1922] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:49:41.839476 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-75125809-397c-4091-bd46-f7700f32d4d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f7e7985409645b4800c7d531cdd66e2'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:41.840374 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-75125809-397c-4091-bd46-f7700f32d4d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f7e7985409645b4800c7d531cdd66e2'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:41.840944 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-75125809-397c-4091-bd46-f7700f32d4d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f7e7985409645b4800c7d531cdd66e2'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:41.863367 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 961/1923] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:49:41 2022] DELETE /identity/v3/users/6f7e7985409645b4800c7d531cdd66e2 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:42.202754 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d990ccc3-03e1-4d53-9feb-9c538e94835b service neutron] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:42.204198 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-d990ccc3-03e1-4d53-9feb-9c538e94835b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:42.217656 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d990ccc3-03e1-4d53-9feb-9c538e94835b service neutron] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:42.262836 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75125809-397c-4091-bd46-f7700f32d4d2 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:42.264752 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-75125809-397c-4091-bd46-f7700f32d4d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:42.283067 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d5421-2fc8-4ac2-96af-e3257a20e81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:42.284284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d5421-2fc8-4ac2-96af-e3257a20e81b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:42.284564 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d5421-2fc8-4ac2-96af-e3257a20e81b admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:42.284838 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d5421-2fc8-4ac2-96af-e3257a20e81b admin admin] PATH_INFO: `/v3/projects/e78ab54e11484721a28338464b8c7863` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:42.286080 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7d5421-2fc8-4ac2-96af-e3257a20e81b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e78ab54e11484721a28338464b8c7863)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:42.288183 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7d5421-2fc8-4ac2-96af-e3257a20e81b admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:42.339375 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-6c7d5421-2fc8-4ac2-96af-e3257a20e81b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e78ab54e11484721a28338464b8c7863', 'request_id': 'req-6c7d5421-2fc8-4ac2-96af-e3257a20e81b'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:42.340375 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75125809-397c-4091-bd46-f7700f32d4d2 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:42.345123 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-6c7d5421-2fc8-4ac2-96af-e3257a20e81b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e78ab54e11484721a28338464b8c7863', 'request_id': 'req-6c7d5421-2fc8-4ac2-96af-e3257a20e81b'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:42.353944 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-6c7d5421-2fc8-4ac2-96af-e3257a20e81b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e78ab54e11484721a28338464b8c7863', 'request_id': 'req-6c7d5421-2fc8-4ac2-96af-e3257a20e81b'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:42.354942 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:42.368017 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-6c7d5421-2fc8-4ac2-96af-e3257a20e81b admin admin] The token cache is being invalidate because project e78ab54e11484721a28338464b8c7863 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:49:42.368670 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-6c7d5421-2fc8-4ac2-96af-e3257a20e81b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:42.369328 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-6c7d5421-2fc8-4ac2-96af-e3257a20e81b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:42.371792 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 963/1924] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:49:42 2022] DELETE /identity/v3/projects/e78ab54e11484721a28338464b8c7863 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:42.376322 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d5421-2fc8-4ac2-96af-e3257a20e81b admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:42.378104 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-6c7d5421-2fc8-4ac2-96af-e3257a20e81b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:42.409306 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea38f5-c0b0-4dcc-9140-ecdf64891aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:42.410336 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea38f5-c0b0-4dcc-9140-ecdf64891aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:42.410611 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea38f5-c0b0-4dcc-9140-ecdf64891aee admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:42.410881 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea38f5-c0b0-4dcc-9140-ecdf64891aee admin admin] PATH_INFO: `/v3/projects/dc986e3a24dd4470a98dde18f1cc4bcb` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:42.412108 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea38f5-c0b0-4dcc-9140-ecdf64891aee admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc986e3a24dd4470a98dde18f1cc4bcb)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:42.414109 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea38f5-c0b0-4dcc-9140-ecdf64891aee admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:42.453706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:42.460859 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d5421-2fc8-4ac2-96af-e3257a20e81b admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:42.471730 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe769774-e295-4e21-b7fc-a5ae133a390a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:42.475185 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe769774-e295-4e21-b7fc-a5ae133a390a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:42.477565 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe769774-e295-4e21-b7fc-a5ae133a390a admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:42.478074 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe769774-e295-4e21-b7fc-a5ae133a390a admin admin] PATH_INFO: `/v3/users/fe1c6e1e7a8b40ad8a438655befc99b2` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:42.481119 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe769774-e295-4e21-b7fc-a5ae133a390a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe1c6e1e7a8b40ad8a438655befc99b2)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:42.485289 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe769774-e295-4e21-b7fc-a5ae133a390a admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:42.495300 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-fcea38f5-c0b0-4dcc-9140-ecdf64891aee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc986e3a24dd4470a98dde18f1cc4bcb', 'request_id': 'req-fcea38f5-c0b0-4dcc-9140-ecdf64891aee'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:42.508258 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-fcea38f5-c0b0-4dcc-9140-ecdf64891aee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc986e3a24dd4470a98dde18f1cc4bcb', 'request_id': 'req-fcea38f5-c0b0-4dcc-9140-ecdf64891aee'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:42.519055 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-fcea38f5-c0b0-4dcc-9140-ecdf64891aee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc986e3a24dd4470a98dde18f1cc4bcb', 'request_id': 'req-fcea38f5-c0b0-4dcc-9140-ecdf64891aee'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:42.533747 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-fcea38f5-c0b0-4dcc-9140-ecdf64891aee admin admin] The token cache is being invalidate because project dc986e3a24dd4470a98dde18f1cc4bcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:49:42.534204 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-fcea38f5-c0b0-4dcc-9140-ecdf64891aee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:42.534939 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-fcea38f5-c0b0-4dcc-9140-ecdf64891aee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:42.536912 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 962/1925] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:49:42 2022] DELETE /identity/v3/projects/dc986e3a24dd4470a98dde18f1cc4bcb => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:42.543977 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acb673-e368-4fe5-8b10-8c5c60fede11 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:42.544389 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acb673-e368-4fe5-8b10-8c5c60fede11 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:42.544731 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acb673-e368-4fe5-8b10-8c5c60fede11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:42.558603 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-fe769774-e295-4e21-b7fc-a5ae133a390a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe1c6e1e7a8b40ad8a438655befc99b2'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:42.564057 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-85acb673-e368-4fe5-8b10-8c5c60fede11 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:42.565576 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-85acb673-e368-4fe5-8b10-8c5c60fede11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:42.573314 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-fe769774-e295-4e21-b7fc-a5ae133a390a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe1c6e1e7a8b40ad8a438655befc99b2'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:42.580547 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-fe769774-e295-4e21-b7fc-a5ae133a390a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe1c6e1e7a8b40ad8a438655befc99b2'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:42.581254 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-fe769774-e295-4e21-b7fc-a5ae133a390a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe1c6e1e7a8b40ad8a438655befc99b2'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:42.581887 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-fe769774-e295-4e21-b7fc-a5ae133a390a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe1c6e1e7a8b40ad8a438655befc99b2'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:42.596091 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 964/1926] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:49:42 2022] DELETE /identity/v3/users/fe1c6e1e7a8b40ad8a438655befc99b2 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:42.631979 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 963/1927] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:42.641410 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1f940-adaf-4bfa-917a-bed15286757c None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:42.641706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1f940-adaf-4bfa-917a-bed15286757c None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:42.642013 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1f940-adaf-4bfa-917a-bed15286757c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:42.662447 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-c2c1f940-adaf-4bfa-917a-bed15286757c None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:42.663794 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-c2c1f940-adaf-4bfa-917a-bed15286757c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:42.740608 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 965/1928] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:49:42.745673 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85acb673-e368-4fe5-8b10-8c5c60fede11 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:42.765905 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85acb673-e368-4fe5-8b10-8c5c60fede11 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:42.772542 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755df475-8c7b-41dd-ae23-c2f094417d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:42.773249 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755df475-8c7b-41dd-ae23-c2f094417d90 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:42.773534 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755df475-8c7b-41dd-ae23-c2f094417d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:42.773813 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755df475-8c7b-41dd-ae23-c2f094417d90 admin admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:42.775018 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755df475-8c7b-41dd-ae23-c2f094417d90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:49:42.775399 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755df475-8c7b-41dd-ae23-c2f094417d90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:42.777487 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755df475-8c7b-41dd-ae23-c2f094417d90 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:42.791820 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 964/1929] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:49:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:49:42.796746 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1f940-adaf-4bfa-917a-bed15286757c None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:42.807593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1f940-adaf-4bfa-917a-bed15286757c None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:42.813832 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e929f31-4f24-438c-897c-c6e222176bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:42.814664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e929f31-4f24-438c-897c-c6e222176bef admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:42.815047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e929f31-4f24-438c-897c-c6e222176bef admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:42.815569 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e929f31-4f24-438c-897c-c6e222176bef admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:42.816568 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e929f31-4f24-438c-897c-c6e222176bef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:42.819895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e929f31-4f24-438c-897c-c6e222176bef admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:42.854306 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 966/1930] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:49:42 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:49:42.858453 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755df475-8c7b-41dd-ae23-c2f094417d90 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:42.871365 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755df475-8c7b-41dd-ae23-c2f094417d90 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:42.918964 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:42.954146 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a837eae-50fa-4ee8-b385-d51271c9120c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:42.954922 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a837eae-50fa-4ee8-b385-d51271c9120c admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:42.955209 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a837eae-50fa-4ee8-b385-d51271c9120c admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:42.955480 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a837eae-50fa-4ee8-b385-d51271c9120c admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:42.956256 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a837eae-50fa-4ee8-b385-d51271c9120c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:42.958614 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a837eae-50fa-4ee8-b385-d51271c9120c admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:42.970287 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e929f31-4f24-438c-897c-c6e222176bef admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:42.972155 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-6e929f31-4f24-438c-897c-c6e222176bef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:42.988668 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e929f31-4f24-438c-897c-c6e222176bef admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:42.992166 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 965/1931] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:49:42 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:49:42.993588 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a837eae-50fa-4ee8-b385-d51271c9120c admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:42.995536 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b93fe-d0ce-476e-bbd5-8ad62177eb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:42.997122 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b93fe-d0ce-476e-bbd5-8ad62177eb30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:42.997122 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b93fe-d0ce-476e-bbd5-8ad62177eb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:42.997347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b93fe-d0ce-476e-bbd5-8ad62177eb30 admin admin] PATH_INFO: `/v3/projects/efccc67bc3144f14a4bb9846a7633403` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:42.998436 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b93fe-d0ce-476e-bbd5-8ad62177eb30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efccc67bc3144f14a4bb9846a7633403)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:43.000554 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b93fe-d0ce-476e-bbd5-8ad62177eb30 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:43.006359 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a837eae-50fa-4ee8-b385-d51271c9120c admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:43.019241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa44bf7-ae5a-4136-a70c-b3591c157b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:43.020730 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa44bf7-ae5a-4136-a70c-b3591c157b6c admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:43.021043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa44bf7-ae5a-4136-a70c-b3591c157b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:43.021560 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa44bf7-ae5a-4136-a70c-b3591c157b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:43.022522 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa44bf7-ae5a-4136-a70c-b3591c157b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:43.024210 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa44bf7-ae5a-4136-a70c-b3591c157b6c admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:43.036587 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 966/1932] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:49:43.041482 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa44bf7-ae5a-4136-a70c-b3591c157b6c admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:43.052274 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa44bf7-ae5a-4136-a70c-b3591c157b6c admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:43.059443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:43.061346 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c19b93fe-d0ce-476e-bbd5-8ad62177eb30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efccc67bc3144f14a4bb9846a7633403', 'request_id': 'req-c19b93fe-d0ce-476e-bbd5-8ad62177eb30'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:43.068602 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c19b93fe-d0ce-476e-bbd5-8ad62177eb30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efccc67bc3144f14a4bb9846a7633403', 'request_id': 'req-c19b93fe-d0ce-476e-bbd5-8ad62177eb30'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:43.081334 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c19b93fe-d0ce-476e-bbd5-8ad62177eb30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efccc67bc3144f14a4bb9846a7633403', 'request_id': 'req-c19b93fe-d0ce-476e-bbd5-8ad62177eb30'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:43.095525 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c19b93fe-d0ce-476e-bbd5-8ad62177eb30 admin admin] The token cache is being invalidate because project efccc67bc3144f14a4bb9846a7633403 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:49:43.095815 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c19b93fe-d0ce-476e-bbd5-8ad62177eb30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:43.096486 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c19b93fe-d0ce-476e-bbd5-8ad62177eb30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:43.101720 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 967/1933] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:49:42 2022] DELETE /identity/v3/projects/efccc67bc3144f14a4bb9846a7633403 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:43.106009 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b93fe-d0ce-476e-bbd5-8ad62177eb30 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:43.106009 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-c19b93fe-d0ce-476e-bbd5-8ad62177eb30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:43.120720 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049aaa9-8779-43f4-a83f-0975658bfc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:43.121438 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049aaa9-8779-43f4-a83f-0975658bfc76 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:43.121718 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049aaa9-8779-43f4-a83f-0975658bfc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:43.122027 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049aaa9-8779-43f4-a83f-0975658bfc76 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:43.122762 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049aaa9-8779-43f4-a83f-0975658bfc76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:43.124566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049aaa9-8779-43f4-a83f-0975658bfc76 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:43.134689 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 967/1934] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:49:43.138815 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049aaa9-8779-43f4-a83f-0975658bfc76 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:43.140925 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-4049aaa9-8779-43f4-a83f-0975658bfc76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:43.154317 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049aaa9-8779-43f4-a83f-0975658bfc76 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:43.159812 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615062f9-4e6d-44b1-ae79-0d3ba17646b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:43.160637 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615062f9-4e6d-44b1-ae79-0d3ba17646b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:43.160949 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615062f9-4e6d-44b1-ae79-0d3ba17646b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:43.161215 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615062f9-4e6d-44b1-ae79-0d3ba17646b7 admin admin] PATH_INFO: `/v3/projects/4db69e8fe7084ba9929e8690ebf2b749/users/87fdb75f3a304c68ac64368ed8e54e62/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:43.176486 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615062f9-4e6d-44b1-ae79-0d3ba17646b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4db69e8fe7084ba9929e8690ebf2b749, user_id=87fdb75f3a304c68ac64368ed8e54e62, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:43.179094 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b93fe-d0ce-476e-bbd5-8ad62177eb30 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:43.179211 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615062f9-4e6d-44b1-ae79-0d3ba17646b7 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:43.183794 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd2e92-40b1-4184-8ae0-d3020a0e5777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:43.184755 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd2e92-40b1-4184-8ae0-d3020a0e5777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:43.184962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd2e92-40b1-4184-8ae0-d3020a0e5777 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:43.185239 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd2e92-40b1-4184-8ae0-d3020a0e5777 admin admin] PATH_INFO: `/v3/users/0ac6582207a1452e818e0d9748c5948a` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:43.186515 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd2e92-40b1-4184-8ae0-d3020a0e5777 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ac6582207a1452e818e0d9748c5948a)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:43.188603 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd2e92-40b1-4184-8ae0-d3020a0e5777 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:43.193359 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 968/1935] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:49:43 2022] PUT /identity/v3/projects/4db69e8fe7084ba9929e8690ebf2b749/users/87fdb75f3a304c68ac64368ed8e54e62/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:49:43.204558 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62caccc-96c2-4a63-b6d2-693d842652ff None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:43.204857 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62caccc-96c2-4a63-b6d2-693d842652ff None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:43.205115 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62caccc-96c2-4a63-b6d2-693d842652ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:43.233676 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-a62caccc-96c2-4a63-b6d2-693d842652ff None None] MFA Rules not processed for user `87fdb75f3a304c68ac64368ed8e54e62`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:43.234970 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-a62caccc-96c2-4a63-b6d2-693d842652ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:43.238188 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-10cd2e92-40b1-4184-8ae0-d3020a0e5777 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ac6582207a1452e818e0d9748c5948a'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:43.251789 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-10cd2e92-40b1-4184-8ae0-d3020a0e5777 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ac6582207a1452e818e0d9748c5948a'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:43.260181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-10cd2e92-40b1-4184-8ae0-d3020a0e5777 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ac6582207a1452e818e0d9748c5948a'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:43.260913 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-10cd2e92-40b1-4184-8ae0-d3020a0e5777 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ac6582207a1452e818e0d9748c5948a'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:43.261549 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-10cd2e92-40b1-4184-8ae0-d3020a0e5777 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ac6582207a1452e818e0d9748c5948a'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:43.276914 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 968/1936] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:49:43 2022] DELETE /identity/v3/users/0ac6582207a1452e818e0d9748c5948a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:43.306392 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 969/1937] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:49:43.311790 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd2e92-40b1-4184-8ae0-d3020a0e5777 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:43.313535 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-10cd2e92-40b1-4184-8ae0-d3020a0e5777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:43.377297 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:43.383157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd2e92-40b1-4184-8ae0-d3020a0e5777 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:43.391146 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff037e-aa78-4392-b6e6-2c9710b3b34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:43.392701 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff037e-aa78-4392-b6e6-2c9710b3b34d admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:43.393548 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff037e-aa78-4392-b6e6-2c9710b3b34d admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:43.394175 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff037e-aa78-4392-b6e6-2c9710b3b34d admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:43.394910 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff037e-aa78-4392-b6e6-2c9710b3b34d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:43.396844 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff037e-aa78-4392-b6e6-2c9710b3b34d admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:43.431216 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 969/1938] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:49:43 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:49:43.435283 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62caccc-96c2-4a63-b6d2-693d842652ff None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:43.453462 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:43.501680 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62caccc-96c2-4a63-b6d2-693d842652ff None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:43.562152 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff037e-aa78-4392-b6e6-2c9710b3b34d admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:43.564258 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756225e-58bc-42bd-a9a8-f3b515e5f0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:43.564970 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756225e-58bc-42bd-a9a8-f3b515e5f0c3 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:43.565226 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756225e-58bc-42bd-a9a8-f3b515e5f0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:43.565500 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756225e-58bc-42bd-a9a8-f3b515e5f0c3 admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:43.566225 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f756225e-58bc-42bd-a9a8-f3b515e5f0c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:43.568199 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-9eff037e-aa78-4392-b6e6-2c9710b3b34d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:43.568328 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f756225e-58bc-42bd-a9a8-f3b515e5f0c3 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:43.595795 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff037e-aa78-4392-b6e6-2c9710b3b34d admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:43.601711 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c16401f-dab3-4dd9-bf8b-45ea144e3aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:43.602624 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16401f-dab3-4dd9-bf8b-45ea144e3aea admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:43.602897 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16401f-dab3-4dd9-bf8b-45ea144e3aea admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:43.603191 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16401f-dab3-4dd9-bf8b-45ea144e3aea admin admin] PATH_INFO: `/v3/projects/8c113f94f5e64be486226d1867a8e46e` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:43.604449 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c16401f-dab3-4dd9-bf8b-45ea144e3aea admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c113f94f5e64be486226d1867a8e46e)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:43.606524 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c16401f-dab3-4dd9-bf8b-45ea144e3aea admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:43.613107 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 970/1939] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:49:43 2022] POST /identity/v3/users => generated 299 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:49:43.614327 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756225e-58bc-42bd-a9a8-f3b515e5f0c3 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:43.625562 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756225e-58bc-42bd-a9a8-f3b515e5f0c3 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:43.631331 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191a17a-bb4b-42a8-bdbf-a1f82698b9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:43.632605 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191a17a-bb4b-42a8-bdbf-a1f82698b9bb admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:43.633143 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191a17a-bb4b-42a8-bdbf-a1f82698b9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:43.635832 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191a17a-bb4b-42a8-bdbf-a1f82698b9bb admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:43.635832 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191a17a-bb4b-42a8-bdbf-a1f82698b9bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:43.636624 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191a17a-bb4b-42a8-bdbf-a1f82698b9bb admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:43.651126 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 971/1940] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:49:43.658263 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191a17a-bb4b-42a8-bdbf-a1f82698b9bb admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:43.673828 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191a17a-bb4b-42a8-bdbf-a1f82698b9bb admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:43.677746 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-1c16401f-dab3-4dd9-bf8b-45ea144e3aea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c113f94f5e64be486226d1867a8e46e', 'request_id': 'req-1c16401f-dab3-4dd9-bf8b-45ea144e3aea'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:43.684972 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-1c16401f-dab3-4dd9-bf8b-45ea144e3aea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c113f94f5e64be486226d1867a8e46e', 'request_id': 'req-1c16401f-dab3-4dd9-bf8b-45ea144e3aea'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:43.695811 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-1c16401f-dab3-4dd9-bf8b-45ea144e3aea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c113f94f5e64be486226d1867a8e46e', 'request_id': 'req-1c16401f-dab3-4dd9-bf8b-45ea144e3aea'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:43.709137 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-1c16401f-dab3-4dd9-bf8b-45ea144e3aea admin admin] The token cache is being invalidate because project 8c113f94f5e64be486226d1867a8e46e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:49:43.709994 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-1c16401f-dab3-4dd9-bf8b-45ea144e3aea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:43.710269 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-1c16401f-dab3-4dd9-bf8b-45ea144e3aea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:43.712052 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 970/1941] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:49:43 2022] DELETE /identity/v3/projects/8c113f94f5e64be486226d1867a8e46e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:43.717874 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2af808-cec3-4b66-9560-a79b39389ba4 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:43.718155 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2af808-cec3-4b66-9560-a79b39389ba4 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:43.718423 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2af808-cec3-4b66-9560-a79b39389ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:43.736900 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-0c2af808-cec3-4b66-9560-a79b39389ba4 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:43.738172 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-0c2af808-cec3-4b66-9560-a79b39389ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:43.754644 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe526e4-a7dd-4bf0-8b58-bd040284778d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:43.755649 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe526e4-a7dd-4bf0-8b58-bd040284778d admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:43.755933 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe526e4-a7dd-4bf0-8b58-bd040284778d admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:43.756436 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe526e4-a7dd-4bf0-8b58-bd040284778d admin admin] PATH_INFO: `/v3/projects/8d278bcdb72246c4b34ea356d62860dd/users/e84697e55b2642d1b27ccb20c660269c/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:43.775189 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe526e4-a7dd-4bf0-8b58-bd040284778d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d278bcdb72246c4b34ea356d62860dd, user_id=e84697e55b2642d1b27ccb20c660269c, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:43.778098 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe526e4-a7dd-4bf0-8b58-bd040284778d admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:43.795888 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 972/1942] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:49:43 2022] PUT /identity/v3/projects/8d278bcdb72246c4b34ea356d62860dd/users/e84697e55b2642d1b27ccb20c660269c/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:43.800691 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe526e4-a7dd-4bf0-8b58-bd040284778d admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:43.803256 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-efe526e4-a7dd-4bf0-8b58-bd040284778d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:43.819267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 971/1943] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:49:43.828890 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8bc86-28a2-4163-9cd1-5972f4ab3ab6 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:43.829176 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8bc86-28a2-4163-9cd1-5972f4ab3ab6 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:43.829455 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8bc86-28a2-4163-9cd1-5972f4ab3ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:43.830155 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:43.849011 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-a5e8bc86-28a2-4163-9cd1-5972f4ab3ab6 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:43.850428 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-a5e8bc86-28a2-4163-9cd1-5972f4ab3ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:43.870616 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe526e4-a7dd-4bf0-8b58-bd040284778d admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:43.875190 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1687a-52b3-49a2-8c53-86f501ac95eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:43.875919 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1687a-52b3-49a2-8c53-86f501ac95eb admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:43.876480 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1687a-52b3-49a2-8c53-86f501ac95eb admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:43.876480 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1687a-52b3-49a2-8c53-86f501ac95eb admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:43.877154 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db1687a-52b3-49a2-8c53-86f501ac95eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:43.878788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db1687a-52b3-49a2-8c53-86f501ac95eb admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:43.893431 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 973/1944] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:49:43.895234 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1687a-52b3-49a2-8c53-86f501ac95eb admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:43.906957 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1687a-52b3-49a2-8c53-86f501ac95eb admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:43.911939 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c087197-0db0-49f4-9b3e-6aba412b3b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:43.912461 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 972/1945] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:49:43.912834 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c087197-0db0-49f4-9b3e-6aba412b3b54 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:43.913115 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c087197-0db0-49f4-9b3e-6aba412b3b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:43.913391 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c087197-0db0-49f4-9b3e-6aba412b3b54 admin admin] PATH_INFO: `/v3/projects/8d278bcdb72246c4b34ea356d62860dd/users/e84697e55b2642d1b27ccb20c660269c/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:43.915413 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c087197-0db0-49f4-9b3e-6aba412b3b54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d278bcdb72246c4b34ea356d62860dd, user_id=e84697e55b2642d1b27ccb20c660269c, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:43.917004 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8bc86-28a2-4163-9cd1-5972f4ab3ab6 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:43.918574 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c087197-0db0-49f4-9b3e-6aba412b3b54 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:43.923072 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:43.933948 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8bc86-28a2-4163-9cd1-5972f4ab3ab6 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:43.938025 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 974/1946] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:49:43 2022] PUT /identity/v3/projects/8d278bcdb72246c4b34ea356d62860dd/users/e84697e55b2642d1b27ccb20c660269c/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:49:43.949404 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525a8f3-c3ab-41a8-a987-bd94650ebb81 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:43.949771 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525a8f3-c3ab-41a8-a987-bd94650ebb81 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:43.950145 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525a8f3-c3ab-41a8-a987-bd94650ebb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:43.980559 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-2525a8f3-c3ab-41a8-a987-bd94650ebb81 None None] MFA Rules not processed for user `e84697e55b2642d1b27ccb20c660269c`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:43.981761 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-2525a8f3-c3ab-41a8-a987-bd94650ebb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:44.018183 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5a2b8-c8bb-4309-94f1-a6ea2239488d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:44.019702 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5a2b8-c8bb-4309-94f1-a6ea2239488d admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:44.019976 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5a2b8-c8bb-4309-94f1-a6ea2239488d admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:44.020478 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5a2b8-c8bb-4309-94f1-a6ea2239488d admin admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:44.021327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef5a2b8-c8bb-4309-94f1-a6ea2239488d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:49:44.021702 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef5a2b8-c8bb-4309-94f1-a6ea2239488d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:44.023622 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef5a2b8-c8bb-4309-94f1-a6ea2239488d admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:44.048678 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 973/1947] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:49:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:49:44.053812 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5a2b8-c8bb-4309-94f1-a6ea2239488d admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:44.063932 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5a2b8-c8bb-4309-94f1-a6ea2239488d admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:44.069059 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eece044-6314-43d7-a1d1-48c1915550fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:44.069783 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eece044-6314-43d7-a1d1-48c1915550fc admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:44.070145 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eece044-6314-43d7-a1d1-48c1915550fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:44.070478 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eece044-6314-43d7-a1d1-48c1915550fc admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:44.071325 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eece044-6314-43d7-a1d1-48c1915550fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:44.073541 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eece044-6314-43d7-a1d1-48c1915550fc admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:44.078837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 975/1948] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:43 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:49:44.091057 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2525a8f3-c3ab-41a8-a987-bd94650ebb81 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:44.092690 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-2525a8f3-c3ab-41a8-a987-bd94650ebb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:44.112307 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 974/1949] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:49:44 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:49:44.114198 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eece044-6314-43d7-a1d1-48c1915550fc admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:44.166825 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2525a8f3-c3ab-41a8-a987-bd94650ebb81 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:44.190559 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eece044-6314-43d7-a1d1-48c1915550fc admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:44.196309 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9b15b-10eb-45b1-a2ed-1a1fed461797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:44.196989 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9b15b-10eb-45b1-a2ed-1a1fed461797 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:44.197268 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9b15b-10eb-45b1-a2ed-1a1fed461797 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:44.197824 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9b15b-10eb-45b1-a2ed-1a1fed461797 admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:44.198714 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e9b15b-10eb-45b1-a2ed-1a1fed461797 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:44.200696 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e9b15b-10eb-45b1-a2ed-1a1fed461797 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:44.227949 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 975/1950] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:49:44 2022] POST /identity/v3/users => generated 283 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:49:44.228171 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:44.229023 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9b15b-10eb-45b1-a2ed-1a1fed461797 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:44.233695 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5538b5-8c52-4656-8f04-fcdd21bede2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:44.234432 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5538b5-8c52-4656-8f04-fcdd21bede2e service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:44.234680 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5538b5-8c52-4656-8f04-fcdd21bede2e service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:44.234955 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5538b5-8c52-4656-8f04-fcdd21bede2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:44.240022 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9b15b-10eb-45b1-a2ed-1a1fed461797 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:44.246770 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320752e-5e0b-43ca-9c6c-79c6e0ae0bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:44.247465 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320752e-5e0b-43ca-9c6c-79c6e0ae0bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:44.247742 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320752e-5e0b-43ca-9c6c-79c6e0ae0bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:44.248009 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320752e-5e0b-43ca-9c6c-79c6e0ae0bf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:44.248808 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320752e-5e0b-43ca-9c6c-79c6e0ae0bf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:44.250448 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320752e-5e0b-43ca-9c6c-79c6e0ae0bf5 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:44.261770 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 976/1951] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:49:44.265484 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320752e-5e0b-43ca-9c6c-79c6e0ae0bf5 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:44.278523 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320752e-5e0b-43ca-9c6c-79c6e0ae0bf5 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:44.285540 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c656c-eeda-4d3f-be3d-42bd11ec4e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:44.286370 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c656c-eeda-4d3f-be3d-42bd11ec4e80 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:44.286679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c656c-eeda-4d3f-be3d-42bd11ec4e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:44.286952 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c656c-eeda-4d3f-be3d-42bd11ec4e80 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:44.287872 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c656c-eeda-4d3f-be3d-42bd11ec4e80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:44.289237 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c656c-eeda-4d3f-be3d-42bd11ec4e80 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:44.304044 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5538b5-8c52-4656-8f04-fcdd21bede2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:44.305663 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5538b5-8c52-4656-8f04-fcdd21bede2e service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:44.307026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 977/1952] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:49:44.311150 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c656c-eeda-4d3f-be3d-42bd11ec4e80 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:44.315955 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 976/1953] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:49:44.320908 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c656c-eeda-4d3f-be3d-42bd11ec4e80 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:44.325494 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14feaf-e3f2-40a7-9e79-ab8ebd4ef108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:44.326479 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14feaf-e3f2-40a7-9e79-ab8ebd4ef108 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:44.326880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14feaf-e3f2-40a7-9e79-ab8ebd4ef108 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:44.327222 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14feaf-e3f2-40a7-9e79-ab8ebd4ef108 admin admin] PATH_INFO: `/v3/projects/d835a13a78884b03b9eb74b68034a46a/users/0b36e75a7d664452a2956ec76e8633f0/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:44.342681 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14feaf-e3f2-40a7-9e79-ab8ebd4ef108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d835a13a78884b03b9eb74b68034a46a, user_id=0b36e75a7d664452a2956ec76e8633f0, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:44.345350 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14feaf-e3f2-40a7-9e79-ab8ebd4ef108 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:44.359841 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 978/1954] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:49:44 2022] PUT /identity/v3/projects/d835a13a78884b03b9eb74b68034a46a/users/0b36e75a7d664452a2956ec76e8633f0/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:44.373639 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbceab6-500b-4a5a-b6fd-796845f862c2 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:44.373639 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbceab6-500b-4a5a-b6fd-796845f862c2 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:44.373639 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbceab6-500b-4a5a-b6fd-796845f862c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:44.398974 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-5fbceab6-500b-4a5a-b6fd-796845f862c2 None None] MFA Rules not processed for user `0b36e75a7d664452a2956ec76e8633f0`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:44.400099 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-5fbceab6-500b-4a5a-b6fd-796845f862c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:44.470140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 977/1955] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:44.474316 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14feaf-e3f2-40a7-9e79-ab8ebd4ef108 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:44.498091 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:44.544820 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14feaf-e3f2-40a7-9e79-ab8ebd4ef108 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:44.550357 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010824e-3606-4179-964c-30dc4eec3a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:44.551009 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010824e-3606-4179-964c-30dc4eec3a44 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:44.551287 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010824e-3606-4179-964c-30dc4eec3a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:44.551563 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010824e-3606-4179-964c-30dc4eec3a44 admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:44.552268 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010824e-3606-4179-964c-30dc4eec3a44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:44.554271 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010824e-3606-4179-964c-30dc4eec3a44 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:44.581396 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 979/1956] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:49:44 2022] POST /identity/v3/projects => generated 367 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:49:44.585742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbceab6-500b-4a5a-b6fd-796845f862c2 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:44.597174 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbceab6-500b-4a5a-b6fd-796845f862c2 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:44.664113 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231368c-28b2-4971-8bd5-2ccbc1ece98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:44.664706 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231368c-28b2-4971-8bd5-2ccbc1ece98c admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:44.664984 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231368c-28b2-4971-8bd5-2ccbc1ece98c admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:44.665230 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231368c-28b2-4971-8bd5-2ccbc1ece98c admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:44.666418 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231368c-28b2-4971-8bd5-2ccbc1ece98c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:44.668396 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231368c-28b2-4971-8bd5-2ccbc1ece98c admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:44.693765 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 978/1957] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:49:44 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:49:44.695221 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010824e-3606-4179-964c-30dc4eec3a44 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:44.706381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010824e-3606-4179-964c-30dc4eec3a44 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:44.711724 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3cf6f-ffed-4f07-a039-680d9282d2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:44.712410 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3cf6f-ffed-4f07-a039-680d9282d2a5 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:44.712690 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3cf6f-ffed-4f07-a039-680d9282d2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:44.713074 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3cf6f-ffed-4f07-a039-680d9282d2a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:44.713859 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3cf6f-ffed-4f07-a039-680d9282d2a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:44.715469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3cf6f-ffed-4f07-a039-680d9282d2a5 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:44.728391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 980/1958] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:49:44.732591 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231368c-28b2-4971-8bd5-2ccbc1ece98c admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:44.743150 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231368c-28b2-4971-8bd5-2ccbc1ece98c admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:44.748706 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc47004-2898-4266-91ac-15462505e2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:44.749785 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc47004-2898-4266-91ac-15462505e2ed admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:44.750122 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc47004-2898-4266-91ac-15462505e2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:44.750399 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc47004-2898-4266-91ac-15462505e2ed admin admin] PATH_INFO: `/v3/projects/da6c1bb720b344b9845e70d7212c041f/users/65b70cd60d824b278a24ee5e812fc72c/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:44.768708 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc47004-2898-4266-91ac-15462505e2ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=da6c1bb720b344b9845e70d7212c041f, user_id=65b70cd60d824b278a24ee5e812fc72c, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:44.771495 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc47004-2898-4266-91ac-15462505e2ed admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:44.773979 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:44.792512 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 979/1959] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:49:44 2022] PUT /identity/v3/projects/da6c1bb720b344b9845e70d7212c041f/users/65b70cd60d824b278a24ee5e812fc72c/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:44.796703 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3cf6f-ffed-4f07-a039-680d9282d2a5 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:44.809632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3cf6f-ffed-4f07-a039-680d9282d2a5 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:44.905566 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfd475-aa1a-4f60-bf01-99e77436ae8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:44.906578 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfd475-aa1a-4f60-bf01-99e77436ae8b admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:44.907006 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfd475-aa1a-4f60-bf01-99e77436ae8b admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:44.907425 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfd475-aa1a-4f60-bf01-99e77436ae8b admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:44.908296 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfd475-aa1a-4f60-bf01-99e77436ae8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:44.910308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfd475-aa1a-4f60-bf01-99e77436ae8b admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:44.925187 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 981/1960] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:49:44.929408 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc47004-2898-4266-91ac-15462505e2ed admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:44.939903 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc47004-2898-4266-91ac-15462505e2ed admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:44.947426 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4c4fe-c52c-4564-b217-4ff7cb67a684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:44.947426 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4c4fe-c52c-4564-b217-4ff7cb67a684 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:44.947426 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4c4fe-c52c-4564-b217-4ff7cb67a684 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:44.947426 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4c4fe-c52c-4564-b217-4ff7cb67a684 admin admin] PATH_INFO: `/v3/projects/da6c1bb720b344b9845e70d7212c041f/users/65b70cd60d824b278a24ee5e812fc72c/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:44.948547 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b4c4fe-c52c-4564-b217-4ff7cb67a684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da6c1bb720b344b9845e70d7212c041f, user_id=65b70cd60d824b278a24ee5e812fc72c, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:44.949375 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfd475-aa1a-4f60-bf01-99e77436ae8b admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:44.951465 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b4c4fe-c52c-4564-b217-4ff7cb67a684 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:44.960995 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfd475-aa1a-4f60-bf01-99e77436ae8b admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:44.973894 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 980/1961] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:49:44 2022] PUT /identity/v3/projects/da6c1bb720b344b9845e70d7212c041f/users/65b70cd60d824b278a24ee5e812fc72c/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:44.976878 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a9e6f-dc4d-4989-9c3c-2293d37d2125 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:44.977353 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a9e6f-dc4d-4989-9c3c-2293d37d2125 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:44.977641 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a9e6f-dc4d-4989-9c3c-2293d37d2125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:45.007198 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-c24a9e6f-dc4d-4989-9c3c-2293d37d2125 None None] MFA Rules not processed for user `65b70cd60d824b278a24ee5e812fc72c`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:45.008642 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-c24a9e6f-dc4d-4989-9c3c-2293d37d2125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:45.027076 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9e827-31b9-4485-a88a-297f578b3cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:45.028187 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9e827-31b9-4485-a88a-297f578b3cfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:45.028467 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9e827-31b9-4485-a88a-297f578b3cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:45.030345 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9e827-31b9-4485-a88a-297f578b3cfe admin admin] PATH_INFO: `/v3/users/87fdb75f3a304c68ac64368ed8e54e62` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:45.031826 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9e827-31b9-4485-a88a-297f578b3cfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=87fdb75f3a304c68ac64368ed8e54e62)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:45.033779 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9e827-31b9-4485-a88a-297f578b3cfe admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:45.077831 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:45.093295 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-6ac9e827-31b9-4485-a88a-297f578b3cfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87fdb75f3a304c68ac64368ed8e54e62'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:45.097055 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 981/1962] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:44 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:49:45.108381 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a9e6f-dc4d-4989-9c3c-2293d37d2125 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:45.109636 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-6ac9e827-31b9-4485-a88a-297f578b3cfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87fdb75f3a304c68ac64368ed8e54e62'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:45.116926 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-6ac9e827-31b9-4485-a88a-297f578b3cfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87fdb75f3a304c68ac64368ed8e54e62'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:45.117713 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-6ac9e827-31b9-4485-a88a-297f578b3cfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87fdb75f3a304c68ac64368ed8e54e62'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:45.118364 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-6ac9e827-31b9-4485-a88a-297f578b3cfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87fdb75f3a304c68ac64368ed8e54e62'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:45.132717 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 982/1963] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:49:44 2022] DELETE /identity/v3/users/87fdb75f3a304c68ac64368ed8e54e62 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:45.137240 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25c460-699c-4d9a-bdac-dc8dcb963baa None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:45.137532 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25c460-699c-4d9a-bdac-dc8dcb963baa None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:45.137835 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25c460-699c-4d9a-bdac-dc8dcb963baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:45.162847 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-5c25c460-699c-4d9a-bdac-dc8dcb963baa None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:45.164080 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-5c25c460-699c-4d9a-bdac-dc8dcb963baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:45.166666 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a9e6f-dc4d-4989-9c3c-2293d37d2125 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:45.223051 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937bd471-7b13-414e-ac85-678c6aad3aab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:45.223954 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937bd471-7b13-414e-ac85-678c6aad3aab service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:45.224236 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937bd471-7b13-414e-ac85-678c6aad3aab service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:45.224512 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937bd471-7b13-414e-ac85-678c6aad3aab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:45.226383 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-937bd471-7b13-414e-ac85-678c6aad3aab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:45.227667 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 983/1964] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:45.237884 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25c460-699c-4d9a-bdac-dc8dcb963baa None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:45.239213 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-5c25c460-699c-4d9a-bdac-dc8dcb963baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:45.261096 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:45.292799 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937bd471-7b13-414e-ac85-678c6aad3aab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:45.294311 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937bd471-7b13-414e-ac85-678c6aad3aab service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:45.300018 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25c460-699c-4d9a-bdac-dc8dcb963baa None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:45.303612 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc19e3-22a6-416a-b2ca-3e6cc043269c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:45.304247 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc19e3-22a6-416a-b2ca-3e6cc043269c service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:45.304599 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc19e3-22a6-416a-b2ca-3e6cc043269c service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:45.304918 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 982/1965] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:45 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:49:45.305032 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc19e3-22a6-416a-b2ca-3e6cc043269c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:45.318855 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc19e3-22a6-416a-b2ca-3e6cc043269c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:45.320473 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc19e3-22a6-416a-b2ca-3e6cc043269c service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:45.332416 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 984/1966] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:49:45.399216 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937bd471-7b13-414e-ac85-678c6aad3aab service cinder] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:45.402048 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-937bd471-7b13-414e-ac85-678c6aad3aab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:45.424369 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937bd471-7b13-414e-ac85-678c6aad3aab service cinder] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:45.429113 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b30e9-71ad-4e37-9769-3acc1612b17e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:45.429914 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b30e9-71ad-4e37-9769-3acc1612b17e service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:45.430243 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b30e9-71ad-4e37-9769-3acc1612b17e service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:45.430649 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b30e9-71ad-4e37-9769-3acc1612b17e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:45.432894 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-1d7b30e9-71ad-4e37-9769-3acc1612b17e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:45.507460 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b30e9-71ad-4e37-9769-3acc1612b17e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:45.509209 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b30e9-71ad-4e37-9769-3acc1612b17e service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:45.519936 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 983/1967] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:45 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:49:45.647964 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc19e3-22a6-416a-b2ca-3e6cc043269c service neutron] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:45.649546 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-cbcc19e3-22a6-416a-b2ca-3e6cc043269c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:45.663695 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc19e3-22a6-416a-b2ca-3e6cc043269c service neutron] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:45.668962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd1203-3ae0-4d68-92ca-6b8f8161fce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:45.670575 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd1203-3ae0-4d68-92ca-6b8f8161fce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:45.670975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd1203-3ae0-4d68-92ca-6b8f8161fce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:45.671318 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd1203-3ae0-4d68-92ca-6b8f8161fce9 admin admin] PATH_INFO: `/v3/projects/4db69e8fe7084ba9929e8690ebf2b749` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:45.672648 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd1203-3ae0-4d68-92ca-6b8f8161fce9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4db69e8fe7084ba9929e8690ebf2b749)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:45.674693 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd1203-3ae0-4d68-92ca-6b8f8161fce9 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:45.739729 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:45.742904 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-40cd1203-3ae0-4d68-92ca-6b8f8161fce9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4db69e8fe7084ba9929e8690ebf2b749', 'request_id': 'req-40cd1203-3ae0-4d68-92ca-6b8f8161fce9'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:45.754947 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-40cd1203-3ae0-4d68-92ca-6b8f8161fce9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4db69e8fe7084ba9929e8690ebf2b749', 'request_id': 'req-40cd1203-3ae0-4d68-92ca-6b8f8161fce9'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:45.765583 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-40cd1203-3ae0-4d68-92ca-6b8f8161fce9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4db69e8fe7084ba9929e8690ebf2b749', 'request_id': 'req-40cd1203-3ae0-4d68-92ca-6b8f8161fce9'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:45.783235 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-40cd1203-3ae0-4d68-92ca-6b8f8161fce9 admin admin] The token cache is being invalidate because project 4db69e8fe7084ba9929e8690ebf2b749 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:49:45.783658 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-40cd1203-3ae0-4d68-92ca-6b8f8161fce9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:45.784574 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-40cd1203-3ae0-4d68-92ca-6b8f8161fce9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:45.786893 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 985/1968] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:49:45 2022] DELETE /identity/v3/projects/4db69e8fe7084ba9929e8690ebf2b749 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:45.791126 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b30e9-71ad-4e37-9769-3acc1612b17e service cinder] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:45.804869 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b30e9-71ad-4e37-9769-3acc1612b17e service cinder] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:45.933374 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7627e2f-6ce5-4e00-aa1c-c809d98c6853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:45.935329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7627e2f-6ce5-4e00-aa1c-c809d98c6853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:45.936049 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7627e2f-6ce5-4e00-aa1c-c809d98c6853 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:45.936479 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7627e2f-6ce5-4e00-aa1c-c809d98c6853 admin admin] PATH_INFO: `/v3/users/e84697e55b2642d1b27ccb20c660269c` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:45.937970 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7627e2f-6ce5-4e00-aa1c-c809d98c6853 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e84697e55b2642d1b27ccb20c660269c)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:45.940301 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7627e2f-6ce5-4e00-aa1c-c809d98c6853 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:45.994359 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-d7627e2f-6ce5-4e00-aa1c-c809d98c6853 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e84697e55b2642d1b27ccb20c660269c'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:46.002116 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-d7627e2f-6ce5-4e00-aa1c-c809d98c6853 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e84697e55b2642d1b27ccb20c660269c'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:46.016006 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:46.018151 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-d7627e2f-6ce5-4e00-aa1c-c809d98c6853 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e84697e55b2642d1b27ccb20c660269c'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:46.018964 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-d7627e2f-6ce5-4e00-aa1c-c809d98c6853 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e84697e55b2642d1b27ccb20c660269c'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:46.020132 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-d7627e2f-6ce5-4e00-aa1c-c809d98c6853 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e84697e55b2642d1b27ccb20c660269c'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:46.036694 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 984/1969] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:49:45 2022] DELETE /identity/v3/users/e84697e55b2642d1b27ccb20c660269c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:46.327623 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd1203-3ae0-4d68-92ca-6b8f8161fce9 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:46.329319 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-40cd1203-3ae0-4d68-92ca-6b8f8161fce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:46.343490 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd1203-3ae0-4d68-92ca-6b8f8161fce9 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:46.412708 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfb6cb-9644-431d-96b3-6ca52911a157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:46.413570 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfb6cb-9644-431d-96b3-6ca52911a157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:46.413905 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfb6cb-9644-431d-96b3-6ca52911a157 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:46.414158 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfb6cb-9644-431d-96b3-6ca52911a157 admin admin] PATH_INFO: `/v3/projects/8d278bcdb72246c4b34ea356d62860dd` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:46.415712 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cfb6cb-9644-431d-96b3-6ca52911a157 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d278bcdb72246c4b34ea356d62860dd)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:46.417680 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cfb6cb-9644-431d-96b3-6ca52911a157 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:46.471945 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-11cfb6cb-9644-431d-96b3-6ca52911a157 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d278bcdb72246c4b34ea356d62860dd', 'request_id': 'req-11cfb6cb-9644-431d-96b3-6ca52911a157'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:46.478192 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-11cfb6cb-9644-431d-96b3-6ca52911a157 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d278bcdb72246c4b34ea356d62860dd', 'request_id': 'req-11cfb6cb-9644-431d-96b3-6ca52911a157'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:46.488267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-11cfb6cb-9644-431d-96b3-6ca52911a157 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d278bcdb72246c4b34ea356d62860dd', 'request_id': 'req-11cfb6cb-9644-431d-96b3-6ca52911a157'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:46.503018 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-11cfb6cb-9644-431d-96b3-6ca52911a157 admin admin] The token cache is being invalidate because project 8d278bcdb72246c4b34ea356d62860dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:49:46.503260 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-11cfb6cb-9644-431d-96b3-6ca52911a157 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:46.503972 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-11cfb6cb-9644-431d-96b3-6ca52911a157 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:46.505671 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 986/1970] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:49:46 2022] DELETE /identity/v3/projects/8d278bcdb72246c4b34ea356d62860dd => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:46.510796 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88c446-ff4f-41b3-a784-080830a56496 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:46.511085 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88c446-ff4f-41b3-a784-080830a56496 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:46.511364 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88c446-ff4f-41b3-a784-080830a56496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:46.531803 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-9d88c446-ff4f-41b3-a784-080830a56496 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:46.533199 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-9d88c446-ff4f-41b3-a784-080830a56496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:46.599731 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 985/1971] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:46.607915 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f4875-edf5-401b-b18b-51d69d5d4647 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:46.608199 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f4875-edf5-401b-b18b-51d69d5d4647 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:46.608474 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f4875-edf5-401b-b18b-51d69d5d4647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:46.634245 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-9b8f4875-edf5-401b-b18b-51d69d5d4647 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:46.635606 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-9b8f4875-edf5-401b-b18b-51d69d5d4647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:46.646366 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 987/1972] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:46.650978 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88c446-ff4f-41b3-a784-080830a56496 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:46.662119 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88c446-ff4f-41b3-a784-080830a56496 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:46.667339 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee48e41-21af-4718-b248-fa8e409b2d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:46.668019 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee48e41-21af-4718-b248-fa8e409b2d6b admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:46.668297 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee48e41-21af-4718-b248-fa8e409b2d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:46.669104 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee48e41-21af-4718-b248-fa8e409b2d6b admin admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:46.669299 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee48e41-21af-4718-b248-fa8e409b2d6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:49:46.669657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee48e41-21af-4718-b248-fa8e409b2d6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:46.671362 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee48e41-21af-4718-b248-fa8e409b2d6b admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:46.684586 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 986/1973] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:49:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:49:46.689109 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f4875-edf5-401b-b18b-51d69d5d4647 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:46.698431 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f4875-edf5-401b-b18b-51d69d5d4647 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:46.703092 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c1c97-7a06-4576-8123-0f4c99ec10af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:46.703740 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c1c97-7a06-4576-8123-0f4c99ec10af admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:46.704017 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c1c97-7a06-4576-8123-0f4c99ec10af admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:46.704288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c1c97-7a06-4576-8123-0f4c99ec10af admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:46.704983 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c1c97-7a06-4576-8123-0f4c99ec10af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:46.706937 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c1c97-7a06-4576-8123-0f4c99ec10af admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:46.736028 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 988/1974] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:49:46 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:49:46.740166 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee48e41-21af-4718-b248-fa8e409b2d6b admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:46.750461 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee48e41-21af-4718-b248-fa8e409b2d6b admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:46.817116 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7ee64-2fa2-4524-b618-7006dd34d674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:46.817821 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7ee64-2fa2-4524-b618-7006dd34d674 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:46.818141 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7ee64-2fa2-4524-b618-7006dd34d674 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:46.818414 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7ee64-2fa2-4524-b618-7006dd34d674 admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:46.819114 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d7ee64-2fa2-4524-b618-7006dd34d674 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:46.821102 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d7ee64-2fa2-4524-b618-7006dd34d674 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:46.856340 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 987/1975] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:49:46 2022] POST /identity/v3/users => generated 290 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:49:46.860725 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c1c97-7a06-4576-8123-0f4c99ec10af admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:46.879649 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c1c97-7a06-4576-8123-0f4c99ec10af admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:46.888177 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8dba10-a6f1-40aa-968b-80e169ca3e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:46.889021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dba10-a6f1-40aa-968b-80e169ca3e4a admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:46.889482 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dba10-a6f1-40aa-968b-80e169ca3e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:46.892525 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dba10-a6f1-40aa-968b-80e169ca3e4a admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:46.893570 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8dba10-a6f1-40aa-968b-80e169ca3e4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:46.895376 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8dba10-a6f1-40aa-968b-80e169ca3e4a admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:46.919842 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 989/1976] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:49:46.921371 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7ee64-2fa2-4524-b618-7006dd34d674 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:46.937226 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7ee64-2fa2-4524-b618-7006dd34d674 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:46.948335 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764f647-c529-4dce-a9e4-8954a34b650c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:46.949027 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764f647-c529-4dce-a9e4-8954a34b650c admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:46.949307 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764f647-c529-4dce-a9e4-8954a34b650c admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:46.949575 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764f647-c529-4dce-a9e4-8954a34b650c admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:46.953078 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764f647-c529-4dce-a9e4-8954a34b650c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:46.953078 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764f647-c529-4dce-a9e4-8954a34b650c admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:46.984644 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 988/1977] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:49:46.986998 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8dba10-a6f1-40aa-968b-80e169ca3e4a admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:47.004464 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8dba10-a6f1-40aa-968b-80e169ca3e4a admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:47.030544 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da105a47-09d2-42c8-b79a-bde121ab07d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:47.032014 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da105a47-09d2-42c8-b79a-bde121ab07d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:47.032736 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da105a47-09d2-42c8-b79a-bde121ab07d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:47.033315 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da105a47-09d2-42c8-b79a-bde121ab07d7 admin admin] PATH_INFO: `/v3/projects/958221837006453cbb79b4dd4147cb03/users/9b3d935fa91f4e29afc3d67e77cb6eab/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:47.053021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da105a47-09d2-42c8-b79a-bde121ab07d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=958221837006453cbb79b4dd4147cb03, user_id=9b3d935fa91f4e29afc3d67e77cb6eab, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:47.055788 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da105a47-09d2-42c8-b79a-bde121ab07d7 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:47.076280 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 990/1978] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:49:46 2022] PUT /identity/v3/projects/958221837006453cbb79b4dd4147cb03/users/9b3d935fa91f4e29afc3d67e77cb6eab/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:47.087762 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5883c6d-7397-4552-888e-1a95d1abbabf None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:47.088418 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5883c6d-7397-4552-888e-1a95d1abbabf None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:47.088800 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5883c6d-7397-4552-888e-1a95d1abbabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:47.119601 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-f5883c6d-7397-4552-888e-1a95d1abbabf None None] MFA Rules not processed for user `9b3d935fa91f4e29afc3d67e77cb6eab`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:47.120889 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-f5883c6d-7397-4552-888e-1a95d1abbabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:47.184064 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:47.220823 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 989/1979] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:47.225421 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da105a47-09d2-42c8-b79a-bde121ab07d7 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:47.231127 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:47.315850 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da105a47-09d2-42c8-b79a-bde121ab07d7 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:47.321378 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57a6de-ffea-48db-853c-7c3fac830766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:47.321378 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57a6de-ffea-48db-853c-7c3fac830766 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:47.321602 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57a6de-ffea-48db-853c-7c3fac830766 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:47.321819 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57a6de-ffea-48db-853c-7c3fac830766 admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:47.322570 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57a6de-ffea-48db-853c-7c3fac830766 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:47.324637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57a6de-ffea-48db-853c-7c3fac830766 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:47.355264 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 991/1980] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:49:47 2022] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:49:47.359489 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5883c6d-7397-4552-888e-1a95d1abbabf None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:47.371336 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5883c6d-7397-4552-888e-1a95d1abbabf None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:47.484241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963a3bf-7ca0-40eb-a6f8-3ca33df2e9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:47.484947 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963a3bf-7ca0-40eb-a6f8-3ca33df2e9ce admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:47.485232 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963a3bf-7ca0-40eb-a6f8-3ca33df2e9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:47.485509 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963a3bf-7ca0-40eb-a6f8-3ca33df2e9ce admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:47.486267 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963a3bf-7ca0-40eb-a6f8-3ca33df2e9ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:47.488403 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963a3bf-7ca0-40eb-a6f8-3ca33df2e9ce admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:47.515728 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 990/1981] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:49:47 2022] POST /identity/v3/users => generated 297 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:49:47.516970 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57a6de-ffea-48db-853c-7c3fac830766 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:47.527831 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57a6de-ffea-48db-853c-7c3fac830766 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:47.532869 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d542b-bda1-4f36-a3a6-4b3f66df3af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:47.533640 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d542b-bda1-4f36-a3a6-4b3f66df3af9 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:47.534111 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d542b-bda1-4f36-a3a6-4b3f66df3af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:47.534371 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d542b-bda1-4f36-a3a6-4b3f66df3af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:47.535165 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d542b-bda1-4f36-a3a6-4b3f66df3af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:47.536975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d542b-bda1-4f36-a3a6-4b3f66df3af9 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:47.549885 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 992/1982] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:49:47.553015 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963a3bf-7ca0-40eb-a6f8-3ca33df2e9ce admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:47.565473 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963a3bf-7ca0-40eb-a6f8-3ca33df2e9ce admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:47.571591 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054023d4-ae8a-4ae1-969b-48231223e6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:47.572609 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054023d4-ae8a-4ae1-969b-48231223e6e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:47.572964 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054023d4-ae8a-4ae1-969b-48231223e6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:47.573316 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054023d4-ae8a-4ae1-969b-48231223e6e5 admin admin] PATH_INFO: `/v3/projects/a23f6ca0400a482ba19138455eec553c/users/162be2b5c526463ab318f9bf44cdf346/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:47.591574 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054023d4-ae8a-4ae1-969b-48231223e6e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a23f6ca0400a482ba19138455eec553c, user_id=162be2b5c526463ab318f9bf44cdf346, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:47.594710 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054023d4-ae8a-4ae1-969b-48231223e6e5 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:47.613087 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 991/1983] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:49:47 2022] PUT /identity/v3/projects/a23f6ca0400a482ba19138455eec553c/users/162be2b5c526463ab318f9bf44cdf346/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:49:47.616907 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d542b-bda1-4f36-a3a6-4b3f66df3af9 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:47.627408 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d542b-bda1-4f36-a3a6-4b3f66df3af9 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:47.702059 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d5287-9b6a-47f1-884e-50ec94eab43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:47.703583 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d5287-9b6a-47f1-884e-50ec94eab43f admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:47.704060 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d5287-9b6a-47f1-884e-50ec94eab43f admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:47.704582 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d5287-9b6a-47f1-884e-50ec94eab43f admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:47.705593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d5287-9b6a-47f1-884e-50ec94eab43f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:47.707564 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d5287-9b6a-47f1-884e-50ec94eab43f admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:47.722250 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 993/1984] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:47 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:49:47.723058 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054023d4-ae8a-4ae1-969b-48231223e6e5 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:47.734158 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054023d4-ae8a-4ae1-969b-48231223e6e5 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:47.739013 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c2869-cd05-4917-a03e-38ab53548344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:47.740533 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c2869-cd05-4917-a03e-38ab53548344 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:47.741330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c2869-cd05-4917-a03e-38ab53548344 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:47.741330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c2869-cd05-4917-a03e-38ab53548344 admin admin] PATH_INFO: `/v3/projects/a23f6ca0400a482ba19138455eec553c/users/162be2b5c526463ab318f9bf44cdf346/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:47.743348 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c2869-cd05-4917-a03e-38ab53548344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a23f6ca0400a482ba19138455eec553c, user_id=162be2b5c526463ab318f9bf44cdf346, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:47.746333 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c2869-cd05-4917-a03e-38ab53548344 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:47.761343 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 992/1985] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:49:47 2022] PUT /identity/v3/projects/a23f6ca0400a482ba19138455eec553c/users/162be2b5c526463ab318f9bf44cdf346/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:49:47.771661 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea24e76-b234-416b-b0bd-4f7e7d11f2c2 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:47.771958 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea24e76-b234-416b-b0bd-4f7e7d11f2c2 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:47.772238 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea24e76-b234-416b-b0bd-4f7e7d11f2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:47.803712 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-aea24e76-b234-416b-b0bd-4f7e7d11f2c2 None None] MFA Rules not processed for user `162be2b5c526463ab318f9bf44cdf346`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:47.804579 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-aea24e76-b234-416b-b0bd-4f7e7d11f2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:47.877820 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:47.887905 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 994/1986] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:47.896127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c2869-cd05-4917-a03e-38ab53548344 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:47.897874 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-722c2869-cd05-4917-a03e-38ab53548344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:47.970724 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c2869-cd05-4917-a03e-38ab53548344 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:47.975451 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c2283-b2fa-4d69-923b-bac7b84e2bd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:47.976126 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c2283-b2fa-4d69-923b-bac7b84e2bd6 service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:47.976408 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c2283-b2fa-4d69-923b-bac7b84e2bd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:47.976716 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c2283-b2fa-4d69-923b-bac7b84e2bd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:47.991063 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c2283-b2fa-4d69-923b-bac7b84e2bd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:47.992537 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c2283-b2fa-4d69-923b-bac7b84e2bd6 service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:48.008049 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 993/1987] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:47 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:49:48.435654 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea24e76-b234-416b-b0bd-4f7e7d11f2c2 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:48.551966 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea24e76-b234-416b-b0bd-4f7e7d11f2c2 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:48.556434 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f464b0-5696-4cd0-b9d2-18272dacd115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:48.557317 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f464b0-5696-4cd0-b9d2-18272dacd115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:48.557591 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f464b0-5696-4cd0-b9d2-18272dacd115 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:48.557949 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f464b0-5696-4cd0-b9d2-18272dacd115 admin admin] PATH_INFO: `/v3/users/9b3d935fa91f4e29afc3d67e77cb6eab` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:48.559077 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f464b0-5696-4cd0-b9d2-18272dacd115 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b3d935fa91f4e29afc3d67e77cb6eab)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:48.561064 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f464b0-5696-4cd0-b9d2-18272dacd115 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:48.632377 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-d3f464b0-5696-4cd0-b9d2-18272dacd115 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b3d935fa91f4e29afc3d67e77cb6eab'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:48.652621 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-d3f464b0-5696-4cd0-b9d2-18272dacd115 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b3d935fa91f4e29afc3d67e77cb6eab'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:48.661403 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-d3f464b0-5696-4cd0-b9d2-18272dacd115 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b3d935fa91f4e29afc3d67e77cb6eab'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:48.662177 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-d3f464b0-5696-4cd0-b9d2-18272dacd115 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b3d935fa91f4e29afc3d67e77cb6eab'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:48.662784 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-d3f464b0-5696-4cd0-b9d2-18272dacd115 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b3d935fa91f4e29afc3d67e77cb6eab'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:48.690402 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 995/1988] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:49:48 2022] DELETE /identity/v3/users/9b3d935fa91f4e29afc3d67e77cb6eab => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:48.695266 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74326296-5631-45c6-9185-d9093cf35652 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:48.695549 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74326296-5631-45c6-9185-d9093cf35652 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:48.696006 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74326296-5631-45c6-9185-d9093cf35652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:48.751913 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-74326296-5631-45c6-9185-d9093cf35652 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:48.753474 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-74326296-5631-45c6-9185-d9093cf35652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:48.834048 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:48.890766 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 994/1989] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:48.899289 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f464b0-5696-4cd0-b9d2-18272dacd115 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:48.901149 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-d3f464b0-5696-4cd0-b9d2-18272dacd115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:49.014396 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f464b0-5696-4cd0-b9d2-18272dacd115 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:49.026506 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f3a3a-35ce-488d-835a-af4bb6503e32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:49.027230 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f3a3a-35ce-488d-835a-af4bb6503e32 service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:49.027503 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f3a3a-35ce-488d-835a-af4bb6503e32 service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:49.027803 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f3a3a-35ce-488d-835a-af4bb6503e32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:49.046891 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f3a3a-35ce-488d-835a-af4bb6503e32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:49.048280 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f3a3a-35ce-488d-835a-af4bb6503e32 service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:49.063524 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 996/1990] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:49:49.478377 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74326296-5631-45c6-9185-d9093cf35652 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:49.479937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-74326296-5631-45c6-9185-d9093cf35652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:49.497081 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74326296-5631-45c6-9185-d9093cf35652 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:49.502285 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f7760-0020-42d0-96e1-6b34a9fb9762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:49.503338 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f7760-0020-42d0-96e1-6b34a9fb9762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:49.503774 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f7760-0020-42d0-96e1-6b34a9fb9762 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:49.504043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f7760-0020-42d0-96e1-6b34a9fb9762 admin admin] PATH_INFO: `/v3/projects/958221837006453cbb79b4dd4147cb03` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:49.505283 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f7760-0020-42d0-96e1-6b34a9fb9762 admin admin] RBAC: Authorizing `identity:delete_project(project_id=958221837006453cbb79b4dd4147cb03)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:49.508547 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f7760-0020-42d0-96e1-6b34a9fb9762 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:49.569572 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-e54f7760-0020-42d0-96e1-6b34a9fb9762 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '958221837006453cbb79b4dd4147cb03', 'request_id': 'req-e54f7760-0020-42d0-96e1-6b34a9fb9762'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:49.578713 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-e54f7760-0020-42d0-96e1-6b34a9fb9762 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '958221837006453cbb79b4dd4147cb03', 'request_id': 'req-e54f7760-0020-42d0-96e1-6b34a9fb9762'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:49.589264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-e54f7760-0020-42d0-96e1-6b34a9fb9762 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '958221837006453cbb79b4dd4147cb03', 'request_id': 'req-e54f7760-0020-42d0-96e1-6b34a9fb9762'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:49.605054 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55738e46-8eac-491e-a540-f38a22467c6b None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:49.605799 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55738e46-8eac-491e-a540-f38a22467c6b None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:49.606290 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55738e46-8eac-491e-a540-f38a22467c6b None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:49.607143 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-e54f7760-0020-42d0-96e1-6b34a9fb9762 admin admin] The token cache is being invalidate because project 958221837006453cbb79b4dd4147cb03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:49:49.607688 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-e54f7760-0020-42d0-96e1-6b34a9fb9762 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:49.609043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-e54f7760-0020-42d0-96e1-6b34a9fb9762 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:49.610121 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 997/1991] 10.222.0.27 () {54 vars in 921 bytes} [Tue Jul 5 20:49:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 05 20:49:49.616048 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 995/1992] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:49:49 2022] DELETE /identity/v3/projects/958221837006453cbb79b4dd4147cb03 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:49.619695 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55738e46-8eac-491e-a540-f38a22467c6b None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:49.622265 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-55738e46-8eac-491e-a540-f38a22467c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:49.625737 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e933e29-7ce1-48a7-8995-f141ee824a2c None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:49.626050 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e933e29-7ce1-48a7-8995-f141ee824a2c None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:49.626659 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e933e29-7ce1-48a7-8995-f141ee824a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:49.659686 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-3e933e29-7ce1-48a7-8995-f141ee824a2c None None] MFA Rules not processed for user `16662dd5e2e74163b6aa2e1e7ef07524`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:49.662139 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:49.667578 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-3e933e29-7ce1-48a7-8995-f141ee824a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:49.727352 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55738e46-8eac-491e-a540-f38a22467c6b None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:49.733731 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982bca0-1cc2-4c5e-b8f5-9ea90e5b5121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:49.734745 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982bca0-1cc2-4c5e-b8f5-9ea90e5b5121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:49.735032 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982bca0-1cc2-4c5e-b8f5-9ea90e5b5121 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:49.735334 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982bca0-1cc2-4c5e-b8f5-9ea90e5b5121 admin admin] PATH_INFO: `/v3/users/162be2b5c526463ab318f9bf44cdf346` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:49.736590 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982bca0-1cc2-4c5e-b8f5-9ea90e5b5121 admin admin] RBAC: Authorizing `identity:delete_user(user_id=162be2b5c526463ab318f9bf44cdf346)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:49.738875 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982bca0-1cc2-4c5e-b8f5-9ea90e5b5121 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:49.769176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 996/1993] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Jul 5 20:49:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:49.770977 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e933e29-7ce1-48a7-8995-f141ee824a2c None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:49.773124 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-3e933e29-7ce1-48a7-8995-f141ee824a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:49.789696 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e933e29-7ce1-48a7-8995-f141ee824a2c None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:49.796740 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a3392-f0d8-4739-9377-966e899ffa95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:49.797894 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a3392-f0d8-4739-9377-966e899ffa95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:49.798394 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a3392-f0d8-4739-9377-966e899ffa95 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:49.798702 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a3392-f0d8-4739-9377-966e899ffa95 admin admin] PATH_INFO: `/v3/users/f240a106d1814e0b919b222517c8c381` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:49.800792 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a3392-f0d8-4739-9377-966e899ffa95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f240a106d1814e0b919b222517c8c381)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:49.801313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c982bca0-1cc2-4c5e-b8f5-9ea90e5b5121 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '162be2b5c526463ab318f9bf44cdf346'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:49.803204 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a3392-f0d8-4739-9377-966e899ffa95 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:49.816340 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c982bca0-1cc2-4c5e-b8f5-9ea90e5b5121 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '162be2b5c526463ab318f9bf44cdf346'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:49.824996 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c982bca0-1cc2-4c5e-b8f5-9ea90e5b5121 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '162be2b5c526463ab318f9bf44cdf346'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:49.825819 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c982bca0-1cc2-4c5e-b8f5-9ea90e5b5121 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '162be2b5c526463ab318f9bf44cdf346'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:49.826583 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c982bca0-1cc2-4c5e-b8f5-9ea90e5b5121 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '162be2b5c526463ab318f9bf44cdf346'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:49.845816 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 998/1994] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:49:49 2022] DELETE /identity/v3/users/162be2b5c526463ab318f9bf44cdf346 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:49:49.846793 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982bca0-1cc2-4c5e-b8f5-9ea90e5b5121 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:49.859201 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-c982bca0-1cc2-4c5e-b8f5-9ea90e5b5121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:49.875463 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-7b6a3392-f0d8-4739-9377-966e899ffa95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f240a106d1814e0b919b222517c8c381'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:49.881429 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:49.885923 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-7b6a3392-f0d8-4739-9377-966e899ffa95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f240a106d1814e0b919b222517c8c381'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:49.903358 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-7b6a3392-f0d8-4739-9377-966e899ffa95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f240a106d1814e0b919b222517c8c381'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:49.904260 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-7b6a3392-f0d8-4739-9377-966e899ffa95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f240a106d1814e0b919b222517c8c381'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:49.904998 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-7b6a3392-f0d8-4739-9377-966e899ffa95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f240a106d1814e0b919b222517c8c381'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:49.932569 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 997/1995] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:49:49 2022] DELETE /identity/v3/users/f240a106d1814e0b919b222517c8c381 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:49.965582 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982bca0-1cc2-4c5e-b8f5-9ea90e5b5121 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:50.018884 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:50.047470 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d57696-1b7f-4f22-bd4b-b7860e390528 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16662dd5e2e74163b6aa2e1e7ef07524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:50.048200 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d57696-1b7f-4f22-bd4b-b7860e390528 service placement] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:50.048790 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d57696-1b7f-4f22-bd4b-b7860e390528 service placement] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:50.048790 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d57696-1b7f-4f22-bd4b-b7860e390528 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:50.053634 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-24d57696-1b7f-4f22-bd4b-b7860e390528 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:50.066231 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d57696-1b7f-4f22-bd4b-b7860e390528 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:50.068192 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d57696-1b7f-4f22-bd4b-b7860e390528 service placement] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:50.080578 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 999/1996] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:49:50.270471 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a3392-f0d8-4739-9377-966e899ffa95 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:50.272089 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-7b6a3392-f0d8-4739-9377-966e899ffa95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:50.280069 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d57696-1b7f-4f22-bd4b-b7860e390528 service placement] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:50.281515 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-24d57696-1b7f-4f22-bd4b-b7860e390528 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:50.356462 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a3392-f0d8-4739-9377-966e899ffa95 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:50.361463 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d2d91-78e7-42af-9183-2c3c6672bf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:50.362368 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d2d91-78e7-42af-9183-2c3c6672bf9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:50.362653 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d2d91-78e7-42af-9183-2c3c6672bf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:50.362936 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d2d91-78e7-42af-9183-2c3c6672bf9b admin admin] PATH_INFO: `/v3/projects/a23f6ca0400a482ba19138455eec553c` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:50.364135 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d2d91-78e7-42af-9183-2c3c6672bf9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a23f6ca0400a482ba19138455eec553c)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:50.366089 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d2d91-78e7-42af-9183-2c3c6672bf9b admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:50.368304 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d57696-1b7f-4f22-bd4b-b7860e390528 service placement] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:50.375615 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1f516-b2a8-4f94-909c-d68c1a7281e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:50.376534 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1f516-b2a8-4f94-909c-d68c1a7281e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:50.376807 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1f516-b2a8-4f94-909c-d68c1a7281e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:50.377076 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1f516-b2a8-4f94-909c-d68c1a7281e7 admin admin] PATH_INFO: `/v3/projects/3bd1fbab26fd4467a70369892dc4babe` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:50.378393 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1f516-b2a8-4f94-909c-d68c1a7281e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bd1fbab26fd4467a70369892dc4babe)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:50.380320 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1f516-b2a8-4f94-909c-d68c1a7281e7 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:50.428270 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-334d2d91-78e7-42af-9183-2c3c6672bf9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a23f6ca0400a482ba19138455eec553c', 'request_id': 'req-334d2d91-78e7-42af-9183-2c3c6672bf9b'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:50.434136 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-334d2d91-78e7-42af-9183-2c3c6672bf9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a23f6ca0400a482ba19138455eec553c', 'request_id': 'req-334d2d91-78e7-42af-9183-2c3c6672bf9b'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:50.434850 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c3e1f516-b2a8-4f94-909c-d68c1a7281e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bd1fbab26fd4467a70369892dc4babe', 'request_id': 'req-c3e1f516-b2a8-4f94-909c-d68c1a7281e7'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:50.440769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c3e1f516-b2a8-4f94-909c-d68c1a7281e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bd1fbab26fd4467a70369892dc4babe', 'request_id': 'req-c3e1f516-b2a8-4f94-909c-d68c1a7281e7'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:50.442202 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-334d2d91-78e7-42af-9183-2c3c6672bf9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a23f6ca0400a482ba19138455eec553c', 'request_id': 'req-334d2d91-78e7-42af-9183-2c3c6672bf9b'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:50.448428 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c3e1f516-b2a8-4f94-909c-d68c1a7281e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bd1fbab26fd4467a70369892dc4babe', 'request_id': 'req-c3e1f516-b2a8-4f94-909c-d68c1a7281e7'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:50.457154 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-334d2d91-78e7-42af-9183-2c3c6672bf9b admin admin] The token cache is being invalidate because project a23f6ca0400a482ba19138455eec553c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:49:50.457444 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-334d2d91-78e7-42af-9183-2c3c6672bf9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:50.458319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-334d2d91-78e7-42af-9183-2c3c6672bf9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:50.463904 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 998/1997] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:49:50 2022] DELETE /identity/v3/projects/a23f6ca0400a482ba19138455eec553c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:49:50.464073 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c3e1f516-b2a8-4f94-909c-d68c1a7281e7 admin admin] The token cache is being invalidate because project 3bd1fbab26fd4467a70369892dc4babe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:49:50.464238 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c3e1f516-b2a8-4f94-909c-d68c1a7281e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:50.464885 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c3e1f516-b2a8-4f94-909c-d68c1a7281e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:50.465927 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670de79-33c7-45b9-a081-cfff2fbd48ae None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:50.466272 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670de79-33c7-45b9-a081-cfff2fbd48ae None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:50.466510 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1000/1998] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:49:50 2022] DELETE /identity/v3/projects/3bd1fbab26fd4467a70369892dc4babe => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:50.466619 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670de79-33c7-45b9-a081-cfff2fbd48ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:50.472025 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c6955-fb4f-44aa-8635-d03756a2c2da None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:50.472483 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c6955-fb4f-44aa-8635-d03756a2c2da None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:50.472855 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c6955-fb4f-44aa-8635-d03756a2c2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:50.486877 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-7670de79-33c7-45b9-a081-cfff2fbd48ae None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:50.488076 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-7670de79-33c7-45b9-a081-cfff2fbd48ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:50.491227 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-560c6955-fb4f-44aa-8635-d03756a2c2da None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:50.492396 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-560c6955-fb4f-44aa-8635-d03756a2c2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:50.548380 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 999/1999] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:50.555947 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1001/2000] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:50.556702 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f904e-eb25-4410-82ae-5ee09163746c None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:50.557104 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f904e-eb25-4410-82ae-5ee09163746c None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:50.557384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f904e-eb25-4410-82ae-5ee09163746c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:50.563710 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:50.564622 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fc09b-9993-42e6-8285-31b292673af4 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:50.564622 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fc09b-9993-42e6-8285-31b292673af4 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:50.564835 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fc09b-9993-42e6-8285-31b292673af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:50.571227 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:50.580865 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-d34f904e-eb25-4410-82ae-5ee09163746c None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:50.582423 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-d34f904e-eb25-4410-82ae-5ee09163746c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:50.583968 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-ac8fc09b-9993-42e6-8285-31b292673af4 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:50.585459 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-ac8fc09b-9993-42e6-8285-31b292673af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:50.590566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1000/2001] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:49:50.593402 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1002/2002] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:49:50.594808 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f904e-eb25-4410-82ae-5ee09163746c None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:50.597319 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fc09b-9993-42e6-8285-31b292673af4 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:50.604701 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f904e-eb25-4410-82ae-5ee09163746c None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:50.608386 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fc09b-9993-42e6-8285-31b292673af4 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:50.609398 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3aa132-75a2-47fc-9b1b-7a0870b22a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:50.610106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3aa132-75a2-47fc-9b1b-7a0870b22a6d admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:50.610388 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3aa132-75a2-47fc-9b1b-7a0870b22a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:50.610662 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3aa132-75a2-47fc-9b1b-7a0870b22a6d admin admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:50.611391 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3aa132-75a2-47fc-9b1b-7a0870b22a6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:49:50.611695 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3aa132-75a2-47fc-9b1b-7a0870b22a6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:50.613039 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f1006-91c5-4b6e-93bc-dadef75618bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:50.613318 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3aa132-75a2-47fc-9b1b-7a0870b22a6d admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:50.613693 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f1006-91c5-4b6e-93bc-dadef75618bd admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:50.614001 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f1006-91c5-4b6e-93bc-dadef75618bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:50.614273 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f1006-91c5-4b6e-93bc-dadef75618bd admin admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:50.615024 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f1006-91c5-4b6e-93bc-dadef75618bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:49:50.615439 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f1006-91c5-4b6e-93bc-dadef75618bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:50.617013 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f1006-91c5-4b6e-93bc-dadef75618bd admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:50.625816 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1001/2003] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:49:50.632057 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1003/2004] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:49:50.632187 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3aa132-75a2-47fc-9b1b-7a0870b22a6d admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:50.632969 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f1006-91c5-4b6e-93bc-dadef75618bd admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:50.639852 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3aa132-75a2-47fc-9b1b-7a0870b22a6d admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:50.642349 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f1006-91c5-4b6e-93bc-dadef75618bd admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:50.644571 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900a709-72e1-4f75-b1f8-a010dad57c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:50.645217 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900a709-72e1-4f75-b1f8-a010dad57c37 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:50.645601 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900a709-72e1-4f75-b1f8-a010dad57c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:50.645995 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900a709-72e1-4f75-b1f8-a010dad57c37 admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:50.646718 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900a709-72e1-4f75-b1f8-a010dad57c37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:50.646916 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e938eb-be91-4132-827b-a8240183086b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:50.647536 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e938eb-be91-4132-827b-a8240183086b admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:50.647813 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e938eb-be91-4132-827b-a8240183086b admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:50.648082 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e938eb-be91-4132-827b-a8240183086b admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:50.648622 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900a709-72e1-4f75-b1f8-a010dad57c37 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:50.648755 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e938eb-be91-4132-827b-a8240183086b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:50.650650 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e938eb-be91-4132-827b-a8240183086b admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:50.678510 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1002/2005] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:49:50 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:49:50.681687 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1004/2006] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:49:50 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:49:50.682751 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900a709-72e1-4f75-b1f8-a010dad57c37 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:50.686810 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e938eb-be91-4132-827b-a8240183086b admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:50.746154 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900a709-72e1-4f75-b1f8-a010dad57c37 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:50.750957 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec30315-75d1-4254-b693-76e4e9decacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:50.751629 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec30315-75d1-4254-b693-76e4e9decacd admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:50.751910 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec30315-75d1-4254-b693-76e4e9decacd admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:50.752004 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e938eb-be91-4132-827b-a8240183086b admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:50.752182 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec30315-75d1-4254-b693-76e4e9decacd admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:50.752869 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec30315-75d1-4254-b693-76e4e9decacd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:50.754843 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec30315-75d1-4254-b693-76e4e9decacd admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:50.756508 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae9f7e-fda9-4fb7-a4d6-f3d7c4081598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:50.757169 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae9f7e-fda9-4fb7-a4d6-f3d7c4081598 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:50.757446 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae9f7e-fda9-4fb7-a4d6-f3d7c4081598 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:50.757721 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae9f7e-fda9-4fb7-a4d6-f3d7c4081598 admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:50.758423 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae9f7e-fda9-4fb7-a4d6-f3d7c4081598 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:50.760473 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae9f7e-fda9-4fb7-a4d6-f3d7c4081598 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:50.781485 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1005/2007] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:49:50 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:49:50.782112 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1003/2008] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:49:50 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:49:50.783218 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae9f7e-fda9-4fb7-a4d6-f3d7c4081598 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:50.785326 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec30315-75d1-4254-b693-76e4e9decacd admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:50.793676 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae9f7e-fda9-4fb7-a4d6-f3d7c4081598 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:50.795931 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec30315-75d1-4254-b693-76e4e9decacd admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:50.798819 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32681a-1d78-44ce-9b2d-d0ce1b58de28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:50.799483 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32681a-1d78-44ce-9b2d-d0ce1b58de28 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:50.799762 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32681a-1d78-44ce-9b2d-d0ce1b58de28 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:50.800066 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32681a-1d78-44ce-9b2d-d0ce1b58de28 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:50.800493 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1031b-76ae-4938-989c-c400e86f013e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:50.800780 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32681a-1d78-44ce-9b2d-d0ce1b58de28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:50.801178 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1031b-76ae-4938-989c-c400e86f013e admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:50.801452 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1031b-76ae-4938-989c-c400e86f013e admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:50.801723 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1031b-76ae-4938-989c-c400e86f013e admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:50.802429 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32681a-1d78-44ce-9b2d-d0ce1b58de28 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:50.802527 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1031b-76ae-4938-989c-c400e86f013e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:50.804300 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1031b-76ae-4938-989c-c400e86f013e admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:50.816872 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1006/2009] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:49:50.819818 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1004/2010] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:49:50.820643 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32681a-1d78-44ce-9b2d-d0ce1b58de28 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:50.823534 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1031b-76ae-4938-989c-c400e86f013e admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:50.837481 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32681a-1d78-44ce-9b2d-d0ce1b58de28 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:50.840133 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1031b-76ae-4938-989c-c400e86f013e admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:50.842458 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea340a8b-637a-48fc-8ddc-154a094d3106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:50.843285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea340a8b-637a-48fc-8ddc-154a094d3106 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:50.843622 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea340a8b-637a-48fc-8ddc-154a094d3106 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:50.843995 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea340a8b-637a-48fc-8ddc-154a094d3106 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:50.844815 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea340a8b-637a-48fc-8ddc-154a094d3106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:50.846552 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea340a8b-637a-48fc-8ddc-154a094d3106 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:50.846677 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a756c5b-d111-4cc7-b6db-0150742b4e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:50.847790 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a756c5b-d111-4cc7-b6db-0150742b4e09 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:50.847790 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a756c5b-d111-4cc7-b6db-0150742b4e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:50.848039 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a756c5b-d111-4cc7-b6db-0150742b4e09 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:50.848781 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a756c5b-d111-4cc7-b6db-0150742b4e09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:50.850419 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a756c5b-d111-4cc7-b6db-0150742b4e09 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:50.857983 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1007/2011] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:49:50.861340 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1005/2012] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:49:50.863285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea340a8b-637a-48fc-8ddc-154a094d3106 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:50.866095 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a756c5b-d111-4cc7-b6db-0150742b4e09 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:50.875154 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea340a8b-637a-48fc-8ddc-154a094d3106 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:50.877213 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a756c5b-d111-4cc7-b6db-0150742b4e09 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:50.880240 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94814038-a132-4897-b9c1-615add2b2609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:50.881234 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94814038-a132-4897-b9c1-615add2b2609 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:50.881613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94814038-a132-4897-b9c1-615add2b2609 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:50.882188 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94814038-a132-4897-b9c1-615add2b2609 admin admin] PATH_INFO: `/v3/projects/fc93e462659e439896c94ae57b4f7f3d/users/bd413f66141241979fac14c0c98fe406/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:50.882462 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9155d0-0d38-49ed-95c9-cafe00b18984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:50.883411 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9155d0-0d38-49ed-95c9-cafe00b18984 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:50.883794 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9155d0-0d38-49ed-95c9-cafe00b18984 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:50.884112 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9155d0-0d38-49ed-95c9-cafe00b18984 admin admin] PATH_INFO: `/v3/projects/1c144c752dee4d23a68bc43100ef05c3/users/e9bf0207ca864423a91c36579a2093db/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:50.903882 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9155d0-0d38-49ed-95c9-cafe00b18984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c144c752dee4d23a68bc43100ef05c3, user_id=e9bf0207ca864423a91c36579a2093db, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:50.904164 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9155d0-0d38-49ed-95c9-cafe00b18984 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:50.908690 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94814038-a132-4897-b9c1-615add2b2609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc93e462659e439896c94ae57b4f7f3d, user_id=bd413f66141241979fac14c0c98fe406, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:50.912033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94814038-a132-4897-b9c1-615add2b2609 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:50.920305 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1006/2013] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:49:50 2022] PUT /identity/v3/projects/1c144c752dee4d23a68bc43100ef05c3/users/e9bf0207ca864423a91c36579a2093db/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:50.931038 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9578f-e4ec-49c4-81a4-81ec07d1a1f9 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:50.931517 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9578f-e4ec-49c4-81a4-81ec07d1a1f9 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:50.931845 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9578f-e4ec-49c4-81a4-81ec07d1a1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:50.932886 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1008/2014] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:49:50 2022] PUT /identity/v3/projects/fc93e462659e439896c94ae57b4f7f3d/users/bd413f66141241979fac14c0c98fe406/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:50.937790 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5d54d-ecf5-4b35-a721-310463f05cf3 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:50.938104 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5d54d-ecf5-4b35-a721-310463f05cf3 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:50.938382 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5d54d-ecf5-4b35-a721-310463f05cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:50.956386 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-14d5d54d-ecf5-4b35-a721-310463f05cf3 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:50.958234 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-14d5d54d-ecf5-4b35-a721-310463f05cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:50.961006 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-bdc9578f-e4ec-49c4-81a4-81ec07d1a1f9 None None] MFA Rules not processed for user `e9bf0207ca864423a91c36579a2093db`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:50.962223 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-bdc9578f-e4ec-49c4-81a4-81ec07d1a1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:51.025962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1009/2015] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:51.027555 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5d54d-ecf5-4b35-a721-310463f05cf3 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:51.029627 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-14d5d54d-ecf5-4b35-a721-310463f05cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:51.036490 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:51.040038 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:51.044950 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5d54d-ecf5-4b35-a721-310463f05cf3 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:51.048982 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1007/2016] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:49:51.050130 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9578f-e4ec-49c4-81a4-81ec07d1a1f9 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:51.054549 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-bdc9578f-e4ec-49c4-81a4-81ec07d1a1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:51.056838 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df7813-f604-4122-bc61-4b8f7bee3bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:51.058040 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df7813-f604-4122-bc61-4b8f7bee3bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:51.058351 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df7813-f604-4122-bc61-4b8f7bee3bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:51.058614 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df7813-f604-4122-bc61-4b8f7bee3bc9 admin admin] PATH_INFO: `/v3/users/0b36e75a7d664452a2956ec76e8633f0` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:51.059887 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df7813-f604-4122-bc61-4b8f7bee3bc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b36e75a7d664452a2956ec76e8633f0)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:51.062123 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df7813-f604-4122-bc61-4b8f7bee3bc9 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:51.117473 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9578f-e4ec-49c4-81a4-81ec07d1a1f9 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:51.121367 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66383d1-28d2-441a-8ef4-1f4f32253ea6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:51.122086 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66383d1-28d2-441a-8ef4-1f4f32253ea6 service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:51.122366 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66383d1-28d2-441a-8ef4-1f4f32253ea6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:51.122639 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66383d1-28d2-441a-8ef4-1f4f32253ea6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:51.123075 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-a4df7813-f604-4122-bc61-4b8f7bee3bc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b36e75a7d664452a2956ec76e8633f0'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:51.134518 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66383d1-28d2-441a-8ef4-1f4f32253ea6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:51.136478 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66383d1-28d2-441a-8ef4-1f4f32253ea6 service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:51.141463 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-a4df7813-f604-4122-bc61-4b8f7bee3bc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b36e75a7d664452a2956ec76e8633f0'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:51.147355 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1008/2017] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:49:51.147872 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66383d1-28d2-441a-8ef4-1f4f32253ea6 service neutron] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:51.154139 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-a66383d1-28d2-441a-8ef4-1f4f32253ea6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:51.154286 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-a4df7813-f604-4122-bc61-4b8f7bee3bc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b36e75a7d664452a2956ec76e8633f0'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:51.154286 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-a4df7813-f604-4122-bc61-4b8f7bee3bc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b36e75a7d664452a2956ec76e8633f0'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:51.154286 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-a4df7813-f604-4122-bc61-4b8f7bee3bc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b36e75a7d664452a2956ec76e8633f0'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:51.170263 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1010/2018] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:49:51 2022] DELETE /identity/v3/users/0b36e75a7d664452a2956ec76e8633f0 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:51.174569 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710c3e9-49f7-4968-877a-bf3a0a8c8a30 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:51.174917 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710c3e9-49f7-4968-877a-bf3a0a8c8a30 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:51.175279 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710c3e9-49f7-4968-877a-bf3a0a8c8a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:51.227926 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-f710c3e9-49f7-4968-877a-bf3a0a8c8a30 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:51.229213 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-f710c3e9-49f7-4968-877a-bf3a0a8c8a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:51.247491 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66383d1-28d2-441a-8ef4-1f4f32253ea6 service neutron] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:51.307247 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1011/2019] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:49:51.314808 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710c3e9-49f7-4968-877a-bf3a0a8c8a30 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:51.316635 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-f710c3e9-49f7-4968-877a-bf3a0a8c8a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:51.340775 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea92ef7-92ef-4d94-9581-63c8e744544e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:51.342138 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea92ef7-92ef-4d94-9581-63c8e744544e service nova] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:51.342525 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea92ef7-92ef-4d94-9581-63c8e744544e service nova] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:51.342900 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea92ef7-92ef-4d94-9581-63c8e744544e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:51.345021 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-bea92ef7-92ef-4d94-9581-63c8e744544e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:51.398508 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:51.400692 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710c3e9-49f7-4968-877a-bf3a0a8c8a30 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:51.406221 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2553f9f-145c-41ff-b71e-9f721737be7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:51.406916 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2553f9f-145c-41ff-b71e-9f721737be7d service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:51.407232 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2553f9f-145c-41ff-b71e-9f721737be7d service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:51.407606 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2553f9f-145c-41ff-b71e-9f721737be7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:51.419929 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2553f9f-145c-41ff-b71e-9f721737be7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:51.421466 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2553f9f-145c-41ff-b71e-9f721737be7d service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:51.437260 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1012/2020] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:49:51.438602 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea92ef7-92ef-4d94-9581-63c8e744544e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:51.440427 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea92ef7-92ef-4d94-9581-63c8e744544e service nova] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:51.451110 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1009/2021] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:49:51.782904 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2553f9f-145c-41ff-b71e-9f721737be7d service neutron] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:51.784411 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-d2553f9f-145c-41ff-b71e-9f721737be7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:51.803308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2553f9f-145c-41ff-b71e-9f721737be7d service neutron] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:51.814075 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeeda3a-4fac-4573-a665-7edd13a5409e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:51.815704 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeeda3a-4fac-4573-a665-7edd13a5409e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:51.816395 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeeda3a-4fac-4573-a665-7edd13a5409e admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:51.816770 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeeda3a-4fac-4573-a665-7edd13a5409e admin admin] PATH_INFO: `/v3/projects/d835a13a78884b03b9eb74b68034a46a` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:51.818447 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeeda3a-4fac-4573-a665-7edd13a5409e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d835a13a78884b03b9eb74b68034a46a)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:51.821803 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeeda3a-4fac-4573-a665-7edd13a5409e admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:51.845871 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:51.922676 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-4aeeda3a-4fac-4573-a665-7edd13a5409e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd835a13a78884b03b9eb74b68034a46a', 'request_id': 'req-4aeeda3a-4fac-4573-a665-7edd13a5409e'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:51.938599 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980a774-a989-41d2-9f11-f873fbea534e None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:51.940118 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980a774-a989-41d2-9f11-f873fbea534e None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:51.940553 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980a774-a989-41d2-9f11-f873fbea534e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:51.956260 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-4aeeda3a-4fac-4573-a665-7edd13a5409e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd835a13a78884b03b9eb74b68034a46a', 'request_id': 'req-4aeeda3a-4fac-4573-a665-7edd13a5409e'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:51.975367 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-4aeeda3a-4fac-4573-a665-7edd13a5409e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd835a13a78884b03b9eb74b68034a46a', 'request_id': 'req-4aeeda3a-4fac-4573-a665-7edd13a5409e'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:51.981432 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-9980a774-a989-41d2-9f11-f873fbea534e None None] MFA Rules not processed for user `bd413f66141241979fac14c0c98fe406`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:51.983763 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-9980a774-a989-41d2-9f11-f873fbea534e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:51.994374 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-4aeeda3a-4fac-4573-a665-7edd13a5409e admin admin] The token cache is being invalidate because project d835a13a78884b03b9eb74b68034a46a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:49:51.994552 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-4aeeda3a-4fac-4573-a665-7edd13a5409e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:51.995312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-4aeeda3a-4fac-4573-a665-7edd13a5409e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:51.997887 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1013/2022] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:49:51 2022] DELETE /identity/v3/projects/d835a13a78884b03b9eb74b68034a46a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:52.001448 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeeda3a-4fac-4573-a665-7edd13a5409e admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:52.003340 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-4aeeda3a-4fac-4573-a665-7edd13a5409e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:52.073975 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1010/2023] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:49:52.085510 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980a774-a989-41d2-9f11-f873fbea534e None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:52.087522 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-9980a774-a989-41d2-9f11-f873fbea534e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:52.087637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeeda3a-4fac-4573-a665-7edd13a5409e admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:52.093419 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bdc41b-6814-4b5d-bec1-7e379316cd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:52.094380 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdc41b-6814-4b5d-bec1-7e379316cd0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:52.095257 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdc41b-6814-4b5d-bec1-7e379316cd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:52.095257 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdc41b-6814-4b5d-bec1-7e379316cd0f admin admin] PATH_INFO: `/v3/users/65b70cd60d824b278a24ee5e812fc72c` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:52.096136 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bdc41b-6814-4b5d-bec1-7e379316cd0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=65b70cd60d824b278a24ee5e812fc72c)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:52.098111 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bdc41b-6814-4b5d-bec1-7e379316cd0f admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:52.152719 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-57bdc41b-6814-4b5d-bec1-7e379316cd0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65b70cd60d824b278a24ee5e812fc72c'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:52.164859 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980a774-a989-41d2-9f11-f873fbea534e None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:52.165194 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-57bdc41b-6814-4b5d-bec1-7e379316cd0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65b70cd60d824b278a24ee5e812fc72c'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:52.169400 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6d3bf-2239-4850-ab6b-ecbdd2180a9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:52.170135 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6d3bf-2239-4850-ab6b-ecbdd2180a9e service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:52.170418 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6d3bf-2239-4850-ab6b-ecbdd2180a9e service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:52.170694 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6d3bf-2239-4850-ab6b-ecbdd2180a9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:52.173049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-57bdc41b-6814-4b5d-bec1-7e379316cd0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65b70cd60d824b278a24ee5e812fc72c'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:52.173754 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-57bdc41b-6814-4b5d-bec1-7e379316cd0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65b70cd60d824b278a24ee5e812fc72c'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:52.174395 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-57bdc41b-6814-4b5d-bec1-7e379316cd0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65b70cd60d824b278a24ee5e812fc72c'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:52.179416 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6d3bf-2239-4850-ab6b-ecbdd2180a9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:52.180879 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6d3bf-2239-4850-ab6b-ecbdd2180a9e service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:52.188046 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1014/2024] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:49:52 2022] DELETE /identity/v3/users/65b70cd60d824b278a24ee5e812fc72c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:52.191810 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1011/2025] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:49:52.585274 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bdc41b-6814-4b5d-bec1-7e379316cd0f admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:52.586856 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-57bdc41b-6814-4b5d-bec1-7e379316cd0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:52.614639 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:52.656834 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bdc41b-6814-4b5d-bec1-7e379316cd0f admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:52.662190 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2196da7-5ca5-4663-938e-d9cd34fb3498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:52.663074 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2196da7-5ca5-4663-938e-d9cd34fb3498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:52.663329 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2196da7-5ca5-4663-938e-d9cd34fb3498 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:52.663594 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2196da7-5ca5-4663-938e-d9cd34fb3498 admin admin] PATH_INFO: `/v3/projects/da6c1bb720b344b9845e70d7212c041f` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:52.664849 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2196da7-5ca5-4663-938e-d9cd34fb3498 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da6c1bb720b344b9845e70d7212c041f)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:52.667106 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2196da7-5ca5-4663-938e-d9cd34fb3498 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:52.724621 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-a2196da7-5ca5-4663-938e-d9cd34fb3498 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da6c1bb720b344b9845e70d7212c041f', 'request_id': 'req-a2196da7-5ca5-4663-938e-d9cd34fb3498'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:52.731032 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-a2196da7-5ca5-4663-938e-d9cd34fb3498 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da6c1bb720b344b9845e70d7212c041f', 'request_id': 'req-a2196da7-5ca5-4663-938e-d9cd34fb3498'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:52.741052 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-a2196da7-5ca5-4663-938e-d9cd34fb3498 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da6c1bb720b344b9845e70d7212c041f', 'request_id': 'req-a2196da7-5ca5-4663-938e-d9cd34fb3498'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:52.753213 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-a2196da7-5ca5-4663-938e-d9cd34fb3498 admin admin] The token cache is being invalidate because project da6c1bb720b344b9845e70d7212c041f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:49:52.753498 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-a2196da7-5ca5-4663-938e-d9cd34fb3498 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:52.754235 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-a2196da7-5ca5-4663-938e-d9cd34fb3498 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:52.755932 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1015/2026] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:49:52 2022] DELETE /identity/v3/projects/da6c1bb720b344b9845e70d7212c041f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:52.762301 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd428744-a97e-4b9a-925f-953cf529e0e8 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:52.762586 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd428744-a97e-4b9a-925f-953cf529e0e8 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:52.762860 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd428744-a97e-4b9a-925f-953cf529e0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:52.782291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-bd428744-a97e-4b9a-925f-953cf529e0e8 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:52.783506 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-bd428744-a97e-4b9a-925f-953cf529e0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:52.847941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1012/2027] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:52.860117 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836c67b-62b0-4d6a-b543-e521549b696b None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:52.860516 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836c67b-62b0-4d6a-b543-e521549b696b None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:52.860895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836c67b-62b0-4d6a-b543-e521549b696b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:52.880002 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-8836c67b-62b0-4d6a-b543-e521549b696b None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:52.881198 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-8836c67b-62b0-4d6a-b543-e521549b696b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:52.889542 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1016/2028] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:52.893803 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd428744-a97e-4b9a-925f-953cf529e0e8 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:52.900064 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:52.904140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd428744-a97e-4b9a-925f-953cf529e0e8 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:52.909444 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c321d24-7f81-4f61-88ac-cf7569c333a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:52.910076 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c321d24-7f81-4f61-88ac-cf7569c333a0 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:52.910356 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c321d24-7f81-4f61-88ac-cf7569c333a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:52.910637 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c321d24-7f81-4f61-88ac-cf7569c333a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:52.911365 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c321d24-7f81-4f61-88ac-cf7569c333a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:49:52.911667 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c321d24-7f81-4f61-88ac-cf7569c333a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:52.913275 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c321d24-7f81-4f61-88ac-cf7569c333a0 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:52.925852 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1013/2029] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:49:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:49:52.930204 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836c67b-62b0-4d6a-b543-e521549b696b None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:52.939809 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836c67b-62b0-4d6a-b543-e521549b696b None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:52.944509 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935d65c-4e86-4483-8641-d1c72536a323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:52.945150 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935d65c-4e86-4483-8641-d1c72536a323 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:52.945432 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935d65c-4e86-4483-8641-d1c72536a323 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:52.945702 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935d65c-4e86-4483-8641-d1c72536a323 admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:52.946427 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5935d65c-4e86-4483-8641-d1c72536a323 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:52.948328 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5935d65c-4e86-4483-8641-d1c72536a323 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:52.975405 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1017/2030] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:49:52 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:49:52.979768 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c321d24-7f81-4f61-88ac-cf7569c333a0 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:52.991856 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c321d24-7f81-4f61-88ac-cf7569c333a0 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:53.053865 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c8453-3e16-4375-84de-e2fff141e347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:53.054726 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c8453-3e16-4375-84de-e2fff141e347 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:53.055184 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c8453-3e16-4375-84de-e2fff141e347 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:53.055451 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c8453-3e16-4375-84de-e2fff141e347 admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:53.056262 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c8453-3e16-4375-84de-e2fff141e347 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:53.058819 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c8453-3e16-4375-84de-e2fff141e347 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:53.081451 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1014/2031] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:49:52 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:49:53.085965 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935d65c-4e86-4483-8641-d1c72536a323 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:53.100569 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935d65c-4e86-4483-8641-d1c72536a323 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:53.105690 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb20076-d275-4bfb-83a7-5b680fbe3c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:53.106596 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb20076-d275-4bfb-83a7-5b680fbe3c99 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:53.106869 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb20076-d275-4bfb-83a7-5b680fbe3c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:53.107198 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb20076-d275-4bfb-83a7-5b680fbe3c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:53.107884 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb20076-d275-4bfb-83a7-5b680fbe3c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:53.109722 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb20076-d275-4bfb-83a7-5b680fbe3c99 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:53.137952 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1018/2032] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:49:53.139250 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c8453-3e16-4375-84de-e2fff141e347 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:53.150641 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c8453-3e16-4375-84de-e2fff141e347 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:53.157877 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a3c850-b4b7-44a1-9b46-ae437a949146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:53.158643 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3c850-b4b7-44a1-9b46-ae437a949146 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:53.158989 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3c850-b4b7-44a1-9b46-ae437a949146 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:53.159328 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a3c850-b4b7-44a1-9b46-ae437a949146 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:53.160187 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3c850-b4b7-44a1-9b46-ae437a949146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:53.163092 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a3c850-b4b7-44a1-9b46-ae437a949146 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:53.181447 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1015/2033] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:49:53.184913 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb20076-d275-4bfb-83a7-5b680fbe3c99 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:53.195166 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb20076-d275-4bfb-83a7-5b680fbe3c99 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:53.200957 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df937672-3ad7-4d7a-9d6f-183f1f10ae79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:53.202252 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df937672-3ad7-4d7a-9d6f-183f1f10ae79 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:53.202418 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df937672-3ad7-4d7a-9d6f-183f1f10ae79 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:53.202777 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df937672-3ad7-4d7a-9d6f-183f1f10ae79 admin admin] PATH_INFO: `/v3/projects/d93a5abfb72f45e1a0d0d3ae84b9894a/users/a5e1abd313eb47649ce52f22a2cc10d3/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:53.221074 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df937672-3ad7-4d7a-9d6f-183f1f10ae79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d93a5abfb72f45e1a0d0d3ae84b9894a, user_id=a5e1abd313eb47649ce52f22a2cc10d3, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:53.223941 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df937672-3ad7-4d7a-9d6f-183f1f10ae79 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:53.238809 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1019/2034] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:49:53 2022] PUT /identity/v3/projects/d93a5abfb72f45e1a0d0d3ae84b9894a/users/a5e1abd313eb47649ce52f22a2cc10d3/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:53.250034 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1859b-a042-410e-8aba-8b01a9e9f81d None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:53.250328 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1859b-a042-410e-8aba-8b01a9e9f81d None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:53.250597 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1859b-a042-410e-8aba-8b01a9e9f81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:53.285105 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-0eb1859b-a042-410e-8aba-8b01a9e9f81d None None] MFA Rules not processed for user `a5e1abd313eb47649ce52f22a2cc10d3`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:53.286461 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-0eb1859b-a042-410e-8aba-8b01a9e9f81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:53.373787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1016/2035] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:53.385563 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df937672-3ad7-4d7a-9d6f-183f1f10ae79 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:53.387502 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-df937672-3ad7-4d7a-9d6f-183f1f10ae79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:53.447108 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:53.452416 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df937672-3ad7-4d7a-9d6f-183f1f10ae79 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:53.459508 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74f41f-ab90-49b5-b4d3-1fad47fe427b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:53.460425 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74f41f-ab90-49b5-b4d3-1fad47fe427b service cinder] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:53.460712 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74f41f-ab90-49b5-b4d3-1fad47fe427b service cinder] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:53.460994 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74f41f-ab90-49b5-b4d3-1fad47fe427b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:53.470788 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74f41f-ab90-49b5-b4d3-1fad47fe427b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:53.472264 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74f41f-ab90-49b5-b4d3-1fad47fe427b service cinder] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:53.483262 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1020/2036] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:49:53.505267 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1859b-a042-410e-8aba-8b01a9e9f81d None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:53.597625 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1859b-a042-410e-8aba-8b01a9e9f81d None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:53.604124 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b762a-049d-4884-85c8-b210be2ca8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:53.605052 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b762a-049d-4884-85c8-b210be2ca8ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:53.605427 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b762a-049d-4884-85c8-b210be2ca8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:53.605769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b762a-049d-4884-85c8-b210be2ca8ef admin admin] PATH_INFO: `/v3/users/a5e1abd313eb47649ce52f22a2cc10d3` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:53.607309 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b762a-049d-4884-85c8-b210be2ca8ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5e1abd313eb47649ce52f22a2cc10d3)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:53.610001 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b762a-049d-4884-85c8-b210be2ca8ef admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:53.622951 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf92fe5-e68a-4668-ba05-f5d4cb9b50e2 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:53.623410 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf92fe5-e68a-4668-ba05-f5d4cb9b50e2 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:53.624271 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf92fe5-e68a-4668-ba05-f5d4cb9b50e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:53.624731 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:53.655708 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-dcf92fe5-e68a-4668-ba05-f5d4cb9b50e2 None None] MFA Rules not processed for user `bd413f66141241979fac14c0c98fe406`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:53.658503 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-dcf92fe5-e68a-4668-ba05-f5d4cb9b50e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:53.671526 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-833b762a-049d-4884-85c8-b210be2ca8ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5e1abd313eb47649ce52f22a2cc10d3'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:53.680549 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-833b762a-049d-4884-85c8-b210be2ca8ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5e1abd313eb47649ce52f22a2cc10d3'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:53.694132 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-833b762a-049d-4884-85c8-b210be2ca8ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5e1abd313eb47649ce52f22a2cc10d3'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:53.694851 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-833b762a-049d-4884-85c8-b210be2ca8ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5e1abd313eb47649ce52f22a2cc10d3'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:53.695442 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-833b762a-049d-4884-85c8-b210be2ca8ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5e1abd313eb47649ce52f22a2cc10d3'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:53.714332 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1017/2037] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:49:53 2022] DELETE /identity/v3/users/a5e1abd313eb47649ce52f22a2cc10d3 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:53.718848 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b65fcf-7e16-4164-8887-9f14f2c004c3 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:53.719150 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b65fcf-7e16-4164-8887-9f14f2c004c3 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:53.719428 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b65fcf-7e16-4164-8887-9f14f2c004c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:53.724907 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1021/2038] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:49:53.737559 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-46b65fcf-7e16-4164-8887-9f14f2c004c3 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:53.738857 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-46b65fcf-7e16-4164-8887-9f14f2c004c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:53.801539 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1018/2039] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:49:53.811048 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf92fe5-e68a-4668-ba05-f5d4cb9b50e2 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:53.812856 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-dcf92fe5-e68a-4668-ba05-f5d4cb9b50e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:53.888775 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf92fe5-e68a-4668-ba05-f5d4cb9b50e2 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:53.940666 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e689de-3a5c-4a12-9bb3-f3973cc6cff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:53.941328 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e689de-3a5c-4a12-9bb3-f3973cc6cff2 service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:53.941600 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e689de-3a5c-4a12-9bb3-f3973cc6cff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:53.941872 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e689de-3a5c-4a12-9bb3-f3973cc6cff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:53.951367 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e689de-3a5c-4a12-9bb3-f3973cc6cff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:53.952796 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e689de-3a5c-4a12-9bb3-f3973cc6cff2 service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:53.965621 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1022/2040] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:49:54.360281 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b65fcf-7e16-4164-8887-9f14f2c004c3 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:54.361930 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-46b65fcf-7e16-4164-8887-9f14f2c004c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:54.374923 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b65fcf-7e16-4164-8887-9f14f2c004c3 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:54.388994 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf962f0-8857-4a37-8d0d-33a57350bebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:54.388994 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf962f0-8857-4a37-8d0d-33a57350bebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:54.388994 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf962f0-8857-4a37-8d0d-33a57350bebe admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:54.388994 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf962f0-8857-4a37-8d0d-33a57350bebe admin admin] PATH_INFO: `/v3/projects/d93a5abfb72f45e1a0d0d3ae84b9894a` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:54.390328 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf962f0-8857-4a37-8d0d-33a57350bebe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d93a5abfb72f45e1a0d0d3ae84b9894a)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:54.392298 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf962f0-8857-4a37-8d0d-33a57350bebe admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:54.469412 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-5cf962f0-8857-4a37-8d0d-33a57350bebe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd93a5abfb72f45e1a0d0d3ae84b9894a', 'request_id': 'req-5cf962f0-8857-4a37-8d0d-33a57350bebe'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:54.486726 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-5cf962f0-8857-4a37-8d0d-33a57350bebe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd93a5abfb72f45e1a0d0d3ae84b9894a', 'request_id': 'req-5cf962f0-8857-4a37-8d0d-33a57350bebe'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:54.497081 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-5cf962f0-8857-4a37-8d0d-33a57350bebe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd93a5abfb72f45e1a0d0d3ae84b9894a', 'request_id': 'req-5cf962f0-8857-4a37-8d0d-33a57350bebe'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:54.509813 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-5cf962f0-8857-4a37-8d0d-33a57350bebe admin admin] The token cache is being invalidate because project d93a5abfb72f45e1a0d0d3ae84b9894a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:49:54.510205 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-5cf962f0-8857-4a37-8d0d-33a57350bebe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:54.510850 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-5cf962f0-8857-4a37-8d0d-33a57350bebe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:54.516767 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1019/2041] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:49:54 2022] DELETE /identity/v3/projects/d93a5abfb72f45e1a0d0d3ae84b9894a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:54.518761 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a732ed-50e8-4e32-957c-052c16b36766 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:54.519202 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a732ed-50e8-4e32-957c-052c16b36766 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:54.519498 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a732ed-50e8-4e32-957c-052c16b36766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:54.544743 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-80a732ed-50e8-4e32-957c-052c16b36766 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:54.552216 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-80a732ed-50e8-4e32-957c-052c16b36766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:54.617503 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:54.631274 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1023/2042] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:54.639157 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4e580-78c6-4108-a89f-44d7149c13c4 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:54.639450 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4e580-78c6-4108-a89f-44d7149c13c4 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:54.639737 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4e580-78c6-4108-a89f-44d7149c13c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:54.647844 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:54.663108 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-3dd4e580-78c6-4108-a89f-44d7149c13c4 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:54.664294 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-3dd4e580-78c6-4108-a89f-44d7149c13c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:54.676965 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1020/2043] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:54.678341 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a732ed-50e8-4e32-957c-052c16b36766 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:54.689569 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a732ed-50e8-4e32-957c-052c16b36766 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:54.700183 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e7fb6-f94d-4777-84e7-83b350f189bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:54.701546 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e7fb6-f94d-4777-84e7-83b350f189bc admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:54.702230 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e7fb6-f94d-4777-84e7-83b350f189bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:54.702645 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e7fb6-f94d-4777-84e7-83b350f189bc admin admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:54.703518 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902e7fb6-f94d-4777-84e7-83b350f189bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:49:54.703971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902e7fb6-f94d-4777-84e7-83b350f189bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:54.707113 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902e7fb6-f94d-4777-84e7-83b350f189bc admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:54.721035 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1024/2044] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:49:54.726320 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4e580-78c6-4108-a89f-44d7149c13c4 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:54.737203 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4e580-78c6-4108-a89f-44d7149c13c4 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:54.742386 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201405ca-3691-40f4-b665-feb0a6b9eb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:54.743143 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201405ca-3691-40f4-b665-feb0a6b9eb9b admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:54.743476 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201405ca-3691-40f4-b665-feb0a6b9eb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:54.743843 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201405ca-3691-40f4-b665-feb0a6b9eb9b admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:54.744536 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201405ca-3691-40f4-b665-feb0a6b9eb9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:54.746656 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201405ca-3691-40f4-b665-feb0a6b9eb9b admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:54.786643 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1021/2045] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:49:54 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:49:54.788300 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e7fb6-f94d-4777-84e7-83b350f189bc admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:54.802724 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e7fb6-f94d-4777-84e7-83b350f189bc admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:54.867038 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0fa85-154f-4359-bd89-87455cdeea61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:54.867953 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0fa85-154f-4359-bd89-87455cdeea61 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:54.868142 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0fa85-154f-4359-bd89-87455cdeea61 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:54.868476 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0fa85-154f-4359-bd89-87455cdeea61 admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:54.869225 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0fa85-154f-4359-bd89-87455cdeea61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:54.871402 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0fa85-154f-4359-bd89-87455cdeea61 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:54.895926 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1025/2046] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:49:54 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:49:54.900248 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201405ca-3691-40f4-b665-feb0a6b9eb9b admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:54.910898 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201405ca-3691-40f4-b665-feb0a6b9eb9b admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:54.916140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad2a44-be80-4a49-9899-de1050effc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:54.916827 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad2a44-be80-4a49-9899-de1050effc6b admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:54.917113 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad2a44-be80-4a49-9899-de1050effc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:54.917382 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ad2a44-be80-4a49-9899-de1050effc6b admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:54.918179 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ad2a44-be80-4a49-9899-de1050effc6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:54.919831 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ad2a44-be80-4a49-9899-de1050effc6b admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:54.930908 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1022/2047] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:49:54.935233 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0fa85-154f-4359-bd89-87455cdeea61 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:54.946195 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0fa85-154f-4359-bd89-87455cdeea61 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:54.951457 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d235ad-d343-472a-8955-fd885410b447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:54.952212 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d235ad-d343-472a-8955-fd885410b447 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:54.952588 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d235ad-d343-472a-8955-fd885410b447 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:54.953031 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d235ad-d343-472a-8955-fd885410b447 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:54.953825 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d235ad-d343-472a-8955-fd885410b447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:54.955534 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d235ad-d343-472a-8955-fd885410b447 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:54.966854 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1026/2048] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:49:54.971404 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad2a44-be80-4a49-9899-de1050effc6b admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:54.981655 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ad2a44-be80-4a49-9899-de1050effc6b admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:54.986800 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ca359-1a7d-4afc-85f2-1695f2eb6dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:54.987690 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ca359-1a7d-4afc-85f2-1695f2eb6dbd admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:54.987976 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ca359-1a7d-4afc-85f2-1695f2eb6dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:54.988255 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ca359-1a7d-4afc-85f2-1695f2eb6dbd admin admin] PATH_INFO: `/v3/projects/cded29f9488d4eb79e90e7b4401cf97d/users/3b17481e91824953be5d8d70a0862596/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:55.004573 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ca359-1a7d-4afc-85f2-1695f2eb6dbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=cded29f9488d4eb79e90e7b4401cf97d, user_id=3b17481e91824953be5d8d70a0862596, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:55.007519 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ca359-1a7d-4afc-85f2-1695f2eb6dbd admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:55.023825 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1023/2049] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:49:54 2022] PUT /identity/v3/projects/cded29f9488d4eb79e90e7b4401cf97d/users/3b17481e91824953be5d8d70a0862596/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:55.035931 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f82d90-c8da-4d16-b5f7-13485aba231a None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:55.036446 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f82d90-c8da-4d16-b5f7-13485aba231a None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:55.037030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f82d90-c8da-4d16-b5f7-13485aba231a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:55.067208 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-04f82d90-c8da-4d16-b5f7-13485aba231a None None] MFA Rules not processed for user `3b17481e91824953be5d8d70a0862596`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:55.068480 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-04f82d90-c8da-4d16-b5f7-13485aba231a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:55.135998 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1027/2050] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:55.157282 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ca359-1a7d-4afc-85f2-1695f2eb6dbd admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:55.159811 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-639ca359-1a7d-4afc-85f2-1695f2eb6dbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:55.220945 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ca359-1a7d-4afc-85f2-1695f2eb6dbd admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:55.224582 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da821587-1c29-4e9d-87d9-751d08ecfcc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:55.225238 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da821587-1c29-4e9d-87d9-751d08ecfcc8 service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:55.225515 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da821587-1c29-4e9d-87d9-751d08ecfcc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:55.225791 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da821587-1c29-4e9d-87d9-751d08ecfcc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:55.234759 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da821587-1c29-4e9d-87d9-751d08ecfcc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:55.236202 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da821587-1c29-4e9d-87d9-751d08ecfcc8 service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:55.245444 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1024/2051] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:49:56.953707 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f82d90-c8da-4d16-b5f7-13485aba231a None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:56.955180 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-04f82d90-c8da-4d16-b5f7-13485aba231a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:57.011648 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:57.029426 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f82d90-c8da-4d16-b5f7-13485aba231a None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:57.033984 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368c539-fb91-4409-84b6-92bab65b4b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:57.034861 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368c539-fb91-4409-84b6-92bab65b4b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:57.035145 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368c539-fb91-4409-84b6-92bab65b4b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:57.035438 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368c539-fb91-4409-84b6-92bab65b4b40 admin admin] PATH_INFO: `/v3/users/e9bf0207ca864423a91c36579a2093db` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:57.036641 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b368c539-fb91-4409-84b6-92bab65b4b40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9bf0207ca864423a91c36579a2093db)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:57.038668 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b368c539-fb91-4409-84b6-92bab65b4b40 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:57.092080 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-b368c539-fb91-4409-84b6-92bab65b4b40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9bf0207ca864423a91c36579a2093db'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:57.105369 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-b368c539-fb91-4409-84b6-92bab65b4b40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9bf0207ca864423a91c36579a2093db'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:57.114554 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-b368c539-fb91-4409-84b6-92bab65b4b40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9bf0207ca864423a91c36579a2093db'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:57.115424 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-b368c539-fb91-4409-84b6-92bab65b4b40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9bf0207ca864423a91c36579a2093db'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:57.116126 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-b368c539-fb91-4409-84b6-92bab65b4b40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9bf0207ca864423a91c36579a2093db'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:57.131529 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1028/2052] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:49:56 2022] DELETE /identity/v3/users/e9bf0207ca864423a91c36579a2093db => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:57.136035 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e451fce-e3f3-46f3-ba3f-80528d0d1679 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:57.136499 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e451fce-e3f3-46f3-ba3f-80528d0d1679 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:57.136499 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e451fce-e3f3-46f3-ba3f-80528d0d1679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:57.160674 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-6e451fce-e3f3-46f3-ba3f-80528d0d1679 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:57.162080 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-6e451fce-e3f3-46f3-ba3f-80528d0d1679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:57.247238 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1025/2053] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:57.256922 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368c539-fb91-4409-84b6-92bab65b4b40 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:57.258380 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-b368c539-fb91-4409-84b6-92bab65b4b40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:57.318042 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368c539-fb91-4409-84b6-92bab65b4b40 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:57.321723 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f293be-5767-4ba6-91d8-96118e16183d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:57.322425 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f293be-5767-4ba6-91d8-96118e16183d service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:57.322699 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f293be-5767-4ba6-91d8-96118e16183d service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:57.322969 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f293be-5767-4ba6-91d8-96118e16183d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:57.332997 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f293be-5767-4ba6-91d8-96118e16183d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:57.334477 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f293be-5767-4ba6-91d8-96118e16183d service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:57.344762 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1029/2054] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:49:57.630147 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e451fce-e3f3-46f3-ba3f-80528d0d1679 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:57.631677 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-6e451fce-e3f3-46f3-ba3f-80528d0d1679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:57.645098 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e451fce-e3f3-46f3-ba3f-80528d0d1679 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:57.658368 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76a9b6-2a2c-4482-a11d-e3ff82ade214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:57.659761 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76a9b6-2a2c-4482-a11d-e3ff82ade214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:57.660042 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76a9b6-2a2c-4482-a11d-e3ff82ade214 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:57.660526 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76a9b6-2a2c-4482-a11d-e3ff82ade214 admin admin] PATH_INFO: `/v3/projects/1c144c752dee4d23a68bc43100ef05c3` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:57.662060 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd76a9b6-2a2c-4482-a11d-e3ff82ade214 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c144c752dee4d23a68bc43100ef05c3)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:57.664448 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd76a9b6-2a2c-4482-a11d-e3ff82ade214 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:57.705984 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:57.719956 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-bd76a9b6-2a2c-4482-a11d-e3ff82ade214 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c144c752dee4d23a68bc43100ef05c3', 'request_id': 'req-bd76a9b6-2a2c-4482-a11d-e3ff82ade214'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:57.727818 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-bd76a9b6-2a2c-4482-a11d-e3ff82ade214 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c144c752dee4d23a68bc43100ef05c3', 'request_id': 'req-bd76a9b6-2a2c-4482-a11d-e3ff82ade214'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:57.738169 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-bd76a9b6-2a2c-4482-a11d-e3ff82ade214 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c144c752dee4d23a68bc43100ef05c3', 'request_id': 'req-bd76a9b6-2a2c-4482-a11d-e3ff82ade214'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:57.751366 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-bd76a9b6-2a2c-4482-a11d-e3ff82ade214 admin admin] The token cache is being invalidate because project 1c144c752dee4d23a68bc43100ef05c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:49:57.751651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-bd76a9b6-2a2c-4482-a11d-e3ff82ade214 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:57.752274 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-bd76a9b6-2a2c-4482-a11d-e3ff82ade214 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:49:57.753833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1026/2055] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:49:57 2022] DELETE /identity/v3/projects/1c144c752dee4d23a68bc43100ef05c3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:57.764664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f136cca-a918-4505-89f8-2794b39435f9 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:57.765349 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f136cca-a918-4505-89f8-2794b39435f9 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:57.765652 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f136cca-a918-4505-89f8-2794b39435f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:57.783054 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-4f136cca-a918-4505-89f8-2794b39435f9 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:57.784276 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-4f136cca-a918-4505-89f8-2794b39435f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:57.852915 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1030/2056] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:57.854598 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fd58b-95c6-492f-9b36-db0ffa35b122 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:57.854885 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fd58b-95c6-492f-9b36-db0ffa35b122 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:57.855360 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fd58b-95c6-492f-9b36-db0ffa35b122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:57.875202 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-8e3fd58b-95c6-492f-9b36-db0ffa35b122 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:57.876385 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-8e3fd58b-95c6-492f-9b36-db0ffa35b122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:57.884933 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1027/2057] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:49:57.889505 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f136cca-a918-4505-89f8-2794b39435f9 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:57.901369 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f136cca-a918-4505-89f8-2794b39435f9 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:57.907188 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410410ec-0c85-4659-afc2-91825b480737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:57.907188 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410410ec-0c85-4659-afc2-91825b480737 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:57.907188 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410410ec-0c85-4659-afc2-91825b480737 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:57.907467 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410410ec-0c85-4659-afc2-91825b480737 admin admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:57.908029 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410410ec-0c85-4659-afc2-91825b480737 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:49:57.908335 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410410ec-0c85-4659-afc2-91825b480737 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:57.909975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410410ec-0c85-4659-afc2-91825b480737 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:57.925864 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:57.936251 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fd58b-95c6-492f-9b36-db0ffa35b122 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:57.938039 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1031/2058] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:49:57.947424 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fd58b-95c6-492f-9b36-db0ffa35b122 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:57.952657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7504de77-256e-48f5-86fd-7bcaf9a12e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:57.953419 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504de77-256e-48f5-86fd-7bcaf9a12e5d admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:57.953744 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504de77-256e-48f5-86fd-7bcaf9a12e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:57.954069 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504de77-256e-48f5-86fd-7bcaf9a12e5d admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:57.954886 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7504de77-256e-48f5-86fd-7bcaf9a12e5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:57.957028 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7504de77-256e-48f5-86fd-7bcaf9a12e5d admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:57.993893 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1028/2059] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:49:57 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:49:57.995753 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410410ec-0c85-4659-afc2-91825b480737 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:58.006980 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410410ec-0c85-4659-afc2-91825b480737 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:58.094541 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80a836-4288-4adf-b44a-a4451bb4e759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:58.095255 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80a836-4288-4adf-b44a-a4451bb4e759 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:58.095584 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80a836-4288-4adf-b44a-a4451bb4e759 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:58.095885 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80a836-4288-4adf-b44a-a4451bb4e759 admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:58.096672 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80a836-4288-4adf-b44a-a4451bb4e759 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:58.098735 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80a836-4288-4adf-b44a-a4451bb4e759 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:58.119759 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1032/2060] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:49:57 2022] POST /identity/v3/users => generated 291 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:49:58.124159 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7504de77-256e-48f5-86fd-7bcaf9a12e5d admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:58.134325 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7504de77-256e-48f5-86fd-7bcaf9a12e5d admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:58.139011 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836c866-ee04-4dc2-9cbc-dbe99d13122a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:58.139668 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836c866-ee04-4dc2-9cbc-dbe99d13122a admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:58.139947 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836c866-ee04-4dc2-9cbc-dbe99d13122a admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:58.140213 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836c866-ee04-4dc2-9cbc-dbe99d13122a admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:58.140932 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5836c866-ee04-4dc2-9cbc-dbe99d13122a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:58.142570 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5836c866-ee04-4dc2-9cbc-dbe99d13122a admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:58.153628 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1029/2061] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:49:58.158142 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80a836-4288-4adf-b44a-a4451bb4e759 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:58.168827 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80a836-4288-4adf-b44a-a4451bb4e759 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:58.173579 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bcf9a3-60b1-4410-9a3f-88dd526efb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:58.174266 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bcf9a3-60b1-4410-9a3f-88dd526efb6a admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:58.174544 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bcf9a3-60b1-4410-9a3f-88dd526efb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:58.174817 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bcf9a3-60b1-4410-9a3f-88dd526efb6a admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:58.175534 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bcf9a3-60b1-4410-9a3f-88dd526efb6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:58.177145 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bcf9a3-60b1-4410-9a3f-88dd526efb6a admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:58.187456 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1033/2062] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:49:58.191724 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836c866-ee04-4dc2-9cbc-dbe99d13122a admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:58.202414 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836c866-ee04-4dc2-9cbc-dbe99d13122a admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:58.208572 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1edfc96-b4b4-43d9-91b5-22254150af04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:58.209464 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edfc96-b4b4-43d9-91b5-22254150af04 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:58.209748 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edfc96-b4b4-43d9-91b5-22254150af04 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:58.210084 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edfc96-b4b4-43d9-91b5-22254150af04 admin admin] PATH_INFO: `/v3/projects/6bc20ed895164014ad77965387dc7317/users/dc80461341eb4b37a3c88569d6d191f4/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:58.224934 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1edfc96-b4b4-43d9-91b5-22254150af04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bc20ed895164014ad77965387dc7317, user_id=dc80461341eb4b37a3c88569d6d191f4, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:58.227654 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1edfc96-b4b4-43d9-91b5-22254150af04 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:58.246146 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1030/2063] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:49:58 2022] PUT /identity/v3/projects/6bc20ed895164014ad77965387dc7317/users/dc80461341eb4b37a3c88569d6d191f4/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:58.262178 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10264761-5a0d-4d86-bc1f-bfdb82fbd90c None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:58.262460 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10264761-5a0d-4d86-bc1f-bfdb82fbd90c None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:58.262731 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10264761-5a0d-4d86-bc1f-bfdb82fbd90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:58.291513 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-10264761-5a0d-4d86-bc1f-bfdb82fbd90c None None] MFA Rules not processed for user `dc80461341eb4b37a3c88569d6d191f4`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:58.292733 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-10264761-5a0d-4d86-bc1f-bfdb82fbd90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:58.374242 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1034/2064] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:58.378946 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1edfc96-b4b4-43d9-91b5-22254150af04 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:58.447662 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1edfc96-b4b4-43d9-91b5-22254150af04 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:58.452588 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168eb54-580a-4d0d-94c2-4ad5c2b1d910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:58.453268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168eb54-580a-4d0d-94c2-4ad5c2b1d910 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:58.453533 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168eb54-580a-4d0d-94c2-4ad5c2b1d910 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:58.453813 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a168eb54-580a-4d0d-94c2-4ad5c2b1d910 admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:58.454508 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168eb54-580a-4d0d-94c2-4ad5c2b1d910 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:58.456490 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a168eb54-580a-4d0d-94c2-4ad5c2b1d910 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:58.487987 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1031/2065] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:49:58 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:49:58.489576 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10264761-5a0d-4d86-bc1f-bfdb82fbd90c None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:58.500450 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10264761-5a0d-4d86-bc1f-bfdb82fbd90c None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:58.562794 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92014aa4-cf9e-4acf-8a1e-4856b1d260e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:58.563472 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92014aa4-cf9e-4acf-8a1e-4856b1d260e5 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:58.563752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92014aa4-cf9e-4acf-8a1e-4856b1d260e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:58.564024 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92014aa4-cf9e-4acf-8a1e-4856b1d260e5 admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:58.564728 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92014aa4-cf9e-4acf-8a1e-4856b1d260e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:58.566739 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92014aa4-cf9e-4acf-8a1e-4856b1d260e5 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:58.583832 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:58.592662 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1035/2066] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:49:58 2022] POST /identity/v3/users => generated 296 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:49:58.596372 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168eb54-580a-4d0d-94c2-4ad5c2b1d910 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:58.607147 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a168eb54-580a-4d0d-94c2-4ad5c2b1d910 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:58.612458 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8cdc1a-913a-40b3-ba47-e7c245f51eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:58.613119 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cdc1a-913a-40b3-ba47-e7c245f51eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:58.613401 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cdc1a-913a-40b3-ba47-e7c245f51eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:58.613679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cdc1a-913a-40b3-ba47-e7c245f51eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:58.614442 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8cdc1a-913a-40b3-ba47-e7c245f51eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:58.616054 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8cdc1a-913a-40b3-ba47-e7c245f51eb2 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:58.627452 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1032/2067] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:49:58.631690 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92014aa4-cf9e-4acf-8a1e-4856b1d260e5 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:58.642415 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92014aa4-cf9e-4acf-8a1e-4856b1d260e5 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:58.647762 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a170670-0dc1-43bb-b03f-6f47e5f91494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:58.648634 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a170670-0dc1-43bb-b03f-6f47e5f91494 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:58.648919 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a170670-0dc1-43bb-b03f-6f47e5f91494 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:58.649173 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a170670-0dc1-43bb-b03f-6f47e5f91494 admin admin] PATH_INFO: `/v3/projects/638f533e3cfe47188e234583ab3f0606/users/0a9a4080117340fe906807c086bcee5a/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:58.665622 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a170670-0dc1-43bb-b03f-6f47e5f91494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=638f533e3cfe47188e234583ab3f0606, user_id=0a9a4080117340fe906807c086bcee5a, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:58.668285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a170670-0dc1-43bb-b03f-6f47e5f91494 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:58.683596 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1036/2068] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:49:58 2022] PUT /identity/v3/projects/638f533e3cfe47188e234583ab3f0606/users/0a9a4080117340fe906807c086bcee5a/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:58.687721 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8cdc1a-913a-40b3-ba47-e7c245f51eb2 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:58.698425 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8cdc1a-913a-40b3-ba47-e7c245f51eb2 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:58.732319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:49:58.760965 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299603df-26d2-4294-95fa-5b7c76794825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:58.761660 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299603df-26d2-4294-95fa-5b7c76794825 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:58.761972 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299603df-26d2-4294-95fa-5b7c76794825 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:58.762246 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299603df-26d2-4294-95fa-5b7c76794825 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:58.763003 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299603df-26d2-4294-95fa-5b7c76794825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:58.764611 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299603df-26d2-4294-95fa-5b7c76794825 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:58.774705 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1033/2069] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:49:58.778688 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a170670-0dc1-43bb-b03f-6f47e5f91494 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:58.789317 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a170670-0dc1-43bb-b03f-6f47e5f91494 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:58.794662 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752d7a1-fc5b-4ed9-acab-47aef8a1bf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:58.795557 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752d7a1-fc5b-4ed9-acab-47aef8a1bf77 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:58.795836 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752d7a1-fc5b-4ed9-acab-47aef8a1bf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:58.796110 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2752d7a1-fc5b-4ed9-acab-47aef8a1bf77 admin admin] PATH_INFO: `/v3/projects/638f533e3cfe47188e234583ab3f0606/users/0a9a4080117340fe906807c086bcee5a/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:58.798144 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752d7a1-fc5b-4ed9-acab-47aef8a1bf77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=638f533e3cfe47188e234583ab3f0606, user_id=0a9a4080117340fe906807c086bcee5a, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:58.800788 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2752d7a1-fc5b-4ed9-acab-47aef8a1bf77 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:58.811912 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1037/2070] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:49:58 2022] PUT /identity/v3/projects/638f533e3cfe47188e234583ab3f0606/users/0a9a4080117340fe906807c086bcee5a/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:49:58.822211 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818534d6-3148-4c47-b86c-96fac01a7b0b None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:58.822492 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818534d6-3148-4c47-b86c-96fac01a7b0b None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:58.822788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818534d6-3148-4c47-b86c-96fac01a7b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:58.850080 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-818534d6-3148-4c47-b86c-96fac01a7b0b None None] MFA Rules not processed for user `0a9a4080117340fe906807c086bcee5a`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:49:58.851277 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-818534d6-3148-4c47-b86c-96fac01a7b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:58.922769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1034/2071] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:49:58 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:49:58.966127 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752d7a1-fc5b-4ed9-acab-47aef8a1bf77 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:58.968080 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-2752d7a1-fc5b-4ed9-acab-47aef8a1bf77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:59.029517 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2752d7a1-fc5b-4ed9-acab-47aef8a1bf77 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:59.035348 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5466276-2c45-4b77-bb24-a4b333307876 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:59.036084 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5466276-2c45-4b77-bb24-a4b333307876 service cinder] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:59.036428 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5466276-2c45-4b77-bb24-a4b333307876 service cinder] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:59.036780 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5466276-2c45-4b77-bb24-a4b333307876 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:59.047520 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5466276-2c45-4b77-bb24-a4b333307876 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:59.048983 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5466276-2c45-4b77-bb24-a4b333307876 service cinder] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:59.058475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1038/2072] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:58 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:49:59.190328 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818534d6-3148-4c47-b86c-96fac01a7b0b None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:49:59.192162 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-818534d6-3148-4c47-b86c-96fac01a7b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:49:59.204766 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818534d6-3148-4c47-b86c-96fac01a7b0b None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:49:59.209199 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a6838-4ec1-4aa0-947a-d839f90e8623 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:49:59.209893 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a6838-4ec1-4aa0-947a-d839f90e8623 service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:49:59.210171 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a6838-4ec1-4aa0-947a-d839f90e8623 service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:49:59.210552 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a6838-4ec1-4aa0-947a-d839f90e8623 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:49:59.317699 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a6838-4ec1-4aa0-947a-d839f90e8623 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:49:59.318918 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a6838-4ec1-4aa0-947a-d839f90e8623 service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:49:59.329555 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1035/2073] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:49:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:50:07.232817 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5466276-2c45-4b77-bb24-a4b333307876 service cinder] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:07.298893 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5466276-2c45-4b77-bb24-a4b333307876 service cinder] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:07.304668 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753896f6-0fd2-4663-af54-b2b59c734433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:07.305545 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753896f6-0fd2-4663-af54-b2b59c734433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:07.305834 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753896f6-0fd2-4663-af54-b2b59c734433 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:07.306345 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753896f6-0fd2-4663-af54-b2b59c734433 admin admin] PATH_INFO: `/v3/users/dc80461341eb4b37a3c88569d6d191f4` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:07.307615 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753896f6-0fd2-4663-af54-b2b59c734433 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc80461341eb4b37a3c88569d6d191f4)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:07.309561 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753896f6-0fd2-4663-af54-b2b59c734433 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:07.357286 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-753896f6-0fd2-4663-af54-b2b59c734433 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc80461341eb4b37a3c88569d6d191f4'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:07.368953 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-753896f6-0fd2-4663-af54-b2b59c734433 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc80461341eb4b37a3c88569d6d191f4'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:07.370237 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:07.378150 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-753896f6-0fd2-4663-af54-b2b59c734433 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc80461341eb4b37a3c88569d6d191f4'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:07.379343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-753896f6-0fd2-4663-af54-b2b59c734433 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc80461341eb4b37a3c88569d6d191f4'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:07.379951 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-753896f6-0fd2-4663-af54-b2b59c734433 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc80461341eb4b37a3c88569d6d191f4'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:07.392642 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1039/2074] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:50:07 2022] DELETE /identity/v3/users/dc80461341eb4b37a3c88569d6d191f4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:07.397732 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a078e6-7f80-411a-a2af-8812f525efae None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:07.398238 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a078e6-7f80-411a-a2af-8812f525efae None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:07.398329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a078e6-7f80-411a-a2af-8812f525efae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:07.418001 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-44a078e6-7f80-411a-a2af-8812f525efae None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:07.419231 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-44a078e6-7f80-411a-a2af-8812f525efae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:07.471549 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:07.484750 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1036/2075] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:50:07.494253 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753896f6-0fd2-4663-af54-b2b59c734433 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:07.496220 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-753896f6-0fd2-4663-af54-b2b59c734433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:07.559164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753896f6-0fd2-4663-af54-b2b59c734433 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:07.563983 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3377f-7a3a-4c60-9c66-43f0e53f6d21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:07.564665 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3377f-7a3a-4c60-9c66-43f0e53f6d21 service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:07.564948 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3377f-7a3a-4c60-9c66-43f0e53f6d21 service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:07.565224 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3377f-7a3a-4c60-9c66-43f0e53f6d21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:07.580208 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3377f-7a3a-4c60-9c66-43f0e53f6d21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:07.581655 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce3377f-7a3a-4c60-9c66-43f0e53f6d21 service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:07.592616 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1040/2076] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:50:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:50:07.911969 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a078e6-7f80-411a-a2af-8812f525efae None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:07.914234 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-44a078e6-7f80-411a-a2af-8812f525efae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:07.945612 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a078e6-7f80-411a-a2af-8812f525efae None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:07.957461 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee74e2e-fd16-4da1-b980-729e656fa961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:07.959075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee74e2e-fd16-4da1-b980-729e656fa961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:07.959367 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee74e2e-fd16-4da1-b980-729e656fa961 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:07.959730 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee74e2e-fd16-4da1-b980-729e656fa961 admin admin] PATH_INFO: `/v3/projects/6bc20ed895164014ad77965387dc7317` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:07.961112 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee74e2e-fd16-4da1-b980-729e656fa961 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bc20ed895164014ad77965387dc7317)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:07.963163 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee74e2e-fd16-4da1-b980-729e656fa961 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:08.018064 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-cee74e2e-fd16-4da1-b980-729e656fa961 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bc20ed895164014ad77965387dc7317', 'request_id': 'req-cee74e2e-fd16-4da1-b980-729e656fa961'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:08.024845 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-cee74e2e-fd16-4da1-b980-729e656fa961 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bc20ed895164014ad77965387dc7317', 'request_id': 'req-cee74e2e-fd16-4da1-b980-729e656fa961'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:08.032845 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-cee74e2e-fd16-4da1-b980-729e656fa961 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bc20ed895164014ad77965387dc7317', 'request_id': 'req-cee74e2e-fd16-4da1-b980-729e656fa961'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:08.044394 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-cee74e2e-fd16-4da1-b980-729e656fa961 admin admin] The token cache is being invalidate because project 6bc20ed895164014ad77965387dc7317 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:50:08.044738 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-cee74e2e-fd16-4da1-b980-729e656fa961 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:08.045419 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-cee74e2e-fd16-4da1-b980-729e656fa961 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:08.047031 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1037/2077] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:50:07 2022] DELETE /identity/v3/projects/6bc20ed895164014ad77965387dc7317 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:08.051274 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3377f-7a3a-4c60-9c66-43f0e53f6d21 service neutron] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:08.061424 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3377f-7a3a-4c60-9c66-43f0e53f6d21 service neutron] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:08.137707 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ef44f-d464-4146-8b58-863f9cb808c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:08.138653 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ef44f-d464-4146-8b58-863f9cb808c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:08.138950 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ef44f-d464-4146-8b58-863f9cb808c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:08.139204 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ef44f-d464-4146-8b58-863f9cb808c4 admin admin] PATH_INFO: `/v3/users/0a9a4080117340fe906807c086bcee5a` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:08.140393 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ef44f-d464-4146-8b58-863f9cb808c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a9a4080117340fe906807c086bcee5a)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:08.142373 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ef44f-d464-4146-8b58-863f9cb808c4 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:08.195222 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-cc9ef44f-d464-4146-8b58-863f9cb808c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a9a4080117340fe906807c086bcee5a'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:08.208644 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-cc9ef44f-d464-4146-8b58-863f9cb808c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a9a4080117340fe906807c086bcee5a'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:08.215389 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-cc9ef44f-d464-4146-8b58-863f9cb808c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a9a4080117340fe906807c086bcee5a'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:08.216102 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-cc9ef44f-d464-4146-8b58-863f9cb808c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a9a4080117340fe906807c086bcee5a'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:08.216910 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-cc9ef44f-d464-4146-8b58-863f9cb808c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a9a4080117340fe906807c086bcee5a'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:08.230829 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1041/2078] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:50:08 2022] DELETE /identity/v3/users/0a9a4080117340fe906807c086bcee5a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:08.504277 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee74e2e-fd16-4da1-b980-729e656fa961 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:08.506118 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-cee74e2e-fd16-4da1-b980-729e656fa961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:08.520508 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee74e2e-fd16-4da1-b980-729e656fa961 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:08.578203 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f880c-53cb-4ba3-8ad0-214c8d5913d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:08.579071 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f880c-53cb-4ba3-8ad0-214c8d5913d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:08.579357 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f880c-53cb-4ba3-8ad0-214c8d5913d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:08.579664 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f880c-53cb-4ba3-8ad0-214c8d5913d7 admin admin] PATH_INFO: `/v3/projects/638f533e3cfe47188e234583ab3f0606` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:08.580889 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f880c-53cb-4ba3-8ad0-214c8d5913d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=638f533e3cfe47188e234583ab3f0606)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:08.582882 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f880c-53cb-4ba3-8ad0-214c8d5913d7 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:08.630817 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-582f880c-53cb-4ba3-8ad0-214c8d5913d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '638f533e3cfe47188e234583ab3f0606', 'request_id': 'req-582f880c-53cb-4ba3-8ad0-214c8d5913d7'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:08.637400 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-582f880c-53cb-4ba3-8ad0-214c8d5913d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '638f533e3cfe47188e234583ab3f0606', 'request_id': 'req-582f880c-53cb-4ba3-8ad0-214c8d5913d7'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:08.650397 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-582f880c-53cb-4ba3-8ad0-214c8d5913d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '638f533e3cfe47188e234583ab3f0606', 'request_id': 'req-582f880c-53cb-4ba3-8ad0-214c8d5913d7'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:08.663294 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-582f880c-53cb-4ba3-8ad0-214c8d5913d7 admin admin] The token cache is being invalidate because project 638f533e3cfe47188e234583ab3f0606 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:50:08.663579 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-582f880c-53cb-4ba3-8ad0-214c8d5913d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:08.664308 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-582f880c-53cb-4ba3-8ad0-214c8d5913d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:08.666379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1038/2079] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:50:08 2022] DELETE /identity/v3/projects/638f533e3cfe47188e234583ab3f0606 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:08.672195 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f47ff3-0a6b-4f4a-a987-7161f35e18b1 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:08.672661 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f47ff3-0a6b-4f4a-a987-7161f35e18b1 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:08.673118 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f47ff3-0a6b-4f4a-a987-7161f35e18b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:08.680234 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:08.693054 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-a6f47ff3-0a6b-4f4a-a987-7161f35e18b1 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:08.695659 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f880c-53cb-4ba3-8ad0-214c8d5913d7 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:08.697179 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-582f880c-53cb-4ba3-8ad0-214c8d5913d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:08.697299 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-a6f47ff3-0a6b-4f4a-a987-7161f35e18b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:08.709230 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:08.764645 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1042/2080] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:50:08.772398 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbc9d5-97b7-4a94-bf12-cc04d995be15 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:08.772682 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbc9d5-97b7-4a94-bf12-cc04d995be15 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:08.772956 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbc9d5-97b7-4a94-bf12-cc04d995be15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:08.785414 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f880c-53cb-4ba3-8ad0-214c8d5913d7 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:08.791302 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c3450-e93c-47a3-97a8-290127e67cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:08.792320 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-89dbc9d5-97b7-4a94-bf12-cc04d995be15 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:08.794984 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-89dbc9d5-97b7-4a94-bf12-cc04d995be15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:08.795129 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c3450-e93c-47a3-97a8-290127e67cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:08.795129 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c3450-e93c-47a3-97a8-290127e67cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:08.801496 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c3450-e93c-47a3-97a8-290127e67cc9 admin admin] PATH_INFO: `/v3/users/f4cebab0e8bc4bbd8d65b0d1e557e60c` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:08.803010 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c3450-e93c-47a3-97a8-290127e67cc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4cebab0e8bc4bbd8d65b0d1e557e60c)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:08.805700 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c3450-e93c-47a3-97a8-290127e67cc9 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:08.809449 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1043/2081] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:50:08.814692 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dbc9d5-97b7-4a94-bf12-cc04d995be15 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:08.824627 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dbc9d5-97b7-4a94-bf12-cc04d995be15 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:08.831467 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9e1ce-e019-4547-9852-b24b492c99a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:08.839854 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9e1ce-e019-4547-9852-b24b492c99a2 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:08.840197 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9e1ce-e019-4547-9852-b24b492c99a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:08.840484 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9e1ce-e019-4547-9852-b24b492c99a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:08.841255 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f9e1ce-e019-4547-9852-b24b492c99a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:50:08.841606 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f9e1ce-e019-4547-9852-b24b492c99a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:08.843386 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f9e1ce-e019-4547-9852-b24b492c99a2 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:08.867149 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1044/2082] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:50:08.868641 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9e1ce-e019-4547-9852-b24b492c99a2 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:08.878453 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-f80c3450-e93c-47a3-97a8-290127e67cc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4cebab0e8bc4bbd8d65b0d1e557e60c'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:08.881778 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9e1ce-e019-4547-9852-b24b492c99a2 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:08.885621 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-f80c3450-e93c-47a3-97a8-290127e67cc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4cebab0e8bc4bbd8d65b0d1e557e60c'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:08.888235 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc05fc4-13ea-4544-a7fc-e067e0f9e907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:08.888972 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc05fc4-13ea-4544-a7fc-e067e0f9e907 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:08.889249 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc05fc4-13ea-4544-a7fc-e067e0f9e907 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:08.889518 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc05fc4-13ea-4544-a7fc-e067e0f9e907 admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:08.890236 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc05fc4-13ea-4544-a7fc-e067e0f9e907 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:08.892199 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc05fc4-13ea-4544-a7fc-e067e0f9e907 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:08.901812 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-f80c3450-e93c-47a3-97a8-290127e67cc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4cebab0e8bc4bbd8d65b0d1e557e60c'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:08.902600 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-f80c3450-e93c-47a3-97a8-290127e67cc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4cebab0e8bc4bbd8d65b0d1e557e60c'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:08.903219 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-f80c3450-e93c-47a3-97a8-290127e67cc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4cebab0e8bc4bbd8d65b0d1e557e60c'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:08.922981 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1039/2083] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:50:08 2022] DELETE /identity/v3/users/f4cebab0e8bc4bbd8d65b0d1e557e60c => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:08.923174 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1045/2084] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:50:08 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:50:08.925054 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31075cdf-ea1c-4729-8582-820219d2d55a None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:08.925344 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31075cdf-ea1c-4729-8582-820219d2d55a None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:08.925618 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31075cdf-ea1c-4729-8582-820219d2d55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:08.927561 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc05fc4-13ea-4544-a7fc-e067e0f9e907 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:08.929309 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-2cc05fc4-13ea-4544-a7fc-e067e0f9e907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:08.944397 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-31075cdf-ea1c-4729-8582-820219d2d55a None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:08.945602 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-31075cdf-ea1c-4729-8582-820219d2d55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:09.009733 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc05fc4-13ea-4544-a7fc-e067e0f9e907 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:09.016732 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1040/2085] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:50:09.021956 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8823885-11c1-49f5-a4ff-7aa8b9546c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:09.022754 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8823885-11c1-49f5-a4ff-7aa8b9546c6d admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:09.023137 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8823885-11c1-49f5-a4ff-7aa8b9546c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:09.023483 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8823885-11c1-49f5-a4ff-7aa8b9546c6d admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:09.024294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8823885-11c1-49f5-a4ff-7aa8b9546c6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:09.026760 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8823885-11c1-49f5-a4ff-7aa8b9546c6d admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:09.033659 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31075cdf-ea1c-4729-8582-820219d2d55a None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:09.040513 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-31075cdf-ea1c-4729-8582-820219d2d55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:09.066194 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1046/2086] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:50:08 2022] POST /identity/v3/users => generated 283 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:50:09.071565 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8823885-11c1-49f5-a4ff-7aa8b9546c6d admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:09.088431 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8823885-11c1-49f5-a4ff-7aa8b9546c6d admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:09.096744 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e38db-6471-4dbb-a37c-1a69a3121ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:09.097576 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e38db-6471-4dbb-a37c-1a69a3121ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:09.098080 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e38db-6471-4dbb-a37c-1a69a3121ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:09.098459 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e38db-6471-4dbb-a37c-1a69a3121ad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:09.098695 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:09.099394 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e38db-6471-4dbb-a37c-1a69a3121ad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:09.101183 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e38db-6471-4dbb-a37c-1a69a3121ad9 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:09.120703 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1047/2087] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:50:09.124452 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e38db-6471-4dbb-a37c-1a69a3121ad9 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:09.136112 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e38db-6471-4dbb-a37c-1a69a3121ad9 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:09.153237 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7112c10-6b96-4bef-b3e7-02c2652c429b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:09.157658 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7112c10-6b96-4bef-b3e7-02c2652c429b admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:09.160271 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7112c10-6b96-4bef-b3e7-02c2652c429b admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:09.160742 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7112c10-6b96-4bef-b3e7-02c2652c429b admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:09.162080 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7112c10-6b96-4bef-b3e7-02c2652c429b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:09.166870 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7112c10-6b96-4bef-b3e7-02c2652c429b admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:09.169977 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31075cdf-ea1c-4729-8582-820219d2d55a None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:09.181815 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4694f4-3a4a-48a6-8e00-29e00c9165a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:09.182618 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4694f4-3a4a-48a6-8e00-29e00c9165a9 service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:09.182963 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4694f4-3a4a-48a6-8e00-29e00c9165a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:09.184851 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4694f4-3a4a-48a6-8e00-29e00c9165a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:09.193526 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1048/2088] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:50:09.198565 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7112c10-6b96-4bef-b3e7-02c2652c429b admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:09.200498 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4694f4-3a4a-48a6-8e00-29e00c9165a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:09.202382 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4694f4-3a4a-48a6-8e00-29e00c9165a9 service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:09.213118 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1041/2089] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:50:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:50:09.214211 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4694f4-3a4a-48a6-8e00-29e00c9165a9 service neutron] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:09.215697 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-9b4694f4-3a4a-48a6-8e00-29e00c9165a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:09.228148 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7112c10-6b96-4bef-b3e7-02c2652c429b admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:09.232323 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4694f4-3a4a-48a6-8e00-29e00c9165a9 service neutron] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:09.236772 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c703ed-cefc-4208-9f39-533f471b7229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:09.237911 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c703ed-cefc-4208-9f39-533f471b7229 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:09.238160 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c703ed-cefc-4208-9f39-533f471b7229 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:09.238433 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c703ed-cefc-4208-9f39-533f471b7229 admin admin] PATH_INFO: `/v3/projects/77a75f485fd24b2cb901792b2bcf8c88/users/8a505a6541c143b8b4854a67f8e333d8/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:09.239935 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f52538-c5f0-4597-bfbb-4cdc02692be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:09.240909 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f52538-c5f0-4597-bfbb-4cdc02692be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:09.241472 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f52538-c5f0-4597-bfbb-4cdc02692be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:09.241752 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f52538-c5f0-4597-bfbb-4cdc02692be2 admin admin] PATH_INFO: `/v3/users/3b17481e91824953be5d8d70a0862596` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:09.244048 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f52538-c5f0-4597-bfbb-4cdc02692be2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b17481e91824953be5d8d70a0862596)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:09.247781 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f52538-c5f0-4597-bfbb-4cdc02692be2 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:09.261535 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c703ed-cefc-4208-9f39-533f471b7229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a75f485fd24b2cb901792b2bcf8c88, user_id=8a505a6541c143b8b4854a67f8e333d8, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:09.266909 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c703ed-cefc-4208-9f39-533f471b7229 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:09.283985 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1049/2090] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:50:09 2022] PUT /identity/v3/projects/77a75f485fd24b2cb901792b2bcf8c88/users/8a505a6541c143b8b4854a67f8e333d8/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:50:09.296512 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd37bc-9e72-4e43-9083-cd70d4d4bce5 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:09.296901 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd37bc-9e72-4e43-9083-cd70d4d4bce5 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:09.297186 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd37bc-9e72-4e43-9083-cd70d4d4bce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:09.311085 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-41f52538-c5f0-4597-bfbb-4cdc02692be2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b17481e91824953be5d8d70a0862596'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:09.311660 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:09.327414 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-41f52538-c5f0-4597-bfbb-4cdc02692be2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b17481e91824953be5d8d70a0862596'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:09.338051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-94cd37bc-9e72-4e43-9083-cd70d4d4bce5 None None] MFA Rules not processed for user `8a505a6541c143b8b4854a67f8e333d8`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:09.339131 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-94cd37bc-9e72-4e43-9083-cd70d4d4bce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:09.355288 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-41f52538-c5f0-4597-bfbb-4cdc02692be2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b17481e91824953be5d8d70a0862596'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:09.356040 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-41f52538-c5f0-4597-bfbb-4cdc02692be2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b17481e91824953be5d8d70a0862596'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:09.356651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-41f52538-c5f0-4597-bfbb-4cdc02692be2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b17481e91824953be5d8d70a0862596'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:09.388345 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1042/2091] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:50:09 2022] DELETE /identity/v3/users/3b17481e91824953be5d8d70a0862596 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:09.392703 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011953e5-b89c-412f-9109-3fc9ce1e234e None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:09.392971 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011953e5-b89c-412f-9109-3fc9ce1e234e None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:09.393406 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011953e5-b89c-412f-9109-3fc9ce1e234e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:09.436527 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1050/2092] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:09 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:50:09.451536 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd37bc-9e72-4e43-9083-cd70d4d4bce5 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:09.453438 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-011953e5-b89c-412f-9109-3fc9ce1e234e None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:09.453803 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-94cd37bc-9e72-4e43-9083-cd70d4d4bce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:09.455601 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-011953e5-b89c-412f-9109-3fc9ce1e234e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:09.532380 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1043/2093] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:50:09.539628 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011953e5-b89c-412f-9109-3fc9ce1e234e None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:09.541588 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-011953e5-b89c-412f-9109-3fc9ce1e234e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:09.544294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd37bc-9e72-4e43-9083-cd70d4d4bce5 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:09.553225 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386631f-b36c-4980-a3a7-c50ce75c567a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:09.554603 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386631f-b36c-4980-a3a7-c50ce75c567a admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:09.555052 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386631f-b36c-4980-a3a7-c50ce75c567a admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:09.555590 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386631f-b36c-4980-a3a7-c50ce75c567a admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:09.556420 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386631f-b36c-4980-a3a7-c50ce75c567a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:09.558477 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386631f-b36c-4980-a3a7-c50ce75c567a admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:09.599144 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:09.612494 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1051/2094] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:50:09 2022] POST /identity/v3/projects => generated 365 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:50:09.613292 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386631f-b36c-4980-a3a7-c50ce75c567a admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:09.615397 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-7386631f-b36c-4980-a3a7-c50ce75c567a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:09.633447 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011953e5-b89c-412f-9109-3fc9ce1e234e None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:09.686608 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c7e26-e907-41fb-88bd-52ecf34505cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:09.687171 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c7e26-e907-41fb-88bd-52ecf34505cc service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:09.687468 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c7e26-e907-41fb-88bd-52ecf34505cc service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:09.687793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c7e26-e907-41fb-88bd-52ecf34505cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:09.692818 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386631f-b36c-4980-a3a7-c50ce75c567a admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:09.697663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22cc4cc-2e3f-41cc-abaf-dbee4f472f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:09.698603 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c7e26-e907-41fb-88bd-52ecf34505cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:09.698719 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cc4cc-2e3f-41cc-abaf-dbee4f472f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:09.698999 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cc4cc-2e3f-41cc-abaf-dbee4f472f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:09.699327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22cc4cc-2e3f-41cc-abaf-dbee4f472f77 admin admin] PATH_INFO: `/v3/projects/50b7da054278448da90178dddc0a71de` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:09.700095 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c7e26-e907-41fb-88bd-52ecf34505cc service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:09.700611 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22cc4cc-2e3f-41cc-abaf-dbee4f472f77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50b7da054278448da90178dddc0a71de)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:09.702705 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22cc4cc-2e3f-41cc-abaf-dbee4f472f77 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:09.709754 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1044/2095] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:50:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:50:09.710578 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c7e26-e907-41fb-88bd-52ecf34505cc service neutron] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:09.730306 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c7e26-e907-41fb-88bd-52ecf34505cc service neutron] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:09.732625 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:09.737332 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d69c4b4-55f4-4cb9-89c4-c8385af4d51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:09.738144 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69c4b4-55f4-4cb9-89c4-c8385af4d51b admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:09.739058 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69c4b4-55f4-4cb9-89c4-c8385af4d51b admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:09.739399 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69c4b4-55f4-4cb9-89c4-c8385af4d51b admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:09.740086 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d69c4b4-55f4-4cb9-89c4-c8385af4d51b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:09.742562 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d69c4b4-55f4-4cb9-89c4-c8385af4d51b admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:09.767167 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1045/2096] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:50:09 2022] POST /identity/v3/users => generated 289 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:50:09.771118 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c22cc4cc-2e3f-41cc-abaf-dbee4f472f77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50b7da054278448da90178dddc0a71de', 'request_id': 'req-c22cc4cc-2e3f-41cc-abaf-dbee4f472f77'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:09.771290 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d69c4b4-55f4-4cb9-89c4-c8385af4d51b admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:09.778225 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c22cc4cc-2e3f-41cc-abaf-dbee4f472f77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50b7da054278448da90178dddc0a71de', 'request_id': 'req-c22cc4cc-2e3f-41cc-abaf-dbee4f472f77'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:09.783583 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d69c4b4-55f4-4cb9-89c4-c8385af4d51b admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:09.787272 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c22cc4cc-2e3f-41cc-abaf-dbee4f472f77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50b7da054278448da90178dddc0a71de', 'request_id': 'req-c22cc4cc-2e3f-41cc-abaf-dbee4f472f77'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:09.800833 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c22cc4cc-2e3f-41cc-abaf-dbee4f472f77 admin admin] The token cache is being invalidate because project 50b7da054278448da90178dddc0a71de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:50:09.801120 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c22cc4cc-2e3f-41cc-abaf-dbee4f472f77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:09.801787 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c22cc4cc-2e3f-41cc-abaf-dbee4f472f77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:09.803703 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1052/2097] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:50:09 2022] DELETE /identity/v3/projects/50b7da054278448da90178dddc0a71de => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:09.808367 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63617bd-1b0f-4c96-933e-d2587dc945d5 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:09.809102 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63617bd-1b0f-4c96-933e-d2587dc945d5 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:09.809102 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63617bd-1b0f-4c96-933e-d2587dc945d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:09.831575 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-c63617bd-1b0f-4c96-933e-d2587dc945d5 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:09.832815 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-c63617bd-1b0f-4c96-933e-d2587dc945d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:09.857162 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4af0b9-582b-491a-b4cb-cb0338a1fb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:09.857994 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4af0b9-582b-491a-b4cb-cb0338a1fb8b admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:09.858278 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4af0b9-582b-491a-b4cb-cb0338a1fb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:09.858552 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4af0b9-582b-491a-b4cb-cb0338a1fb8b admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:09.859280 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4af0b9-582b-491a-b4cb-cb0338a1fb8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:09.861765 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4af0b9-582b-491a-b4cb-cb0338a1fb8b admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:09.886419 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1046/2098] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:50:09.887773 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4af0b9-582b-491a-b4cb-cb0338a1fb8b admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:09.889737 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-9a4af0b9-582b-491a-b4cb-cb0338a1fb8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:09.909453 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4af0b9-582b-491a-b4cb-cb0338a1fb8b admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:09.916015 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd7dac7-489d-4f01-836e-d491e64cace1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:09.917090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7dac7-489d-4f01-836e-d491e64cace1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:09.917218 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7dac7-489d-4f01-836e-d491e64cace1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:09.917440 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7dac7-489d-4f01-836e-d491e64cace1 admin admin] PATH_INFO: `/v3/projects/f01e84c5e09b446eacae9d3051f8d939/users/f86d30111a99442db9d87de602b84e48/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:09.922010 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1053/2099] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:50:09.929257 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fa185-41cf-4aec-bfb4-4c5465f6e34d None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:09.929543 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fa185-41cf-4aec-bfb4-4c5465f6e34d None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:09.929819 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fa185-41cf-4aec-bfb4-4c5465f6e34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:09.934312 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd7dac7-489d-4f01-836e-d491e64cace1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f01e84c5e09b446eacae9d3051f8d939, user_id=f86d30111a99442db9d87de602b84e48, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:09.937314 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd7dac7-489d-4f01-836e-d491e64cace1 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:09.956083 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1047/2100] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:50:09 2022] PUT /identity/v3/projects/f01e84c5e09b446eacae9d3051f8d939/users/f86d30111a99442db9d87de602b84e48/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:50:09.959963 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd7dac7-489d-4f01-836e-d491e64cace1 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:09.960218 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-b86fa185-41cf-4aec-bfb4-4c5465f6e34d None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:09.961499 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-b86fa185-41cf-4aec-bfb4-4c5465f6e34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:10.049324 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1054/2101] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:50:10.050228 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86fa185-41cf-4aec-bfb4-4c5465f6e34d None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:10.051522 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-b86fa185-41cf-4aec-bfb4-4c5465f6e34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:10.070292 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:10.074433 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86fa185-41cf-4aec-bfb4-4c5465f6e34d None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:10.075808 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd7dac7-489d-4f01-836e-d491e64cace1 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:10.079657 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4cb09-ba3a-41fe-99eb-6997324e4120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:10.080529 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4cb09-ba3a-41fe-99eb-6997324e4120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:10.080814 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4cb09-ba3a-41fe-99eb-6997324e4120 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:10.081077 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4cb09-ba3a-41fe-99eb-6997324e4120 admin admin] PATH_INFO: `/v3/projects/cded29f9488d4eb79e90e7b4401cf97d` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:10.082172 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48495750-3cc2-49ea-9f47-be277f40df73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:10.082309 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4cb09-ba3a-41fe-99eb-6997324e4120 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cded29f9488d4eb79e90e7b4401cf97d)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:10.082968 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48495750-3cc2-49ea-9f47-be277f40df73 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:10.083318 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48495750-3cc2-49ea-9f47-be277f40df73 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:10.083677 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48495750-3cc2-49ea-9f47-be277f40df73 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:10.084220 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4cb09-ba3a-41fe-99eb-6997324e4120 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:10.084541 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48495750-3cc2-49ea-9f47-be277f40df73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:10.086266 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48495750-3cc2-49ea-9f47-be277f40df73 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:10.097882 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1048/2102] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:50:10.098674 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48495750-3cc2-49ea-9f47-be277f40df73 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:10.108504 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48495750-3cc2-49ea-9f47-be277f40df73 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:10.114356 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab24e9e-37a9-48eb-a485-bb44df656009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:10.115141 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab24e9e-37a9-48eb-a485-bb44df656009 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:10.115460 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab24e9e-37a9-48eb-a485-bb44df656009 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:10.115904 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab24e9e-37a9-48eb-a485-bb44df656009 admin admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:10.116725 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab24e9e-37a9-48eb-a485-bb44df656009 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:50:10.117092 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab24e9e-37a9-48eb-a485-bb44df656009 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:10.118799 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab24e9e-37a9-48eb-a485-bb44df656009 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:10.133932 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1049/2103] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:50:10.134794 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab24e9e-37a9-48eb-a485-bb44df656009 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:10.140970 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:10.142891 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-e8e4cb09-ba3a-41fe-99eb-6997324e4120 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cded29f9488d4eb79e90e7b4401cf97d', 'request_id': 'req-e8e4cb09-ba3a-41fe-99eb-6997324e4120'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:10.149588 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab24e9e-37a9-48eb-a485-bb44df656009 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:10.151440 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-e8e4cb09-ba3a-41fe-99eb-6997324e4120 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cded29f9488d4eb79e90e7b4401cf97d', 'request_id': 'req-e8e4cb09-ba3a-41fe-99eb-6997324e4120'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:10.163595 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-e8e4cb09-ba3a-41fe-99eb-6997324e4120 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cded29f9488d4eb79e90e7b4401cf97d', 'request_id': 'req-e8e4cb09-ba3a-41fe-99eb-6997324e4120'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:10.176030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-e8e4cb09-ba3a-41fe-99eb-6997324e4120 admin admin] The token cache is being invalidate because project cded29f9488d4eb79e90e7b4401cf97d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:50:10.176419 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-e8e4cb09-ba3a-41fe-99eb-6997324e4120 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:10.180237 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-e8e4cb09-ba3a-41fe-99eb-6997324e4120 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:10.180237 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1055/2104] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:50:10 2022] DELETE /identity/v3/projects/cded29f9488d4eb79e90e7b4401cf97d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:10.181641 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4cb09-ba3a-41fe-99eb-6997324e4120 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:10.182494 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-e8e4cb09-ba3a-41fe-99eb-6997324e4120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:10.291713 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9b161-7872-43ca-b758-7a0b4d801833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:10.292659 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9b161-7872-43ca-b758-7a0b4d801833 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:10.292929 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9b161-7872-43ca-b758-7a0b4d801833 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:10.293177 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9b161-7872-43ca-b758-7a0b4d801833 admin admin] PATH_INFO: `/v3/projects/f01e84c5e09b446eacae9d3051f8d939/users/f86d30111a99442db9d87de602b84e48/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:10.300834 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9b161-7872-43ca-b758-7a0b4d801833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f01e84c5e09b446eacae9d3051f8d939, user_id=f86d30111a99442db9d87de602b84e48, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:10.303862 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4cb09-ba3a-41fe-99eb-6997324e4120 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:10.305870 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9b161-7872-43ca-b758-7a0b4d801833 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:10.308894 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca0492-0839-424a-8df7-ac23d5673170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:10.309565 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca0492-0839-424a-8df7-ac23d5673170 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:10.309835 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca0492-0839-424a-8df7-ac23d5673170 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:10.310329 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca0492-0839-424a-8df7-ac23d5673170 admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:10.312157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca0492-0839-424a-8df7-ac23d5673170 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:10.313036 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca0492-0839-424a-8df7-ac23d5673170 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:10.332431 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1050/2105] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:50:10 2022] PUT /identity/v3/projects/f01e84c5e09b446eacae9d3051f8d939/users/f86d30111a99442db9d87de602b84e48/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:10.349207 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04c092-825f-4d28-82a1-0aea6772484c None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:10.350020 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04c092-825f-4d28-82a1-0aea6772484c None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:10.350656 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04c092-825f-4d28-82a1-0aea6772484c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:10.354002 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1056/2106] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:50:10 2022] POST /identity/v3/projects => generated 383 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:50:10.356256 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca0492-0839-424a-8df7-ac23d5673170 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:10.405807 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-ff04c092-825f-4d28-82a1-0aea6772484c None None] MFA Rules not processed for user `f86d30111a99442db9d87de602b84e48`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:10.407358 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-ff04c092-825f-4d28-82a1-0aea6772484c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:10.432833 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca0492-0839-424a-8df7-ac23d5673170 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:10.438458 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a97798-00dc-44dc-8a3f-742263a8caaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:10.439210 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a97798-00dc-44dc-8a3f-742263a8caaf admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:10.439641 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a97798-00dc-44dc-8a3f-742263a8caaf admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:10.439808 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a97798-00dc-44dc-8a3f-742263a8caaf admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:10.440503 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a97798-00dc-44dc-8a3f-742263a8caaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:10.442577 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a97798-00dc-44dc-8a3f-742263a8caaf admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:10.467056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1057/2107] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:50:10 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:50:10.470977 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a97798-00dc-44dc-8a3f-742263a8caaf admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:10.480434 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a97798-00dc-44dc-8a3f-742263a8caaf admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:10.485020 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf822c9-e301-4c4c-8e58-d06414ad1ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:10.485662 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf822c9-e301-4c4c-8e58-d06414ad1ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:10.489775 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1051/2108] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:10 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:50:10.489934 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf822c9-e301-4c4c-8e58-d06414ad1ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:10.489934 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf822c9-e301-4c4c-8e58-d06414ad1ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:10.489934 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf822c9-e301-4c4c-8e58-d06414ad1ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:10.489934 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf822c9-e301-4c4c-8e58-d06414ad1ab4 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:10.497449 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04c092-825f-4d28-82a1-0aea6772484c None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:10.498883 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-ff04c092-825f-4d28-82a1-0aea6772484c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:10.499879 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1058/2109] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:50:10.503456 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf822c9-e301-4c4c-8e58-d06414ad1ab4 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:10.513246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf822c9-e301-4c4c-8e58-d06414ad1ab4 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:10.517946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a281bcb-82e9-4fb8-b644-5b7414b858ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:10.518642 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a281bcb-82e9-4fb8-b644-5b7414b858ea admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:10.518926 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a281bcb-82e9-4fb8-b644-5b7414b858ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:10.519201 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a281bcb-82e9-4fb8-b644-5b7414b858ea admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:10.519917 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a281bcb-82e9-4fb8-b644-5b7414b858ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:10.521514 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a281bcb-82e9-4fb8-b644-5b7414b858ea admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:10.532333 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1059/2110] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:50:10.536417 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a281bcb-82e9-4fb8-b644-5b7414b858ea admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:10.547317 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a281bcb-82e9-4fb8-b644-5b7414b858ea admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:10.551858 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3cbe7-c944-44fa-b9a9-1b340d5a35f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:10.552721 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3cbe7-c944-44fa-b9a9-1b340d5a35f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:10.552998 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3cbe7-c944-44fa-b9a9-1b340d5a35f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:10.553310 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3cbe7-c944-44fa-b9a9-1b340d5a35f6 admin admin] PATH_INFO: `/v3/projects/9263b57dbc724cd1ba5e2b8e9f8954ec/users/5abb12fa284648208d829cdfa6fee847/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:10.557406 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04c092-825f-4d28-82a1-0aea6772484c None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:10.561970 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52a2ba-9194-49a5-96f8-045dfd109912 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:10.562641 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52a2ba-9194-49a5-96f8-045dfd109912 service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:10.562925 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52a2ba-9194-49a5-96f8-045dfd109912 service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:10.563384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52a2ba-9194-49a5-96f8-045dfd109912 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:10.573445 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac3cbe7-c944-44fa-b9a9-1b340d5a35f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9263b57dbc724cd1ba5e2b8e9f8954ec, user_id=5abb12fa284648208d829cdfa6fee847, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:10.575149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52a2ba-9194-49a5-96f8-045dfd109912 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:10.576548 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac3cbe7-c944-44fa-b9a9-1b340d5a35f6 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:10.576774 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52a2ba-9194-49a5-96f8-045dfd109912 service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:10.587682 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1052/2111] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:50:10 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:50:10.591670 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1060/2112] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:50:10 2022] PUT /identity/v3/projects/9263b57dbc724cd1ba5e2b8e9f8954ec/users/5abb12fa284648208d829cdfa6fee847/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:50:10.601934 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a61891-e40b-40cf-8afd-69a04fa6a3b1 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:10.602242 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a61891-e40b-40cf-8afd-69a04fa6a3b1 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:10.602520 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a61891-e40b-40cf-8afd-69a04fa6a3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:10.609768 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:10.636734 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-c4a61891-e40b-40cf-8afd-69a04fa6a3b1 None None] MFA Rules not processed for user `5abb12fa284648208d829cdfa6fee847`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:10.637980 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-c4a61891-e40b-40cf-8afd-69a04fa6a3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:10.707822 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1053/2113] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:50:10.719051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3cbe7-c944-44fa-b9a9-1b340d5a35f6 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:10.725186 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=91,keystone:DELETE=3,keystone:INSERT=6 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:10.780083 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3cbe7-c944-44fa-b9a9-1b340d5a35f6 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:10.783671 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ab1df-91c1-4170-a316-dc80fcb8d55e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:10.784308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ab1df-91c1-4170-a316-dc80fcb8d55e service cinder] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:10.784582 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ab1df-91c1-4170-a316-dc80fcb8d55e service cinder] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:10.784878 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ab1df-91c1-4170-a316-dc80fcb8d55e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:10.793648 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ab1df-91c1-4170-a316-dc80fcb8d55e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:10.795140 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ab1df-91c1-4170-a316-dc80fcb8d55e service cinder] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:10.805999 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1061/2114] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:50:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:50:11.010297 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a61891-e40b-40cf-8afd-69a04fa6a3b1 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:11.011678 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-c4a61891-e40b-40cf-8afd-69a04fa6a3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:11.091365 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12ef9b-4ff8-450e-9697-9d5f96287ecf None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:11.092031 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12ef9b-4ff8-450e-9697-9d5f96287ecf None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:11.092537 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12ef9b-4ff8-450e-9697-9d5f96287ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:11.113998 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-9e12ef9b-4ff8-450e-9697-9d5f96287ecf None None] MFA Rules not processed for user `bd413f66141241979fac14c0c98fe406`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:11.115406 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-9e12ef9b-4ff8-450e-9697-9d5f96287ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:11.123778 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a61891-e40b-40cf-8afd-69a04fa6a3b1 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:11.129540 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945576b-ff76-4bb0-9688-3c73f27fd243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:11.130905 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945576b-ff76-4bb0-9688-3c73f27fd243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:11.131181 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945576b-ff76-4bb0-9688-3c73f27fd243 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:11.131446 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945576b-ff76-4bb0-9688-3c73f27fd243 admin admin] PATH_INFO: `/v3/users/8a505a6541c143b8b4854a67f8e333d8` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:11.133383 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945576b-ff76-4bb0-9688-3c73f27fd243 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a505a6541c143b8b4854a67f8e333d8)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:11.136064 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945576b-ff76-4bb0-9688-3c73f27fd243 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:11.193167 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c945576b-ff76-4bb0-9688-3c73f27fd243 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a505a6541c143b8b4854a67f8e333d8'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:11.198227 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1062/2115] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:50:11.200187 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c945576b-ff76-4bb0-9688-3c73f27fd243 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a505a6541c143b8b4854a67f8e333d8'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:11.217376 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c945576b-ff76-4bb0-9688-3c73f27fd243 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a505a6541c143b8b4854a67f8e333d8'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:11.218168 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c945576b-ff76-4bb0-9688-3c73f27fd243 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a505a6541c143b8b4854a67f8e333d8'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:11.218778 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c945576b-ff76-4bb0-9688-3c73f27fd243 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a505a6541c143b8b4854a67f8e333d8'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:11.233442 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1054/2116] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:50:11 2022] DELETE /identity/v3/users/8a505a6541c143b8b4854a67f8e333d8 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:11.238039 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38b81c-e7b6-4154-9058-f1283ed35bd8 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:11.238328 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38b81c-e7b6-4154-9058-f1283ed35bd8 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:11.238601 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38b81c-e7b6-4154-9058-f1283ed35bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:11.257106 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-0d38b81c-e7b6-4154-9058-f1283ed35bd8 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:11.258334 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-0d38b81c-e7b6-4154-9058-f1283ed35bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:11.323452 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1063/2117] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:50:11.333301 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945576b-ff76-4bb0-9688-3c73f27fd243 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:11.334780 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-c945576b-ff76-4bb0-9688-3c73f27fd243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:11.348841 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:11.399513 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945576b-ff76-4bb0-9688-3c73f27fd243 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:11.403433 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0123eb-7aa9-472c-aae4-5590519abe0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:11.404244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0123eb-7aa9-472c-aae4-5590519abe0d service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:11.404526 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0123eb-7aa9-472c-aae4-5590519abe0d service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:11.404804 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0123eb-7aa9-472c-aae4-5590519abe0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:11.415242 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0123eb-7aa9-472c-aae4-5590519abe0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:11.416695 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0123eb-7aa9-472c-aae4-5590519abe0d service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:11.426845 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1055/2118] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:50:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:50:11.760317 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38b81c-e7b6-4154-9058-f1283ed35bd8 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:11.761992 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-0d38b81c-e7b6-4154-9058-f1283ed35bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:11.775615 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38b81c-e7b6-4154-9058-f1283ed35bd8 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:11.780569 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f15239-6318-49cb-82da-9e09b67d6889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:11.781502 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f15239-6318-49cb-82da-9e09b67d6889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:11.781869 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f15239-6318-49cb-82da-9e09b67d6889 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:11.782228 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f15239-6318-49cb-82da-9e09b67d6889 admin admin] PATH_INFO: `/v3/projects/77a75f485fd24b2cb901792b2bcf8c88` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:11.783954 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f15239-6318-49cb-82da-9e09b67d6889 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77a75f485fd24b2cb901792b2bcf8c88)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:11.786007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f15239-6318-49cb-82da-9e09b67d6889 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:11.842219 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:11.844251 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c4f15239-6318-49cb-82da-9e09b67d6889 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77a75f485fd24b2cb901792b2bcf8c88', 'request_id': 'req-c4f15239-6318-49cb-82da-9e09b67d6889'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:11.852709 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c4f15239-6318-49cb-82da-9e09b67d6889 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77a75f485fd24b2cb901792b2bcf8c88', 'request_id': 'req-c4f15239-6318-49cb-82da-9e09b67d6889'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:11.865994 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c4f15239-6318-49cb-82da-9e09b67d6889 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77a75f485fd24b2cb901792b2bcf8c88', 'request_id': 'req-c4f15239-6318-49cb-82da-9e09b67d6889'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:11.880738 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c4f15239-6318-49cb-82da-9e09b67d6889 admin admin] The token cache is being invalidate because project 77a75f485fd24b2cb901792b2bcf8c88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:50:11.881075 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c4f15239-6318-49cb-82da-9e09b67d6889 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:11.881661 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c4f15239-6318-49cb-82da-9e09b67d6889 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:11.886937 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1064/2119] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:50:11 2022] DELETE /identity/v3/projects/77a75f485fd24b2cb901792b2bcf8c88 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:11.887685 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0123eb-7aa9-472c-aae4-5590519abe0d service neutron] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:11.899473 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0123eb-7aa9-472c-aae4-5590519abe0d service neutron] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:11.968987 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925bc29-d525-4c2e-ba95-44272d3e84ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:11.969937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925bc29-d525-4c2e-ba95-44272d3e84ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:11.970217 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925bc29-d525-4c2e-ba95-44272d3e84ec admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:11.970489 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925bc29-d525-4c2e-ba95-44272d3e84ec admin admin] PATH_INFO: `/v3/users/f86d30111a99442db9d87de602b84e48` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:11.971662 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925bc29-d525-4c2e-ba95-44272d3e84ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=f86d30111a99442db9d87de602b84e48)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:11.973589 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925bc29-d525-4c2e-ba95-44272d3e84ec admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:12.029740 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-3925bc29-d525-4c2e-ba95-44272d3e84ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f86d30111a99442db9d87de602b84e48'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:12.037153 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-3925bc29-d525-4c2e-ba95-44272d3e84ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f86d30111a99442db9d87de602b84e48'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:12.052560 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-3925bc29-d525-4c2e-ba95-44272d3e84ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f86d30111a99442db9d87de602b84e48'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:12.053395 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-3925bc29-d525-4c2e-ba95-44272d3e84ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f86d30111a99442db9d87de602b84e48'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:12.054053 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-3925bc29-d525-4c2e-ba95-44272d3e84ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f86d30111a99442db9d87de602b84e48'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:12.073646 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1056/2120] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:50:11 2022] DELETE /identity/v3/users/f86d30111a99442db9d87de602b84e48 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:12.397786 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f15239-6318-49cb-82da-9e09b67d6889 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:12.400118 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-c4f15239-6318-49cb-82da-9e09b67d6889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:12.416217 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f15239-6318-49cb-82da-9e09b67d6889 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:12.496525 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31934952-e110-427b-b079-b2e4e8318d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:12.497425 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31934952-e110-427b-b079-b2e4e8318d27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:12.497774 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31934952-e110-427b-b079-b2e4e8318d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:12.498082 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31934952-e110-427b-b079-b2e4e8318d27 admin admin] PATH_INFO: `/v3/projects/f01e84c5e09b446eacae9d3051f8d939` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:12.499267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31934952-e110-427b-b079-b2e4e8318d27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f01e84c5e09b446eacae9d3051f8d939)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:12.501538 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31934952-e110-427b-b079-b2e4e8318d27 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:12.550071 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-31934952-e110-427b-b079-b2e4e8318d27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f01e84c5e09b446eacae9d3051f8d939', 'request_id': 'req-31934952-e110-427b-b079-b2e4e8318d27'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:12.555511 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-31934952-e110-427b-b079-b2e4e8318d27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f01e84c5e09b446eacae9d3051f8d939', 'request_id': 'req-31934952-e110-427b-b079-b2e4e8318d27'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:12.565203 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-31934952-e110-427b-b079-b2e4e8318d27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f01e84c5e09b446eacae9d3051f8d939', 'request_id': 'req-31934952-e110-427b-b079-b2e4e8318d27'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:12.576792 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-31934952-e110-427b-b079-b2e4e8318d27 admin admin] The token cache is being invalidate because project f01e84c5e09b446eacae9d3051f8d939 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:50:12.577079 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-31934952-e110-427b-b079-b2e4e8318d27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:12.577705 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-31934952-e110-427b-b079-b2e4e8318d27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:12.579298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1065/2121] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:50:12 2022] DELETE /identity/v3/projects/f01e84c5e09b446eacae9d3051f8d939 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:12.584329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21537b0e-5ad5-474d-b41c-4beb679127ca None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:12.584616 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21537b0e-5ad5-474d-b41c-4beb679127ca None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:12.584887 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21537b0e-5ad5-474d-b41c-4beb679127ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:12.605167 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-21537b0e-5ad5-474d-b41c-4beb679127ca None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:12.606420 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-21537b0e-5ad5-474d-b41c-4beb679127ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:12.635282 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:12.668821 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1057/2122] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:50:12.677945 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e039125-cebc-4c73-83de-9326bcd5d7f8 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:12.678237 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e039125-cebc-4c73-83de-9326bcd5d7f8 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:12.678509 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e039125-cebc-4c73-83de-9326bcd5d7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:12.700414 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-3e039125-cebc-4c73-83de-9326bcd5d7f8 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:12.701854 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-3e039125-cebc-4c73-83de-9326bcd5d7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:12.710736 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1066/2123] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:50:12.715174 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21537b0e-5ad5-474d-b41c-4beb679127ca None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:12.725588 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21537b0e-5ad5-474d-b41c-4beb679127ca None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:12.731081 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145864d7-09cd-440f-9998-ca4fd43cec34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:12.732038 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145864d7-09cd-440f-9998-ca4fd43cec34 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:12.732327 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145864d7-09cd-440f-9998-ca4fd43cec34 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:12.732603 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145864d7-09cd-440f-9998-ca4fd43cec34 admin admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:12.734885 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145864d7-09cd-440f-9998-ca4fd43cec34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:50:12.735205 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145864d7-09cd-440f-9998-ca4fd43cec34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:12.737104 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145864d7-09cd-440f-9998-ca4fd43cec34 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:12.751740 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1058/2124] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:50:12.756080 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e039125-cebc-4c73-83de-9326bcd5d7f8 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:12.767366 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e039125-cebc-4c73-83de-9326bcd5d7f8 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:12.772434 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705af1c-2766-4f9e-a725-1b537c95083c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:12.773186 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705af1c-2766-4f9e-a725-1b537c95083c admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:12.773530 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705af1c-2766-4f9e-a725-1b537c95083c admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:12.773946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705af1c-2766-4f9e-a725-1b537c95083c admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:12.775259 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1705af1c-2766-4f9e-a725-1b537c95083c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:12.776762 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1705af1c-2766-4f9e-a725-1b537c95083c admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:12.807883 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1067/2125] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:50:12 2022] POST /identity/v3/projects => generated 363 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:50:12.811905 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145864d7-09cd-440f-9998-ca4fd43cec34 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:12.822079 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145864d7-09cd-440f-9998-ca4fd43cec34 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:12.906367 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea61f8-03d4-4aa0-8bc7-5d374f8ec1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:12.907126 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea61f8-03d4-4aa0-8bc7-5d374f8ec1a1 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:12.907501 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea61f8-03d4-4aa0-8bc7-5d374f8ec1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:12.907824 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea61f8-03d4-4aa0-8bc7-5d374f8ec1a1 admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:12.908626 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea61f8-03d4-4aa0-8bc7-5d374f8ec1a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:12.910552 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea61f8-03d4-4aa0-8bc7-5d374f8ec1a1 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:12.945945 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1059/2126] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:50:12 2022] POST /identity/v3/users => generated 282 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:50:12.948549 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705af1c-2766-4f9e-a725-1b537c95083c admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:12.959153 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705af1c-2766-4f9e-a725-1b537c95083c admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:12.964664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89360f0-518f-4588-9657-e70cf337d866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:12.965392 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89360f0-518f-4588-9657-e70cf337d866 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:12.965755 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89360f0-518f-4588-9657-e70cf337d866 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:12.966161 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89360f0-518f-4588-9657-e70cf337d866 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:12.966969 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89360f0-518f-4588-9657-e70cf337d866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:12.968640 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89360f0-518f-4588-9657-e70cf337d866 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:12.981154 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1068/2127] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:50:12.984585 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea61f8-03d4-4aa0-8bc7-5d374f8ec1a1 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:12.996291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea61f8-03d4-4aa0-8bc7-5d374f8ec1a1 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:13.001599 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1965701-dc6e-42da-b58c-ecbdbeae613b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:13.002986 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1965701-dc6e-42da-b58c-ecbdbeae613b admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:13.002986 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1965701-dc6e-42da-b58c-ecbdbeae613b admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:13.002986 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1965701-dc6e-42da-b58c-ecbdbeae613b admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:13.003801 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1965701-dc6e-42da-b58c-ecbdbeae613b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:13.005931 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1965701-dc6e-42da-b58c-ecbdbeae613b admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:13.020030 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1060/2128] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:50:13.024734 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89360f0-518f-4588-9657-e70cf337d866 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:13.036464 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89360f0-518f-4588-9657-e70cf337d866 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:13.041894 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253aff92-432c-480f-88bb-7bae1a3ae1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:13.043124 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253aff92-432c-480f-88bb-7bae1a3ae1a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:13.043124 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253aff92-432c-480f-88bb-7bae1a3ae1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:13.043342 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253aff92-432c-480f-88bb-7bae1a3ae1a2 admin admin] PATH_INFO: `/v3/projects/3d20b8040c164f0d9a6f5b26f1dd5d34/users/30a9d63e425c4a259868de7c764e4fcb/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:13.065772 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253aff92-432c-480f-88bb-7bae1a3ae1a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d20b8040c164f0d9a6f5b26f1dd5d34, user_id=30a9d63e425c4a259868de7c764e4fcb, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:13.069756 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253aff92-432c-480f-88bb-7bae1a3ae1a2 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:13.094018 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1069/2129] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:50:13 2022] PUT /identity/v3/projects/3d20b8040c164f0d9a6f5b26f1dd5d34/users/30a9d63e425c4a259868de7c764e4fcb/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:13.104731 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17be29-0302-460b-94eb-adb04a01bded None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:13.105039 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17be29-0302-460b-94eb-adb04a01bded None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:13.105315 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17be29-0302-460b-94eb-adb04a01bded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:13.133414 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-0b17be29-0302-460b-94eb-adb04a01bded None None] MFA Rules not processed for user `30a9d63e425c4a259868de7c764e4fcb`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:13.134637 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-0b17be29-0302-460b-94eb-adb04a01bded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:13.206122 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1061/2130] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:13 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:50:13.210015 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253aff92-432c-480f-88bb-7bae1a3ae1a2 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:13.214800 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:13.278505 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253aff92-432c-480f-88bb-7bae1a3ae1a2 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:13.283224 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5224658-00c0-4fdb-a975-6cf4bb4f780f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:13.283889 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5224658-00c0-4fdb-a975-6cf4bb4f780f admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:13.284174 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5224658-00c0-4fdb-a975-6cf4bb4f780f admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:13.284450 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5224658-00c0-4fdb-a975-6cf4bb4f780f admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:13.285142 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5224658-00c0-4fdb-a975-6cf4bb4f780f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:13.287105 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5224658-00c0-4fdb-a975-6cf4bb4f780f admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:13.316212 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1070/2131] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:50:13 2022] POST /identity/v3/projects => generated 363 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:50:13.317332 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17be29-0302-460b-94eb-adb04a01bded None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:13.328667 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17be29-0302-460b-94eb-adb04a01bded None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:13.356309 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:13.390491 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024acc85-dfc7-4e92-b216-54e022683127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:13.391174 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024acc85-dfc7-4e92-b216-54e022683127 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:13.391453 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024acc85-dfc7-4e92-b216-54e022683127 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:13.391756 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024acc85-dfc7-4e92-b216-54e022683127 admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:13.392451 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024acc85-dfc7-4e92-b216-54e022683127 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:13.394797 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024acc85-dfc7-4e92-b216-54e022683127 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:13.416415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1062/2132] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:50:13 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:50:13.423781 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5224658-00c0-4fdb-a975-6cf4bb4f780f admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:13.448988 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5224658-00c0-4fdb-a975-6cf4bb4f780f admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:13.455148 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e244ba-2f6a-4e93-adc8-17e90ea38fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:13.455826 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e244ba-2f6a-4e93-adc8-17e90ea38fac admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:13.456142 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e244ba-2f6a-4e93-adc8-17e90ea38fac admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:13.456416 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e244ba-2f6a-4e93-adc8-17e90ea38fac admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:13.457396 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e244ba-2f6a-4e93-adc8-17e90ea38fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:13.459200 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e244ba-2f6a-4e93-adc8-17e90ea38fac admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:13.464529 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024acc85-dfc7-4e92-b216-54e022683127 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:13.466402 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-024acc85-dfc7-4e92-b216-54e022683127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:13.473209 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1071/2133] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:50:13.476881 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e244ba-2f6a-4e93-adc8-17e90ea38fac admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:13.481339 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024acc85-dfc7-4e92-b216-54e022683127 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:13.486749 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc8b6c-68dd-485e-8afc-ebdfca38dd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:13.487616 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc8b6c-68dd-485e-8afc-ebdfca38dd0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:13.487894 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc8b6c-68dd-485e-8afc-ebdfca38dd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:13.488188 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc8b6c-68dd-485e-8afc-ebdfca38dd0c admin admin] PATH_INFO: `/v3/users/5abb12fa284648208d829cdfa6fee847` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:13.488464 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e244ba-2f6a-4e93-adc8-17e90ea38fac admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:13.489385 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc8b6c-68dd-485e-8afc-ebdfca38dd0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5abb12fa284648208d829cdfa6fee847)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:13.491364 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc8b6c-68dd-485e-8afc-ebdfca38dd0c admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:13.495240 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf244fe-7782-4518-a27f-3b132cece99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:13.496129 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf244fe-7782-4518-a27f-3b132cece99d admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:13.496404 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf244fe-7782-4518-a27f-3b132cece99d admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:13.496674 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf244fe-7782-4518-a27f-3b132cece99d admin admin] PATH_INFO: `/v3/projects/73b5677de6e24d6f9de99e6c290a1005/users/8cbcbe5acccc48d6b7b56332356f30ea/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:13.513820 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf244fe-7782-4518-a27f-3b132cece99d admin admin] RBAC: Authorizing `identity:create_grant(project_id=73b5677de6e24d6f9de99e6c290a1005, user_id=8cbcbe5acccc48d6b7b56332356f30ea, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:13.516580 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf244fe-7782-4518-a27f-3b132cece99d admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:13.531548 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1072/2134] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:50:13 2022] PUT /identity/v3/projects/73b5677de6e24d6f9de99e6c290a1005/users/8cbcbe5acccc48d6b7b56332356f30ea/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:50:13.535424 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf244fe-7782-4518-a27f-3b132cece99d admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:13.545441 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-fdcc8b6c-68dd-485e-8afc-ebdfca38dd0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5abb12fa284648208d829cdfa6fee847'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:13.553288 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-fdcc8b6c-68dd-485e-8afc-ebdfca38dd0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5abb12fa284648208d829cdfa6fee847'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:13.566858 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-fdcc8b6c-68dd-485e-8afc-ebdfca38dd0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5abb12fa284648208d829cdfa6fee847'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:13.567592 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-fdcc8b6c-68dd-485e-8afc-ebdfca38dd0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5abb12fa284648208d829cdfa6fee847'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:13.568241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-fdcc8b6c-68dd-485e-8afc-ebdfca38dd0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5abb12fa284648208d829cdfa6fee847'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:13.586321 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1063/2135] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:50:13 2022] DELETE /identity/v3/users/5abb12fa284648208d829cdfa6fee847 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:50:13.590122 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb75bd1-3b71-4e5d-b43e-dbce4fa5d12d None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:13.590413 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb75bd1-3b71-4e5d-b43e-dbce4fa5d12d None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:13.590693 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb75bd1-3b71-4e5d-b43e-dbce4fa5d12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:13.613530 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-bfb75bd1-3b71-4e5d-b43e-dbce4fa5d12d None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:13.614401 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf244fe-7782-4518-a27f-3b132cece99d admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:13.614783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-bfb75bd1-3b71-4e5d-b43e-dbce4fa5d12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:13.684014 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1064/2136] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:50:13.689776 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51028548-72e6-4871-9097-b9f2c13a4ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:13.691501 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51028548-72e6-4871-9097-b9f2c13a4ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:13.691884 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51028548-72e6-4871-9097-b9f2c13a4ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:13.692370 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51028548-72e6-4871-9097-b9f2c13a4ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:13.693172 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51028548-72e6-4871-9097-b9f2c13a4ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:13.693894 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb75bd1-3b71-4e5d-b43e-dbce4fa5d12d None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:13.694871 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51028548-72e6-4871-9097-b9f2c13a4ff6 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:13.695319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-bfb75bd1-3b71-4e5d-b43e-dbce4fa5d12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:13.696524 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:13.713816 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1073/2137] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:50:13.715232 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51028548-72e6-4871-9097-b9f2c13a4ff6 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:13.717054 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-51028548-72e6-4871-9097-b9f2c13a4ff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:13.732257 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:13.732758 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51028548-72e6-4871-9097-b9f2c13a4ff6 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:13.739269 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c658298-1967-4ae1-8072-d01d5e9ba468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:13.740225 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c658298-1967-4ae1-8072-d01d5e9ba468 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:13.740961 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c658298-1967-4ae1-8072-d01d5e9ba468 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:13.741255 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c658298-1967-4ae1-8072-d01d5e9ba468 admin admin] PATH_INFO: `/v3/projects/73b5677de6e24d6f9de99e6c290a1005/users/8cbcbe5acccc48d6b7b56332356f30ea/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:13.743838 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c658298-1967-4ae1-8072-d01d5e9ba468 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73b5677de6e24d6f9de99e6c290a1005, user_id=8cbcbe5acccc48d6b7b56332356f30ea, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:13.746857 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c658298-1967-4ae1-8072-d01d5e9ba468 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:13.759949 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1074/2138] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:50:13 2022] PUT /identity/v3/projects/73b5677de6e24d6f9de99e6c290a1005/users/8cbcbe5acccc48d6b7b56332356f30ea/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:50:13.764157 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb75bd1-3b71-4e5d-b43e-dbce4fa5d12d None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:13.770665 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b605be-11c7-4b6e-9f31-7a1dd932e36c None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:13.771208 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b605be-11c7-4b6e-9f31-7a1dd932e36c None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:13.771410 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b605be-11c7-4b6e-9f31-7a1dd932e36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:13.812771 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-27b605be-11c7-4b6e-9f31-7a1dd932e36c None None] MFA Rules not processed for user `8cbcbe5acccc48d6b7b56332356f30ea`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:13.814194 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-27b605be-11c7-4b6e-9f31-7a1dd932e36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:13.838509 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f1ff0-5217-48e1-8bff-a4f4c3821329 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:13.839777 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f1ff0-5217-48e1-8bff-a4f4c3821329 service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:13.840198 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f1ff0-5217-48e1-8bff-a4f4c3821329 service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:13.840742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f1ff0-5217-48e1-8bff-a4f4c3821329 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:13.909742 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1075/2139] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:13 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:50:13.922536 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b605be-11c7-4b6e-9f31-7a1dd932e36c None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:13.924035 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-27b605be-11c7-4b6e-9f31-7a1dd932e36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:13.961090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f1ff0-5217-48e1-8bff-a4f4c3821329 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:13.962672 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f1ff0-5217-48e1-8bff-a4f4c3821329 service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:13.974654 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1065/2140] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:50:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:50:14.013516 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b605be-11c7-4b6e-9f31-7a1dd932e36c None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:14.020679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88468eac-5ded-4f6a-9a18-59231cc27e68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:14.021501 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88468eac-5ded-4f6a-9a18-59231cc27e68 service cinder] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:14.021778 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88468eac-5ded-4f6a-9a18-59231cc27e68 service cinder] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:14.022085 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88468eac-5ded-4f6a-9a18-59231cc27e68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:14.032945 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88468eac-5ded-4f6a-9a18-59231cc27e68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:14.034430 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88468eac-5ded-4f6a-9a18-59231cc27e68 service cinder] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:14.045340 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1076/2141] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:50:13 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:50:14.145318 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f1ff0-5217-48e1-8bff-a4f4c3821329 service neutron] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:14.155665 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f1ff0-5217-48e1-8bff-a4f4c3821329 service neutron] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:14.160801 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e97184-5eb8-44ad-b683-0bc5f7f5b070 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:14.161473 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e97184-5eb8-44ad-b683-0bc5f7f5b070 service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:14.161938 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e97184-5eb8-44ad-b683-0bc5f7f5b070 service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:14.162105 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e97184-5eb8-44ad-b683-0bc5f7f5b070 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:14.164002 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-e4e97184-5eb8-44ad-b683-0bc5f7f5b070 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:14.238237 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e97184-5eb8-44ad-b683-0bc5f7f5b070 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:14.239926 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e97184-5eb8-44ad-b683-0bc5f7f5b070 service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:14.252415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1066/2142] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:50:14 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:50:14.764333 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88468eac-5ded-4f6a-9a18-59231cc27e68 service cinder] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:14.766080 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-88468eac-5ded-4f6a-9a18-59231cc27e68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:14.781290 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88468eac-5ded-4f6a-9a18-59231cc27e68 service cinder] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:14.787078 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd2449-dc3c-49f1-bbd0-7c0ae38e3430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:14.788148 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd2449-dc3c-49f1-bbd0-7c0ae38e3430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:14.788497 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd2449-dc3c-49f1-bbd0-7c0ae38e3430 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:14.788844 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd2449-dc3c-49f1-bbd0-7c0ae38e3430 admin admin] PATH_INFO: `/v3/projects/9263b57dbc724cd1ba5e2b8e9f8954ec` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:14.790894 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd2449-dc3c-49f1-bbd0-7c0ae38e3430 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9263b57dbc724cd1ba5e2b8e9f8954ec)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:14.793382 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd2449-dc3c-49f1-bbd0-7c0ae38e3430 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:14.856631 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-75cd2449-dc3c-49f1-bbd0-7c0ae38e3430 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9263b57dbc724cd1ba5e2b8e9f8954ec', 'request_id': 'req-75cd2449-dc3c-49f1-bbd0-7c0ae38e3430'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:14.864528 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-75cd2449-dc3c-49f1-bbd0-7c0ae38e3430 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9263b57dbc724cd1ba5e2b8e9f8954ec', 'request_id': 'req-75cd2449-dc3c-49f1-bbd0-7c0ae38e3430'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:14.878501 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-75cd2449-dc3c-49f1-bbd0-7c0ae38e3430 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9263b57dbc724cd1ba5e2b8e9f8954ec', 'request_id': 'req-75cd2449-dc3c-49f1-bbd0-7c0ae38e3430'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:14.880082 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:14.902390 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-75cd2449-dc3c-49f1-bbd0-7c0ae38e3430 admin admin] The token cache is being invalidate because project 9263b57dbc724cd1ba5e2b8e9f8954ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:50:14.902744 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-75cd2449-dc3c-49f1-bbd0-7c0ae38e3430 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:14.903476 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-75cd2449-dc3c-49f1-bbd0-7c0ae38e3430 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:14.905446 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1077/2143] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:50:14 2022] DELETE /identity/v3/projects/9263b57dbc724cd1ba5e2b8e9f8954ec => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:14.910290 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b45550-4b80-4973-a25f-c5489c8c64fe None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:14.910668 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b45550-4b80-4973-a25f-c5489c8c64fe None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:14.911016 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b45550-4b80-4973-a25f-c5489c8c64fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:14.930342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-88b45550-4b80-4973-a25f-c5489c8c64fe None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:14.931707 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-88b45550-4b80-4973-a25f-c5489c8c64fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:14.962189 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:14.997621 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1067/2144] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:50:15.005637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ff96c-0b59-4905-b0a5-ac39597f7b32 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:15.005975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ff96c-0b59-4905-b0a5-ac39597f7b32 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:15.006248 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ff96c-0b59-4905-b0a5-ac39597f7b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:15.031186 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-db3ff96c-0b59-4905-b0a5-ac39597f7b32 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:15.032424 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-db3ff96c-0b59-4905-b0a5-ac39597f7b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:15.041786 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1078/2145] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:50:15.046355 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b45550-4b80-4973-a25f-c5489c8c64fe None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:15.056917 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b45550-4b80-4973-a25f-c5489c8c64fe None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:15.062126 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ee0fb-18c0-478e-8ec4-e543d1a3affc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:15.062793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ee0fb-18c0-478e-8ec4-e543d1a3affc admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:15.063073 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ee0fb-18c0-478e-8ec4-e543d1a3affc admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:15.063344 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ee0fb-18c0-478e-8ec4-e543d1a3affc admin admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:15.064082 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ee0fb-18c0-478e-8ec4-e543d1a3affc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:50:15.064394 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ee0fb-18c0-478e-8ec4-e543d1a3affc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:15.066044 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ee0fb-18c0-478e-8ec4-e543d1a3affc admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:15.078447 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1068/2146] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:50:15.082952 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ff96c-0b59-4905-b0a5-ac39597f7b32 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:15.093108 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ff96c-0b59-4905-b0a5-ac39597f7b32 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:15.097879 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5955c7-fb61-4488-bae0-53aea89c4a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:15.098527 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5955c7-fb61-4488-bae0-53aea89c4a57 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:15.098865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5955c7-fb61-4488-bae0-53aea89c4a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:15.099118 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5955c7-fb61-4488-bae0-53aea89c4a57 admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:15.099804 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5955c7-fb61-4488-bae0-53aea89c4a57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:15.101711 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5955c7-fb61-4488-bae0-53aea89c4a57 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:15.130034 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1079/2147] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:50:15 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:50:15.134503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ee0fb-18c0-478e-8ec4-e543d1a3affc admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:15.148403 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ee0fb-18c0-478e-8ec4-e543d1a3affc admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:15.241195 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f983515-ae1f-4dae-9075-df97cc62a89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:15.242412 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f983515-ae1f-4dae-9075-df97cc62a89d admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:15.242691 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f983515-ae1f-4dae-9075-df97cc62a89d admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:15.243365 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f983515-ae1f-4dae-9075-df97cc62a89d admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:15.244067 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f983515-ae1f-4dae-9075-df97cc62a89d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:15.246469 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f983515-ae1f-4dae-9075-df97cc62a89d admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:15.276672 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1069/2148] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:50:15 2022] POST /identity/v3/users => generated 292 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:50:15.277960 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5955c7-fb61-4488-bae0-53aea89c4a57 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:15.298047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5955c7-fb61-4488-bae0-53aea89c4a57 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:15.298047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3099b2-55ef-430a-becc-751d8a63bd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:15.298047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3099b2-55ef-430a-becc-751d8a63bd90 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:15.298047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3099b2-55ef-430a-becc-751d8a63bd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:15.298481 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3099b2-55ef-430a-becc-751d8a63bd90 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:15.298481 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3099b2-55ef-430a-becc-751d8a63bd90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:15.299355 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3099b2-55ef-430a-becc-751d8a63bd90 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:15.313900 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1080/2149] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:50:15.317350 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f983515-ae1f-4dae-9075-df97cc62a89d admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:15.328180 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f983515-ae1f-4dae-9075-df97cc62a89d admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:15.333918 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bdfa85-2473-4ec2-9fb3-e83fb98d63a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:15.334780 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdfa85-2473-4ec2-9fb3-e83fb98d63a6 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:15.335217 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdfa85-2473-4ec2-9fb3-e83fb98d63a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:15.335496 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdfa85-2473-4ec2-9fb3-e83fb98d63a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:15.336237 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bdfa85-2473-4ec2-9fb3-e83fb98d63a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:15.338032 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bdfa85-2473-4ec2-9fb3-e83fb98d63a6 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:15.351707 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1070/2150] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:50:15.353806 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3099b2-55ef-430a-becc-751d8a63bd90 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:15.364577 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3099b2-55ef-430a-becc-751d8a63bd90 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:15.369298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e398c6-599d-4ccb-948a-05519e87bc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:15.370226 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e398c6-599d-4ccb-948a-05519e87bc54 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:15.370506 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e398c6-599d-4ccb-948a-05519e87bc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:15.370779 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e398c6-599d-4ccb-948a-05519e87bc54 admin admin] PATH_INFO: `/v3/projects/f194bb2b7949480ead35d8e83cb9535f/users/148f32f6cd4e4af89681bcd5f4ba87b7/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:15.385621 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e398c6-599d-4ccb-948a-05519e87bc54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f194bb2b7949480ead35d8e83cb9535f, user_id=148f32f6cd4e4af89681bcd5f4ba87b7, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:15.388481 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e398c6-599d-4ccb-948a-05519e87bc54 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:15.409707 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1081/2151] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:50:15 2022] PUT /identity/v3/projects/f194bb2b7949480ead35d8e83cb9535f/users/148f32f6cd4e4af89681bcd5f4ba87b7/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:50:15.415241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b637aa-d4f0-44a0-9058-779a7e383294 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:15.415752 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b637aa-d4f0-44a0-9058-779a7e383294 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:15.416201 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b637aa-d4f0-44a0-9058-779a7e383294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:15.435292 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-f7b637aa-d4f0-44a0-9058-779a7e383294 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:15.436503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-f7b637aa-d4f0-44a0-9058-779a7e383294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:15.512920 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1071/2152] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:50:15.526077 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e398c6-599d-4ccb-948a-05519e87bc54 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:15.527848 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-e8e398c6-599d-4ccb-948a-05519e87bc54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:15.598713 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e398c6-599d-4ccb-948a-05519e87bc54 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:15.602343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8471af-b68e-498f-a74d-7500c960fc83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:15.602986 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8471af-b68e-498f-a74d-7500c960fc83 service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:15.603285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8471af-b68e-498f-a74d-7500c960fc83 service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:15.603529 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8471af-b68e-498f-a74d-7500c960fc83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:15.612670 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8471af-b68e-498f-a74d-7500c960fc83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:15.614132 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8471af-b68e-498f-a74d-7500c960fc83 service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:15.623899 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1082/2153] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:50:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:50:16.453072 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345974c-901f-49f4-8cf0-2b47dcf9ce2d None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:16.453581 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345974c-901f-49f4-8cf0-2b47dcf9ce2d None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:16.453686 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345974c-901f-49f4-8cf0-2b47dcf9ce2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:16.498094 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-2345974c-901f-49f4-8cf0-2b47dcf9ce2d None None] MFA Rules not processed for user `148f32f6cd4e4af89681bcd5f4ba87b7`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:16.499328 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-2345974c-901f-49f4-8cf0-2b47dcf9ce2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:16.536329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:16.584083 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1072/2154] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:50:16.595344 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8471af-b68e-498f-a74d-7500c960fc83 service neutron] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:16.597438 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-5d8471af-b68e-498f-a74d-7500c960fc83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:16.669738 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8471af-b68e-498f-a74d-7500c960fc83 service neutron] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:16.673393 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e09879-bc21-4755-9bc6-600ae0beee5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:16.674059 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e09879-bc21-4755-9bc6-600ae0beee5f service cinder] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:16.674412 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e09879-bc21-4755-9bc6-600ae0beee5f service cinder] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:16.674592 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e09879-bc21-4755-9bc6-600ae0beee5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:16.683538 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e09879-bc21-4755-9bc6-600ae0beee5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:16.685060 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e09879-bc21-4755-9bc6-600ae0beee5f service cinder] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:16.694025 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1083/2155] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:50:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:50:17.107778 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2345974c-901f-49f4-8cf0-2b47dcf9ce2d None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:17.109417 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-2345974c-901f-49f4-8cf0-2b47dcf9ce2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:17.123100 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2345974c-901f-49f4-8cf0-2b47dcf9ce2d None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:17.127602 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94141392-ccf9-4cd3-a9e2-6de80f93685f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:17.128507 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94141392-ccf9-4cd3-a9e2-6de80f93685f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:17.128788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94141392-ccf9-4cd3-a9e2-6de80f93685f admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:17.129060 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94141392-ccf9-4cd3-a9e2-6de80f93685f admin admin] PATH_INFO: `/v3/users/30a9d63e425c4a259868de7c764e4fcb` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:17.130394 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94141392-ccf9-4cd3-a9e2-6de80f93685f admin admin] RBAC: Authorizing `identity:delete_user(user_id=30a9d63e425c4a259868de7c764e4fcb)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:17.132324 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94141392-ccf9-4cd3-a9e2-6de80f93685f admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:17.191535 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-94141392-ccf9-4cd3-a9e2-6de80f93685f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30a9d63e425c4a259868de7c764e4fcb'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:17.199749 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-94141392-ccf9-4cd3-a9e2-6de80f93685f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30a9d63e425c4a259868de7c764e4fcb'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:17.214039 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-94141392-ccf9-4cd3-a9e2-6de80f93685f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30a9d63e425c4a259868de7c764e4fcb'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:17.214752 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-94141392-ccf9-4cd3-a9e2-6de80f93685f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30a9d63e425c4a259868de7c764e4fcb'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:17.215348 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-94141392-ccf9-4cd3-a9e2-6de80f93685f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30a9d63e425c4a259868de7c764e4fcb'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:17.230835 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1073/2156] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:50:17 2022] DELETE /identity/v3/users/30a9d63e425c4a259868de7c764e4fcb => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:17.235411 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beea210-3852-4ffb-93b2-8339136c9dc0 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:17.235720 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beea210-3852-4ffb-93b2-8339136c9dc0 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:17.235994 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beea210-3852-4ffb-93b2-8339136c9dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:17.253042 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-4beea210-3852-4ffb-93b2-8339136c9dc0 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:17.254289 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-4beea210-3852-4ffb-93b2-8339136c9dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:17.290764 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:17.328615 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1084/2157] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:50:17.338327 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94141392-ccf9-4cd3-a9e2-6de80f93685f admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:17.339908 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-94141392-ccf9-4cd3-a9e2-6de80f93685f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:17.397977 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94141392-ccf9-4cd3-a9e2-6de80f93685f admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:17.402120 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c6c72-53c1-4f4f-9c0c-4deeb8075016 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:17.402793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c6c72-53c1-4f4f-9c0c-4deeb8075016 service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:17.403054 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c6c72-53c1-4f4f-9c0c-4deeb8075016 service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:17.403327 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c6c72-53c1-4f4f-9c0c-4deeb8075016 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:17.412536 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c6c72-53c1-4f4f-9c0c-4deeb8075016 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:17.414057 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c6c72-53c1-4f4f-9c0c-4deeb8075016 service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:17.424178 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1074/2158] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:50:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:50:17.686954 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beea210-3852-4ffb-93b2-8339136c9dc0 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:17.701792 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-4beea210-3852-4ffb-93b2-8339136c9dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:17.755870 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beea210-3852-4ffb-93b2-8339136c9dc0 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:17.763728 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f2aed-6704-4007-8b5a-2085e563a4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:17.763728 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f2aed-6704-4007-8b5a-2085e563a4ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:17.763728 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f2aed-6704-4007-8b5a-2085e563a4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:17.764065 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f2aed-6704-4007-8b5a-2085e563a4ca admin admin] PATH_INFO: `/v3/projects/3d20b8040c164f0d9a6f5b26f1dd5d34` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:17.765120 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f2aed-6704-4007-8b5a-2085e563a4ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d20b8040c164f0d9a6f5b26f1dd5d34)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:17.767125 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f2aed-6704-4007-8b5a-2085e563a4ca admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:17.835157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-227f2aed-6704-4007-8b5a-2085e563a4ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d20b8040c164f0d9a6f5b26f1dd5d34', 'request_id': 'req-227f2aed-6704-4007-8b5a-2085e563a4ca'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:17.842026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-227f2aed-6704-4007-8b5a-2085e563a4ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d20b8040c164f0d9a6f5b26f1dd5d34', 'request_id': 'req-227f2aed-6704-4007-8b5a-2085e563a4ca'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:17.852330 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-227f2aed-6704-4007-8b5a-2085e563a4ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d20b8040c164f0d9a6f5b26f1dd5d34', 'request_id': 'req-227f2aed-6704-4007-8b5a-2085e563a4ca'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:17.869142 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-227f2aed-6704-4007-8b5a-2085e563a4ca admin admin] The token cache is being invalidate because project 3d20b8040c164f0d9a6f5b26f1dd5d34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:50:17.869436 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-227f2aed-6704-4007-8b5a-2085e563a4ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:17.870692 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-227f2aed-6704-4007-8b5a-2085e563a4ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:17.872640 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1085/2159] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:50:17 2022] DELETE /identity/v3/projects/3d20b8040c164f0d9a6f5b26f1dd5d34 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:17.876339 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c6c72-53c1-4f4f-9c0c-4deeb8075016 service neutron] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:17.900080 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c6c72-53c1-4f4f-9c0c-4deeb8075016 service neutron] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:17.943309 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:17.960984 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456a3bf-5025-4d3d-a6ec-4709b9d2ae2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:17.962231 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456a3bf-5025-4d3d-a6ec-4709b9d2ae2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:17.962694 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456a3bf-5025-4d3d-a6ec-4709b9d2ae2f admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:17.962976 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456a3bf-5025-4d3d-a6ec-4709b9d2ae2f admin admin] PATH_INFO: `/v3/users/8cbcbe5acccc48d6b7b56332356f30ea` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:17.964246 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456a3bf-5025-4d3d-a6ec-4709b9d2ae2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cbcbe5acccc48d6b7b56332356f30ea)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:17.966319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456a3bf-5025-4d3d-a6ec-4709b9d2ae2f admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:18.043534 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-4456a3bf-5025-4d3d-a6ec-4709b9d2ae2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cbcbe5acccc48d6b7b56332356f30ea'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:18.055303 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-4456a3bf-5025-4d3d-a6ec-4709b9d2ae2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cbcbe5acccc48d6b7b56332356f30ea'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:18.056678 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891dffd2-d58c-446b-9b83-75374289c267 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:18.057098 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891dffd2-d58c-446b-9b83-75374289c267 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:18.057385 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891dffd2-d58c-446b-9b83-75374289c267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:18.073584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-4456a3bf-5025-4d3d-a6ec-4709b9d2ae2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cbcbe5acccc48d6b7b56332356f30ea'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:18.074412 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-4456a3bf-5025-4d3d-a6ec-4709b9d2ae2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cbcbe5acccc48d6b7b56332356f30ea'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:18.077477 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-4456a3bf-5025-4d3d-a6ec-4709b9d2ae2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cbcbe5acccc48d6b7b56332356f30ea'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:18.083394 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-891dffd2-d58c-446b-9b83-75374289c267 None None] MFA Rules not processed for user `148f32f6cd4e4af89681bcd5f4ba87b7`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:18.085006 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-891dffd2-d58c-446b-9b83-75374289c267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:18.095396 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1075/2160] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:50:17 2022] DELETE /identity/v3/users/8cbcbe5acccc48d6b7b56332356f30ea => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:18.172008 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1086/2161] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:50:18.437428 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456a3bf-5025-4d3d-a6ec-4709b9d2ae2f admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:18.439108 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-4456a3bf-5025-4d3d-a6ec-4709b9d2ae2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:18.514605 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456a3bf-5025-4d3d-a6ec-4709b9d2ae2f admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:18.519164 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d3fa3-2dd3-43be-8d2d-9af4935e9bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:18.520041 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d3fa3-2dd3-43be-8d2d-9af4935e9bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:18.520378 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d3fa3-2dd3-43be-8d2d-9af4935e9bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:18.520636 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d3fa3-2dd3-43be-8d2d-9af4935e9bb0 admin admin] PATH_INFO: `/v3/projects/73b5677de6e24d6f9de99e6c290a1005` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:18.521970 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d3fa3-2dd3-43be-8d2d-9af4935e9bb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73b5677de6e24d6f9de99e6c290a1005)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:18.523914 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d3fa3-2dd3-43be-8d2d-9af4935e9bb0 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:18.574777 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-596d3fa3-2dd3-43be-8d2d-9af4935e9bb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73b5677de6e24d6f9de99e6c290a1005', 'request_id': 'req-596d3fa3-2dd3-43be-8d2d-9af4935e9bb0'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:18.580210 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-596d3fa3-2dd3-43be-8d2d-9af4935e9bb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73b5677de6e24d6f9de99e6c290a1005', 'request_id': 'req-596d3fa3-2dd3-43be-8d2d-9af4935e9bb0'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:18.588651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-596d3fa3-2dd3-43be-8d2d-9af4935e9bb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73b5677de6e24d6f9de99e6c290a1005', 'request_id': 'req-596d3fa3-2dd3-43be-8d2d-9af4935e9bb0'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:18.590883 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:18.600950 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-596d3fa3-2dd3-43be-8d2d-9af4935e9bb0 admin admin] The token cache is being invalidate because project 73b5677de6e24d6f9de99e6c290a1005 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:50:18.601231 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-596d3fa3-2dd3-43be-8d2d-9af4935e9bb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:18.602047 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-596d3fa3-2dd3-43be-8d2d-9af4935e9bb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:18.604029 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1076/2162] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:50:18 2022] DELETE /identity/v3/projects/73b5677de6e24d6f9de99e6c290a1005 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:18.608797 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ee46d-b6bd-456f-aec8-9df3488dc37e None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:18.609082 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ee46d-b6bd-456f-aec8-9df3488dc37e None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:18.609348 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ee46d-b6bd-456f-aec8-9df3488dc37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:18.627733 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-a05ee46d-b6bd-456f-aec8-9df3488dc37e None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:18.629000 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-a05ee46d-b6bd-456f-aec8-9df3488dc37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:18.696756 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1087/2163] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:50:18.705358 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bf3f4-5347-4291-8e57-9c01f212e499 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:18.705647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bf3f4-5347-4291-8e57-9c01f212e499 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:18.706410 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bf3f4-5347-4291-8e57-9c01f212e499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:18.724605 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-316bf3f4-5347-4291-8e57-9c01f212e499 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:18.725824 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-316bf3f4-5347-4291-8e57-9c01f212e499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:18.734365 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1077/2164] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:50:18.738659 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ee46d-b6bd-456f-aec8-9df3488dc37e None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:18.744725 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:18.749727 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ee46d-b6bd-456f-aec8-9df3488dc37e None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:18.756872 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2b86a-6533-4088-96a3-deca6b1316c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:18.757541 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2b86a-6533-4088-96a3-deca6b1316c3 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:18.758038 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2b86a-6533-4088-96a3-deca6b1316c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:18.758314 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2b86a-6533-4088-96a3-deca6b1316c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:18.759054 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e2b86a-6533-4088-96a3-deca6b1316c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:50:18.759353 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e2b86a-6533-4088-96a3-deca6b1316c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:18.761075 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e2b86a-6533-4088-96a3-deca6b1316c3 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:18.773866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1088/2165] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:50:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:50:18.778929 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316bf3f4-5347-4291-8e57-9c01f212e499 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:18.792220 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316bf3f4-5347-4291-8e57-9c01f212e499 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:18.797512 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec8636-3153-4042-ae15-0f6795bbf502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:18.798212 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec8636-3153-4042-ae15-0f6795bbf502 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:18.798537 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec8636-3153-4042-ae15-0f6795bbf502 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:18.798760 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ec8636-3153-4042-ae15-0f6795bbf502 admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:18.799446 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec8636-3153-4042-ae15-0f6795bbf502 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:18.819451 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ec8636-3153-4042-ae15-0f6795bbf502 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:18.853887 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1078/2166] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:50:18 2022] POST /identity/v3/projects => generated 381 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:50:18.856105 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2b86a-6533-4088-96a3-deca6b1316c3 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:18.870129 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2b86a-6533-4088-96a3-deca6b1316c3 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:18.928200 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955528d-bb55-4d83-b125-35debb59db73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:18.928874 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955528d-bb55-4d83-b125-35debb59db73 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:18.929155 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955528d-bb55-4d83-b125-35debb59db73 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:18.929429 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955528d-bb55-4d83-b125-35debb59db73 admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:18.930286 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955528d-bb55-4d83-b125-35debb59db73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:18.932660 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955528d-bb55-4d83-b125-35debb59db73 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:18.957008 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1089/2167] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:50:18 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:50:18.961919 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec8636-3153-4042-ae15-0f6795bbf502 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:18.973443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ec8636-3153-4042-ae15-0f6795bbf502 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:18.978911 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fbbe7b-c708-4b76-b30e-3e13bcc26564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:18.979651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbbe7b-c708-4b76-b30e-3e13bcc26564 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:18.980338 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbbe7b-c708-4b76-b30e-3e13bcc26564 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:18.980624 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbbe7b-c708-4b76-b30e-3e13bcc26564 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:18.982678 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fbbe7b-c708-4b76-b30e-3e13bcc26564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:18.984589 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fbbe7b-c708-4b76-b30e-3e13bcc26564 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:19.007899 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1079/2168] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:50:19.012792 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955528d-bb55-4d83-b125-35debb59db73 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:19.027666 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955528d-bb55-4d83-b125-35debb59db73 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:19.032425 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131cbab2-61db-4c8c-ab6b-9dcc567f73c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:19.033336 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cbab2-61db-4c8c-ab6b-9dcc567f73c3 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:19.033800 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cbab2-61db-4c8c-ab6b-9dcc567f73c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:19.034121 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cbab2-61db-4c8c-ab6b-9dcc567f73c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:19.034860 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131cbab2-61db-4c8c-ab6b-9dcc567f73c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:19.036474 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131cbab2-61db-4c8c-ab6b-9dcc567f73c3 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:19.049762 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1090/2169] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:50:19.054420 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fbbe7b-c708-4b76-b30e-3e13bcc26564 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:19.066033 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fbbe7b-c708-4b76-b30e-3e13bcc26564 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:19.072547 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d75b37-b8ea-4810-86df-e748f7ca3d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:19.073553 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d75b37-b8ea-4810-86df-e748f7ca3d37 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:19.074163 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d75b37-b8ea-4810-86df-e748f7ca3d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:19.074419 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d75b37-b8ea-4810-86df-e748f7ca3d37 admin admin] PATH_INFO: `/v3/projects/a8b14cd26f9f44a99c1c842b17daae14/users/49688c04b35649ec95b692be2a6d7052/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:19.098670 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d75b37-b8ea-4810-86df-e748f7ca3d37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8b14cd26f9f44a99c1c842b17daae14, user_id=49688c04b35649ec95b692be2a6d7052, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:19.102062 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d75b37-b8ea-4810-86df-e748f7ca3d37 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:19.116717 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1080/2170] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:50:19 2022] PUT /identity/v3/projects/a8b14cd26f9f44a99c1c842b17daae14/users/49688c04b35649ec95b692be2a6d7052/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:19.128153 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11106e0e-4b34-4ca0-a7e3-5c62e1fd402e None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:19.128672 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11106e0e-4b34-4ca0-a7e3-5c62e1fd402e None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:19.129210 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11106e0e-4b34-4ca0-a7e3-5c62e1fd402e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:19.175645 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-11106e0e-4b34-4ca0-a7e3-5c62e1fd402e None None] MFA Rules not processed for user `49688c04b35649ec95b692be2a6d7052`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:19.176886 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-11106e0e-4b34-4ca0-a7e3-5c62e1fd402e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:19.246838 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1091/2171] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:50:19.251653 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d75b37-b8ea-4810-86df-e748f7ca3d37 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:19.325038 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d75b37-b8ea-4810-86df-e748f7ca3d37 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:19.334238 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31eefb-d539-4ee8-a01c-765e70b6693e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:19.335707 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31eefb-d539-4ee8-a01c-765e70b6693e admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:19.335707 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31eefb-d539-4ee8-a01c-765e70b6693e admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:19.335707 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31eefb-d539-4ee8-a01c-765e70b6693e admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:19.336148 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31eefb-d539-4ee8-a01c-765e70b6693e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:19.339624 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31eefb-d539-4ee8-a01c-765e70b6693e admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:19.382764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1081/2172] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:50:19 2022] POST /identity/v3/projects => generated 381 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:50:19.387816 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11106e0e-4b34-4ca0-a7e3-5c62e1fd402e None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:19.400280 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11106e0e-4b34-4ca0-a7e3-5c62e1fd402e None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:19.469507 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b200eff-d592-417f-9f07-e057dc4cd3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:19.470229 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b200eff-d592-417f-9f07-e057dc4cd3bf admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:19.470507 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b200eff-d592-417f-9f07-e057dc4cd3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:19.470780 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b200eff-d592-417f-9f07-e057dc4cd3bf admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:19.471471 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b200eff-d592-417f-9f07-e057dc4cd3bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:19.473432 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b200eff-d592-417f-9f07-e057dc4cd3bf admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:19.481568 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:19.500276 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1092/2173] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:50:19 2022] POST /identity/v3/users => generated 297 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:50:19.504398 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31eefb-d539-4ee8-a01c-765e70b6693e admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:19.516423 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31eefb-d539-4ee8-a01c-765e70b6693e admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:19.521355 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f09c7e-c1b3-4d9e-86b0-a1ca83fa0a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:19.522162 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f09c7e-c1b3-4d9e-86b0-a1ca83fa0a9d admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:19.522539 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f09c7e-c1b3-4d9e-86b0-a1ca83fa0a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:19.523220 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f09c7e-c1b3-4d9e-86b0-a1ca83fa0a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:19.523810 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f09c7e-c1b3-4d9e-86b0-a1ca83fa0a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:19.525403 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f09c7e-c1b3-4d9e-86b0-a1ca83fa0a9d admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:19.540159 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1082/2174] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:50:19.541323 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b200eff-d592-417f-9f07-e057dc4cd3bf admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:19.552167 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b200eff-d592-417f-9f07-e057dc4cd3bf admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:19.557322 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd4d3c-728b-42ea-81e2-fe8f1ce569a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:19.558365 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd4d3c-728b-42ea-81e2-fe8f1ce569a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:19.558709 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd4d3c-728b-42ea-81e2-fe8f1ce569a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:19.559096 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd4d3c-728b-42ea-81e2-fe8f1ce569a2 admin admin] PATH_INFO: `/v3/projects/d1737d883d334c96a38a5dee5d8de46a/users/39547396ede74d6d8138f75e061066f8/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:19.574890 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd4d3c-728b-42ea-81e2-fe8f1ce569a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1737d883d334c96a38a5dee5d8de46a, user_id=39547396ede74d6d8138f75e061066f8, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:19.577628 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd4d3c-728b-42ea-81e2-fe8f1ce569a2 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:19.592744 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1093/2175] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:50:19 2022] PUT /identity/v3/projects/d1737d883d334c96a38a5dee5d8de46a/users/39547396ede74d6d8138f75e061066f8/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:19.596855 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f09c7e-c1b3-4d9e-86b0-a1ca83fa0a9d admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:19.609578 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f09c7e-c1b3-4d9e-86b0-a1ca83fa0a9d admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:19.669972 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7300f-cb03-46cd-99b2-3a53255dc62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:19.671236 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7300f-cb03-46cd-99b2-3a53255dc62a admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:19.671236 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7300f-cb03-46cd-99b2-3a53255dc62a admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:19.671425 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7300f-cb03-46cd-99b2-3a53255dc62a admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:19.672093 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7300f-cb03-46cd-99b2-3a53255dc62a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:19.673788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7300f-cb03-46cd-99b2-3a53255dc62a admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:19.687635 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1083/2176] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:50:19.688960 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd4d3c-728b-42ea-81e2-fe8f1ce569a2 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:19.699415 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd4d3c-728b-42ea-81e2-fe8f1ce569a2 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:19.704282 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea932c-93b0-427c-833c-0f2a4e36dd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:19.705263 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea932c-93b0-427c-833c-0f2a4e36dd3b admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:19.705546 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea932c-93b0-427c-833c-0f2a4e36dd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:19.705812 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea932c-93b0-427c-833c-0f2a4e36dd3b admin admin] PATH_INFO: `/v3/projects/d1737d883d334c96a38a5dee5d8de46a/users/39547396ede74d6d8138f75e061066f8/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:19.707796 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea932c-93b0-427c-833c-0f2a4e36dd3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1737d883d334c96a38a5dee5d8de46a, user_id=39547396ede74d6d8138f75e061066f8, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:19.710483 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea932c-93b0-427c-833c-0f2a4e36dd3b admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:19.721372 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1094/2177] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:50:19 2022] PUT /identity/v3/projects/d1737d883d334c96a38a5dee5d8de46a/users/39547396ede74d6d8138f75e061066f8/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:19.732693 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dadf9e-f057-4ab7-aba4-bbb9649e9832 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:19.732977 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dadf9e-f057-4ab7-aba4-bbb9649e9832 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:19.733253 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dadf9e-f057-4ab7-aba4-bbb9649e9832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:19.739197 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:19.760995 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-b9dadf9e-f057-4ab7-aba4-bbb9649e9832 None None] MFA Rules not processed for user `39547396ede74d6d8138f75e061066f8`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:19.762288 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-b9dadf9e-f057-4ab7-aba4-bbb9649e9832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:19.835119 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1084/2178] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:50:19.846034 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea932c-93b0-427c-833c-0f2a4e36dd3b admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:19.848053 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-cfea932c-93b0-427c-833c-0f2a4e36dd3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:19.916044 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea932c-93b0-427c-833c-0f2a4e36dd3b admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:19.920679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f66dc5-2937-4f34-8756-10fb87ba092a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:19.921454 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f66dc5-2937-4f34-8756-10fb87ba092a service cinder] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:19.921763 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f66dc5-2937-4f34-8756-10fb87ba092a service cinder] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:19.922078 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f66dc5-2937-4f34-8756-10fb87ba092a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:19.931889 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f66dc5-2937-4f34-8756-10fb87ba092a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:19.933574 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f66dc5-2937-4f34-8756-10fb87ba092a service cinder] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:19.945698 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1095/2179] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:50:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:50:20.098067 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dadf9e-f057-4ab7-aba4-bbb9649e9832 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:20.111688 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dadf9e-f057-4ab7-aba4-bbb9649e9832 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:20.115783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d18c5f-c1b7-4757-a07d-fe7067a3d0b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:20.116603 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d18c5f-c1b7-4757-a07d-fe7067a3d0b2 service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:20.117047 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d18c5f-c1b7-4757-a07d-fe7067a3d0b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:20.117462 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d18c5f-c1b7-4757-a07d-fe7067a3d0b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:20.231038 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d18c5f-c1b7-4757-a07d-fe7067a3d0b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:20.234057 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d18c5f-c1b7-4757-a07d-fe7067a3d0b2 service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:20.257031 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1085/2180] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:50:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:50:22.910296 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f66dc5-2937-4f34-8756-10fb87ba092a service cinder] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:22.975170 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f66dc5-2937-4f34-8756-10fb87ba092a service cinder] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:22.980190 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2abcc9-bebc-4682-93d1-9bd7bacb3a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:22.980984 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2abcc9-bebc-4682-93d1-9bd7bacb3a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:22.981267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2abcc9-bebc-4682-93d1-9bd7bacb3a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:22.981554 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2abcc9-bebc-4682-93d1-9bd7bacb3a46 admin admin] PATH_INFO: `/v3/users/49688c04b35649ec95b692be2a6d7052` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:22.982792 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2abcc9-bebc-4682-93d1-9bd7bacb3a46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49688c04b35649ec95b692be2a6d7052)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:22.984753 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2abcc9-bebc-4682-93d1-9bd7bacb3a46 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:23.046989 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-7e2abcc9-bebc-4682-93d1-9bd7bacb3a46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49688c04b35649ec95b692be2a6d7052'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:23.055647 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:INSERT=5,keystone:SELECT=87,keystone:DELETE=8 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:23.062366 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-7e2abcc9-bebc-4682-93d1-9bd7bacb3a46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49688c04b35649ec95b692be2a6d7052'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:23.071298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-7e2abcc9-bebc-4682-93d1-9bd7bacb3a46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49688c04b35649ec95b692be2a6d7052'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:23.072218 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-7e2abcc9-bebc-4682-93d1-9bd7bacb3a46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49688c04b35649ec95b692be2a6d7052'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:23.073008 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-7e2abcc9-bebc-4682-93d1-9bd7bacb3a46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49688c04b35649ec95b692be2a6d7052'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:23.088369 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1096/2181] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:50:22 2022] DELETE /identity/v3/users/49688c04b35649ec95b692be2a6d7052 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:23.093036 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45033816-d52a-42e9-9c6b-c56080db7c25 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:23.093529 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45033816-d52a-42e9-9c6b-c56080db7c25 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:23.093756 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45033816-d52a-42e9-9c6b-c56080db7c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:23.112144 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-45033816-d52a-42e9-9c6b-c56080db7c25 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:23.113451 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-45033816-d52a-42e9-9c6b-c56080db7c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:23.190976 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1086/2182] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:50:23.201510 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2abcc9-bebc-4682-93d1-9bd7bacb3a46 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:23.203193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-7e2abcc9-bebc-4682-93d1-9bd7bacb3a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:23.273085 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2abcc9-bebc-4682-93d1-9bd7bacb3a46 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:23.280026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0ed0f-aa84-47f7-9006-f4ea92687def service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:23.280681 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0ed0f-aa84-47f7-9006-f4ea92687def service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:23.280898 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0ed0f-aa84-47f7-9006-f4ea92687def service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:23.282030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0ed0f-aa84-47f7-9006-f4ea92687def service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:23.299386 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0ed0f-aa84-47f7-9006-f4ea92687def service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:23.301668 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0ed0f-aa84-47f7-9006-f4ea92687def service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:23.313066 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1097/2183] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:50:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:50:23.826281 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45033816-d52a-42e9-9c6b-c56080db7c25 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:23.828023 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-45033816-d52a-42e9-9c6b-c56080db7c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:23.841089 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45033816-d52a-42e9-9c6b-c56080db7c25 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:23.848433 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4743d0-dbd6-4e4c-92a9-0c41bd525107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:23.849437 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4743d0-dbd6-4e4c-92a9-0c41bd525107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:23.849868 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4743d0-dbd6-4e4c-92a9-0c41bd525107 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:23.850315 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4743d0-dbd6-4e4c-92a9-0c41bd525107 admin admin] PATH_INFO: `/v3/projects/a8b14cd26f9f44a99c1c842b17daae14` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:23.851533 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4743d0-dbd6-4e4c-92a9-0c41bd525107 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8b14cd26f9f44a99c1c842b17daae14)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:23.853535 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4743d0-dbd6-4e4c-92a9-0c41bd525107 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:23.896167 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:23.927609 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-cf4743d0-dbd6-4e4c-92a9-0c41bd525107 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8b14cd26f9f44a99c1c842b17daae14', 'request_id': 'req-cf4743d0-dbd6-4e4c-92a9-0c41bd525107'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:23.934103 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-cf4743d0-dbd6-4e4c-92a9-0c41bd525107 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8b14cd26f9f44a99c1c842b17daae14', 'request_id': 'req-cf4743d0-dbd6-4e4c-92a9-0c41bd525107'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:23.945131 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-cf4743d0-dbd6-4e4c-92a9-0c41bd525107 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8b14cd26f9f44a99c1c842b17daae14', 'request_id': 'req-cf4743d0-dbd6-4e4c-92a9-0c41bd525107'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:23.960149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-cf4743d0-dbd6-4e4c-92a9-0c41bd525107 admin admin] The token cache is being invalidate because project a8b14cd26f9f44a99c1c842b17daae14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:50:23.960573 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-cf4743d0-dbd6-4e4c-92a9-0c41bd525107 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:23.961361 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-cf4743d0-dbd6-4e4c-92a9-0c41bd525107 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:23.965922 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1087/2184] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:50:23 2022] DELETE /identity/v3/projects/a8b14cd26f9f44a99c1c842b17daae14 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:23.968109 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0ed0f-aa84-47f7-9006-f4ea92687def service neutron] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:23.978284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0ed0f-aa84-47f7-9006-f4ea92687def service neutron] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:24.051804 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b093458-80ce-4fa7-ad94-7bcea97c8031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:24.052678 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b093458-80ce-4fa7-ad94-7bcea97c8031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:24.052956 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b093458-80ce-4fa7-ad94-7bcea97c8031 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:24.053237 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b093458-80ce-4fa7-ad94-7bcea97c8031 admin admin] PATH_INFO: `/v3/users/39547396ede74d6d8138f75e061066f8` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:24.054440 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b093458-80ce-4fa7-ad94-7bcea97c8031 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39547396ede74d6d8138f75e061066f8)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:24.056557 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b093458-80ce-4fa7-ad94-7bcea97c8031 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:24.119476 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-0b093458-80ce-4fa7-ad94-7bcea97c8031 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39547396ede74d6d8138f75e061066f8'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:24.133036 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-0b093458-80ce-4fa7-ad94-7bcea97c8031 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39547396ede74d6d8138f75e061066f8'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:24.140577 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-0b093458-80ce-4fa7-ad94-7bcea97c8031 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39547396ede74d6d8138f75e061066f8'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:24.141581 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-0b093458-80ce-4fa7-ad94-7bcea97c8031 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39547396ede74d6d8138f75e061066f8'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:24.141928 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-0b093458-80ce-4fa7-ad94-7bcea97c8031 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39547396ede74d6d8138f75e061066f8'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:24.148834 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:24.165284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1098/2185] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:50:23 2022] DELETE /identity/v3/users/39547396ede74d6d8138f75e061066f8 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:50:24.453360 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4743d0-dbd6-4e4c-92a9-0c41bd525107 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:24.455586 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-cf4743d0-dbd6-4e4c-92a9-0c41bd525107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:24.481047 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4743d0-dbd6-4e4c-92a9-0c41bd525107 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:24.551423 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46860fd-bb81-44bf-a2bd-fea8ef0289f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:24.552295 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46860fd-bb81-44bf-a2bd-fea8ef0289f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:24.552569 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46860fd-bb81-44bf-a2bd-fea8ef0289f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:24.552842 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46860fd-bb81-44bf-a2bd-fea8ef0289f4 admin admin] PATH_INFO: `/v3/projects/d1737d883d334c96a38a5dee5d8de46a` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:24.554006 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46860fd-bb81-44bf-a2bd-fea8ef0289f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1737d883d334c96a38a5dee5d8de46a)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:24.555924 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46860fd-bb81-44bf-a2bd-fea8ef0289f4 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:24.605041 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-d46860fd-bb81-44bf-a2bd-fea8ef0289f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1737d883d334c96a38a5dee5d8de46a', 'request_id': 'req-d46860fd-bb81-44bf-a2bd-fea8ef0289f4'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:24.610499 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-d46860fd-bb81-44bf-a2bd-fea8ef0289f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1737d883d334c96a38a5dee5d8de46a', 'request_id': 'req-d46860fd-bb81-44bf-a2bd-fea8ef0289f4'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:24.619016 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-d46860fd-bb81-44bf-a2bd-fea8ef0289f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1737d883d334c96a38a5dee5d8de46a', 'request_id': 'req-d46860fd-bb81-44bf-a2bd-fea8ef0289f4'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:24.630406 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-d46860fd-bb81-44bf-a2bd-fea8ef0289f4 admin admin] The token cache is being invalidate because project d1737d883d334c96a38a5dee5d8de46a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:50:24.630714 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-d46860fd-bb81-44bf-a2bd-fea8ef0289f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:24.631425 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-d46860fd-bb81-44bf-a2bd-fea8ef0289f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:24.633074 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1088/2186] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:50:24 2022] DELETE /identity/v3/projects/d1737d883d334c96a38a5dee5d8de46a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:24.638275 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f73dd-8ada-4ca2-994a-8663f90599a5 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:24.638502 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f73dd-8ada-4ca2-994a-8663f90599a5 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:24.638776 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f73dd-8ada-4ca2-994a-8663f90599a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:24.656939 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-131f73dd-8ada-4ca2-994a-8663f90599a5 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:24.658020 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-131f73dd-8ada-4ca2-994a-8663f90599a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:24.722223 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1099/2187] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:50:24.730095 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875a34a-1762-4118-8c2c-51e8c8085236 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:24.730379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875a34a-1762-4118-8c2c-51e8c8085236 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:24.730653 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875a34a-1762-4118-8c2c-51e8c8085236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:24.749932 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-0875a34a-1762-4118-8c2c-51e8c8085236 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:24.751163 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-0875a34a-1762-4118-8c2c-51e8c8085236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:24.759656 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1089/2188] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:50:24.763808 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f73dd-8ada-4ca2-994a-8663f90599a5 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:24.773412 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f73dd-8ada-4ca2-994a-8663f90599a5 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:24.778354 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d911766-6c77-416b-a710-b588a9f238af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:24.778874 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d911766-6c77-416b-a710-b588a9f238af admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:24.779148 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d911766-6c77-416b-a710-b588a9f238af admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:24.779420 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d911766-6c77-416b-a710-b588a9f238af admin admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:24.780149 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d911766-6c77-416b-a710-b588a9f238af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:50:24.780726 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d911766-6c77-416b-a710-b588a9f238af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:24.782074 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d911766-6c77-416b-a710-b588a9f238af admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:24.795211 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1100/2189] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:50:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:50:24.799677 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875a34a-1762-4118-8c2c-51e8c8085236 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:24.810265 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875a34a-1762-4118-8c2c-51e8c8085236 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:24.815120 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b80b9-500a-46d8-a19a-4b5fa7c85d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:24.815934 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b80b9-500a-46d8-a19a-4b5fa7c85d07 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:24.816036 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b80b9-500a-46d8-a19a-4b5fa7c85d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:24.816329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b80b9-500a-46d8-a19a-4b5fa7c85d07 admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:24.817006 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b80b9-500a-46d8-a19a-4b5fa7c85d07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:24.818956 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b80b9-500a-46d8-a19a-4b5fa7c85d07 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:24.848568 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1090/2190] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:50:24 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:50:24.852460 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d911766-6c77-416b-a710-b588a9f238af admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:24.863804 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d911766-6c77-416b-a710-b588a9f238af admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:24.927187 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4413f0-ef84-4535-aca7-25a071174831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:24.927871 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4413f0-ef84-4535-aca7-25a071174831 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:24.928150 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4413f0-ef84-4535-aca7-25a071174831 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:24.928420 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4413f0-ef84-4535-aca7-25a071174831 admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:24.929096 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4413f0-ef84-4535-aca7-25a071174831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:24.931042 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4413f0-ef84-4535-aca7-25a071174831 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:24.951733 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1101/2191] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:50:24 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:50:24.956119 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b80b9-500a-46d8-a19a-4b5fa7c85d07 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:24.968808 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b80b9-500a-46d8-a19a-4b5fa7c85d07 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:24.974491 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d47eb9-7568-4956-8956-1389297338c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:24.975160 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d47eb9-7568-4956-8956-1389297338c7 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:24.975440 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d47eb9-7568-4956-8956-1389297338c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:24.975717 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d47eb9-7568-4956-8956-1389297338c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:24.976759 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d47eb9-7568-4956-8956-1389297338c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:24.979568 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d47eb9-7568-4956-8956-1389297338c7 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:24.985687 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:24.991884 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1091/2192] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:50:24.996496 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4413f0-ef84-4535-aca7-25a071174831 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:25.006629 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4413f0-ef84-4535-aca7-25a071174831 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:25.011563 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc00d50-b2bc-41f8-a937-5baf009ab031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:25.012325 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc00d50-b2bc-41f8-a937-5baf009ab031 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:25.013047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc00d50-b2bc-41f8-a937-5baf009ab031 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:25.013047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc00d50-b2bc-41f8-a937-5baf009ab031 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:25.013751 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc00d50-b2bc-41f8-a937-5baf009ab031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:25.015606 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc00d50-b2bc-41f8-a937-5baf009ab031 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:25.028503 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1102/2193] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:50:25.031492 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d47eb9-7568-4956-8956-1389297338c7 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:25.042360 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d47eb9-7568-4956-8956-1389297338c7 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:25.048167 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e07f6-efb4-4ff7-85a5-04c49f819fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:25.049054 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e07f6-efb4-4ff7-85a5-04c49f819fe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:25.049332 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e07f6-efb4-4ff7-85a5-04c49f819fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:25.049604 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e07f6-efb4-4ff7-85a5-04c49f819fe1 admin admin] PATH_INFO: `/v3/projects/447caf9e6d3d44eaa284ed4acbe608b3/users/0ea6ac7854414d05a81b2c012799c305/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:25.065688 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e07f6-efb4-4ff7-85a5-04c49f819fe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=447caf9e6d3d44eaa284ed4acbe608b3, user_id=0ea6ac7854414d05a81b2c012799c305, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:25.068415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e07f6-efb4-4ff7-85a5-04c49f819fe1 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:25.083616 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1092/2194] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:50:25 2022] PUT /identity/v3/projects/447caf9e6d3d44eaa284ed4acbe608b3/users/0ea6ac7854414d05a81b2c012799c305/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:50:25.093872 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aafbae-9ee9-48b6-b1f2-0bb02fa32a6c None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:25.094191 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aafbae-9ee9-48b6-b1f2-0bb02fa32a6c None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:25.094467 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aafbae-9ee9-48b6-b1f2-0bb02fa32a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:25.124122 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-35aafbae-9ee9-48b6-b1f2-0bb02fa32a6c None None] MFA Rules not processed for user `0ea6ac7854414d05a81b2c012799c305`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:25.125355 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-35aafbae-9ee9-48b6-b1f2-0bb02fa32a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:25.180118 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:25.198321 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1103/2195] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:50:25.202954 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e07f6-efb4-4ff7-85a5-04c49f819fe1 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:25.268916 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e07f6-efb4-4ff7-85a5-04c49f819fe1 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:25.273956 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9a2e2-5980-4f14-8fee-e472aab612ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:25.274626 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9a2e2-5980-4f14-8fee-e472aab612ff admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:25.274911 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9a2e2-5980-4f14-8fee-e472aab612ff admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:25.275192 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9a2e2-5980-4f14-8fee-e472aab612ff admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:25.275899 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d9a2e2-5980-4f14-8fee-e472aab612ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:25.277834 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d9a2e2-5980-4f14-8fee-e472aab612ff admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:25.307427 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1093/2196] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:50:25 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:50:25.313453 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aafbae-9ee9-48b6-b1f2-0bb02fa32a6c None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:25.329077 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aafbae-9ee9-48b6-b1f2-0bb02fa32a6c None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:25.398342 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6350b-d538-4c05-988e-73ef25f72619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:25.399070 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6350b-d538-4c05-988e-73ef25f72619 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:25.399378 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6350b-d538-4c05-988e-73ef25f72619 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:25.399622 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6350b-d538-4c05-988e-73ef25f72619 admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:25.400355 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6350b-d538-4c05-988e-73ef25f72619 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:25.402359 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6350b-d538-4c05-988e-73ef25f72619 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:25.424383 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1104/2197] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:50:25 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:50:25.428299 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9a2e2-5980-4f14-8fee-e472aab612ff admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:25.438593 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9a2e2-5980-4f14-8fee-e472aab612ff admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:25.443564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ca0a2-8f58-40bc-b918-51809e50756d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:25.444278 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ca0a2-8f58-40bc-b918-51809e50756d admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:25.444562 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ca0a2-8f58-40bc-b918-51809e50756d admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:25.444836 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ca0a2-8f58-40bc-b918-51809e50756d admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:25.445565 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ca0a2-8f58-40bc-b918-51809e50756d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:25.447195 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ca0a2-8f58-40bc-b918-51809e50756d admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:25.458377 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1094/2198] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:50:25.462679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6350b-d538-4c05-988e-73ef25f72619 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:25.472766 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6350b-d538-4c05-988e-73ef25f72619 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:25.477611 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7021cc-aa9b-4c61-88d1-2d99649d3a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:25.478318 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7021cc-aa9b-4c61-88d1-2d99649d3a75 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:25.478594 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7021cc-aa9b-4c61-88d1-2d99649d3a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:25.478863 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7021cc-aa9b-4c61-88d1-2d99649d3a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:25.479605 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7021cc-aa9b-4c61-88d1-2d99649d3a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:25.481403 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7021cc-aa9b-4c61-88d1-2d99649d3a75 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:25.492500 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1105/2199] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:50:25.496227 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ca0a2-8f58-40bc-b918-51809e50756d admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:25.508693 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ca0a2-8f58-40bc-b918-51809e50756d admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:25.516809 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f2f4d-164e-4c36-9761-d9288f932487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:25.517906 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f2f4d-164e-4c36-9761-d9288f932487 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:25.518679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f2f4d-164e-4c36-9761-d9288f932487 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:25.519025 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f2f4d-164e-4c36-9761-d9288f932487 admin admin] PATH_INFO: `/v3/projects/1317ab023fe941429b09fe9e0fdf972b/users/7e18b781f4f14a3986628c6f60b73207/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:25.536482 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f2f4d-164e-4c36-9761-d9288f932487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1317ab023fe941429b09fe9e0fdf972b, user_id=7e18b781f4f14a3986628c6f60b73207, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:25.539633 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f2f4d-164e-4c36-9761-d9288f932487 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:25.557254 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1095/2200] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:50:25 2022] PUT /identity/v3/projects/1317ab023fe941429b09fe9e0fdf972b/users/7e18b781f4f14a3986628c6f60b73207/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:25.568865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912999a-c30c-4afb-bfa6-381fe72538e4 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:25.569266 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912999a-c30c-4afb-bfa6-381fe72538e4 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:25.569579 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912999a-c30c-4afb-bfa6-381fe72538e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:25.596662 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-7912999a-c30c-4afb-bfa6-381fe72538e4 None None] MFA Rules not processed for user `7e18b781f4f14a3986628c6f60b73207`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:25.597900 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-7912999a-c30c-4afb-bfa6-381fe72538e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:25.662518 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1106/2201] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:50:25.667391 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f2f4d-164e-4c36-9761-d9288f932487 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:25.736729 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f2f4d-164e-4c36-9761-d9288f932487 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:25.744310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a8406-1a3c-46b5-859b-3649eb220a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:25.745074 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a8406-1a3c-46b5-859b-3649eb220a23 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:25.746165 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a8406-1a3c-46b5-859b-3649eb220a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:25.746165 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a8406-1a3c-46b5-859b-3649eb220a23 admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:25.746409 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a8406-1a3c-46b5-859b-3649eb220a23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:25.748441 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a8406-1a3c-46b5-859b-3649eb220a23 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:25.777248 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1096/2202] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:50:25 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:50:25.781416 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912999a-c30c-4afb-bfa6-381fe72538e4 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:25.792984 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912999a-c30c-4afb-bfa6-381fe72538e4 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:25.849819 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8057d-b025-4d6c-9c24-a892ce570dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:25.850534 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8057d-b025-4d6c-9c24-a892ce570dcf admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:25.850808 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8057d-b025-4d6c-9c24-a892ce570dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:25.851078 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8057d-b025-4d6c-9c24-a892ce570dcf admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:25.851750 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f8057d-b025-4d6c-9c24-a892ce570dcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:25.853670 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f8057d-b025-4d6c-9c24-a892ce570dcf admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:25.860241 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:25.874870 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1107/2203] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:50:25 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:50:25.878844 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a8406-1a3c-46b5-859b-3649eb220a23 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:25.889702 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a8406-1a3c-46b5-859b-3649eb220a23 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:25.894865 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fbebfe-f025-483d-bc1a-d3c6a936fb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:25.895553 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbebfe-f025-483d-bc1a-d3c6a936fb80 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:25.895833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbebfe-f025-483d-bc1a-d3c6a936fb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:25.896105 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbebfe-f025-483d-bc1a-d3c6a936fb80 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:25.896853 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fbebfe-f025-483d-bc1a-d3c6a936fb80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:25.898489 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fbebfe-f025-483d-bc1a-d3c6a936fb80 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:25.904077 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:25.911032 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1097/2204] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:50:25.915453 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8057d-b025-4d6c-9c24-a892ce570dcf admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:25.925892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8057d-b025-4d6c-9c24-a892ce570dcf admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:25.932007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de16a5f-7e72-478c-b495-79f99a6adb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:25.933479 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de16a5f-7e72-478c-b495-79f99a6adb52 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:25.933479 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de16a5f-7e72-478c-b495-79f99a6adb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:25.933718 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de16a5f-7e72-478c-b495-79f99a6adb52 admin admin] PATH_INFO: `/v3/projects/54c9fff166c740488e6709bf5b9b8c7c/users/0f09a6350de3468f8708cb3191688346/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:25.951426 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de16a5f-7e72-478c-b495-79f99a6adb52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54c9fff166c740488e6709bf5b9b8c7c, user_id=0f09a6350de3468f8708cb3191688346, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:25.954143 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de16a5f-7e72-478c-b495-79f99a6adb52 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:25.970340 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1108/2205] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:50:25 2022] PUT /identity/v3/projects/54c9fff166c740488e6709bf5b9b8c7c/users/0f09a6350de3468f8708cb3191688346/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:25.974234 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fbebfe-f025-483d-bc1a-d3c6a936fb80 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:25.984606 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fbebfe-f025-483d-bc1a-d3c6a936fb80 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:26.058477 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c48ab1-d901-4023-8197-290a6634b599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:26.059317 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c48ab1-d901-4023-8197-290a6634b599 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:26.059635 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c48ab1-d901-4023-8197-290a6634b599 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:26.059862 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c48ab1-d901-4023-8197-290a6634b599 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:26.060622 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c48ab1-d901-4023-8197-290a6634b599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:26.066172 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c48ab1-d901-4023-8197-290a6634b599 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:26.075990 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1098/2206] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:50:26.081648 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de16a5f-7e72-478c-b495-79f99a6adb52 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:26.092348 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de16a5f-7e72-478c-b495-79f99a6adb52 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:26.097052 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b075a8-1968-474a-8e27-00087dfea0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:26.098018 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b075a8-1968-474a-8e27-00087dfea0ff admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:26.098410 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b075a8-1968-474a-8e27-00087dfea0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:26.098748 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b075a8-1968-474a-8e27-00087dfea0ff admin admin] PATH_INFO: `/v3/projects/54c9fff166c740488e6709bf5b9b8c7c/users/0f09a6350de3468f8708cb3191688346/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:26.101042 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b075a8-1968-474a-8e27-00087dfea0ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=54c9fff166c740488e6709bf5b9b8c7c, user_id=0f09a6350de3468f8708cb3191688346, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:26.103928 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b075a8-1968-474a-8e27-00087dfea0ff admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:26.115136 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1109/2207] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:50:26 2022] PUT /identity/v3/projects/54c9fff166c740488e6709bf5b9b8c7c/users/0f09a6350de3468f8708cb3191688346/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:50:26.125455 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c0e52-1527-4178-964a-257b3dc6c781 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:26.125745 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c0e52-1527-4178-964a-257b3dc6c781 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:26.126091 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c0e52-1527-4178-964a-257b3dc6c781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:26.161959 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-fa4c0e52-1527-4178-964a-257b3dc6c781 None None] MFA Rules not processed for user `0f09a6350de3468f8708cb3191688346`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:26.163172 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-fa4c0e52-1527-4178-964a-257b3dc6c781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:26.261452 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1099/2208] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:26 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:50:26.273800 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b075a8-1968-474a-8e27-00087dfea0ff admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:26.276526 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-62b075a8-1968-474a-8e27-00087dfea0ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:26.353464 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b075a8-1968-474a-8e27-00087dfea0ff admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:26.358634 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ab697-1da4-4ff2-9f45-e2c452170251 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:26.359489 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ab697-1da4-4ff2-9f45-e2c452170251 service cinder] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:26.359791 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ab697-1da4-4ff2-9f45-e2c452170251 service cinder] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:26.360045 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ab697-1da4-4ff2-9f45-e2c452170251 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:26.426318 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ab697-1da4-4ff2-9f45-e2c452170251 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:26.427950 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ab697-1da4-4ff2-9f45-e2c452170251 service cinder] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:26.440085 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1110/2209] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:50:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:50:27.999853 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c0e52-1527-4178-964a-257b3dc6c781 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:28.010230 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c0e52-1527-4178-964a-257b3dc6c781 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:28.014526 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631fc08-58bc-4ae1-b297-9b4accf06c14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:28.015433 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631fc08-58bc-4ae1-b297-9b4accf06c14 service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:28.015939 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631fc08-58bc-4ae1-b297-9b4accf06c14 service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:28.016319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631fc08-58bc-4ae1-b297-9b4accf06c14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:28.075798 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631fc08-58bc-4ae1-b297-9b4accf06c14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:28.077254 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631fc08-58bc-4ae1-b297-9b4accf06c14 service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:28.086647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1100/2210] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:50:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:50:28.650120 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ab697-1da4-4ff2-9f45-e2c452170251 service cinder] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:28.659151 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ab697-1da4-4ff2-9f45-e2c452170251 service cinder] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:28.663440 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436243e-cafa-413b-a464-64866c094909 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:28.664053 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436243e-cafa-413b-a464-64866c094909 service cinder] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:28.664728 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436243e-cafa-413b-a464-64866c094909 service cinder] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:28.664998 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436243e-cafa-413b-a464-64866c094909 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:28.675073 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436243e-cafa-413b-a464-64866c094909 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:28.676507 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436243e-cafa-413b-a464-64866c094909 service cinder] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:28.686424 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1111/2211] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:50:28 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:50:32.628927 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631fc08-58bc-4ae1-b297-9b4accf06c14 service cinder] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:32.650478 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:32.697064 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631fc08-58bc-4ae1-b297-9b4accf06c14 service cinder] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:32.702331 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88e331-5d30-4ccd-b5f8-6ceb9e6c1343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:32.703449 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88e331-5d30-4ccd-b5f8-6ceb9e6c1343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:32.703734 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88e331-5d30-4ccd-b5f8-6ceb9e6c1343 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:32.704062 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88e331-5d30-4ccd-b5f8-6ceb9e6c1343 admin admin] PATH_INFO: `/v3/users/0ea6ac7854414d05a81b2c012799c305` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:32.710576 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88e331-5d30-4ccd-b5f8-6ceb9e6c1343 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ea6ac7854414d05a81b2c012799c305)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:32.710576 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88e331-5d30-4ccd-b5f8-6ceb9e6c1343 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:32.764925 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-7f88e331-5d30-4ccd-b5f8-6ceb9e6c1343 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ea6ac7854414d05a81b2c012799c305'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:32.773340 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-7f88e331-5d30-4ccd-b5f8-6ceb9e6c1343 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ea6ac7854414d05a81b2c012799c305'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:32.789781 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-7f88e331-5d30-4ccd-b5f8-6ceb9e6c1343 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ea6ac7854414d05a81b2c012799c305'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:32.790967 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-7f88e331-5d30-4ccd-b5f8-6ceb9e6c1343 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ea6ac7854414d05a81b2c012799c305'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:32.791696 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-7f88e331-5d30-4ccd-b5f8-6ceb9e6c1343 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ea6ac7854414d05a81b2c012799c305'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:32.806543 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1101/2212] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:50:32 2022] DELETE /identity/v3/users/0ea6ac7854414d05a81b2c012799c305 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:32.812066 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a091f-76af-4a29-aa30-16b1ebb75c00 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:32.812609 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a091f-76af-4a29-aa30-16b1ebb75c00 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:32.812609 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a091f-76af-4a29-aa30-16b1ebb75c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:32.834873 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-0e4a091f-76af-4a29-aa30-16b1ebb75c00 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:32.836858 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-0e4a091f-76af-4a29-aa30-16b1ebb75c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:32.911141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:32.926612 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1112/2213] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:50:32.938252 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88e331-5d30-4ccd-b5f8-6ceb9e6c1343 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:32.939702 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-7f88e331-5d30-4ccd-b5f8-6ceb9e6c1343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:33.000896 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88e331-5d30-4ccd-b5f8-6ceb9e6c1343 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:33.005113 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168343c-d288-4baa-ae11-b24d596c722c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:33.005793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168343c-d288-4baa-ae11-b24d596c722c service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:33.006081 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168343c-d288-4baa-ae11-b24d596c722c service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:33.006336 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168343c-d288-4baa-ae11-b24d596c722c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:33.017170 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168343c-d288-4baa-ae11-b24d596c722c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:33.018831 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168343c-d288-4baa-ae11-b24d596c722c service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:33.029660 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1102/2214] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:50:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:50:33.377790 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a091f-76af-4a29-aa30-16b1ebb75c00 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:33.379394 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-0e4a091f-76af-4a29-aa30-16b1ebb75c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:33.394099 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a091f-76af-4a29-aa30-16b1ebb75c00 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:33.399079 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0d96d-cc04-4597-90b0-790715f7bdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:33.400770 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0d96d-cc04-4597-90b0-790715f7bdaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:33.401083 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0d96d-cc04-4597-90b0-790715f7bdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:33.401318 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0d96d-cc04-4597-90b0-790715f7bdaa admin admin] PATH_INFO: `/v3/projects/447caf9e6d3d44eaa284ed4acbe608b3` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:33.403192 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c0d96d-cc04-4597-90b0-790715f7bdaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=447caf9e6d3d44eaa284ed4acbe608b3)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:33.405253 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c0d96d-cc04-4597-90b0-790715f7bdaa admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:33.460547 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-a6c0d96d-cc04-4597-90b0-790715f7bdaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '447caf9e6d3d44eaa284ed4acbe608b3', 'request_id': 'req-a6c0d96d-cc04-4597-90b0-790715f7bdaa'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:33.466978 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-a6c0d96d-cc04-4597-90b0-790715f7bdaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '447caf9e6d3d44eaa284ed4acbe608b3', 'request_id': 'req-a6c0d96d-cc04-4597-90b0-790715f7bdaa'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:33.478151 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-a6c0d96d-cc04-4597-90b0-790715f7bdaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '447caf9e6d3d44eaa284ed4acbe608b3', 'request_id': 'req-a6c0d96d-cc04-4597-90b0-790715f7bdaa'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:33.491468 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-a6c0d96d-cc04-4597-90b0-790715f7bdaa admin admin] The token cache is being invalidate because project 447caf9e6d3d44eaa284ed4acbe608b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:50:33.491774 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-a6c0d96d-cc04-4597-90b0-790715f7bdaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:33.492402 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-a6c0d96d-cc04-4597-90b0-790715f7bdaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:33.493971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1113/2215] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:50:33 2022] DELETE /identity/v3/projects/447caf9e6d3d44eaa284ed4acbe608b3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:33.498049 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168343c-d288-4baa-ae11-b24d596c722c service neutron] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:33.507790 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168343c-d288-4baa-ae11-b24d596c722c service neutron] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:33.550590 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:33.569568 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2932fb7-f94f-4be1-a538-aef5a603c67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:33.570503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2932fb7-f94f-4be1-a538-aef5a603c67f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:33.570786 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2932fb7-f94f-4be1-a538-aef5a603c67f admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:33.571065 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2932fb7-f94f-4be1-a538-aef5a603c67f admin admin] PATH_INFO: `/v3/users/7e18b781f4f14a3986628c6f60b73207` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:33.580053 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2932fb7-f94f-4be1-a538-aef5a603c67f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e18b781f4f14a3986628c6f60b73207)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:33.580053 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2932fb7-f94f-4be1-a538-aef5a603c67f admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:33.620098 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-f2932fb7-f94f-4be1-a538-aef5a603c67f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e18b781f4f14a3986628c6f60b73207'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:33.629105 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-f2932fb7-f94f-4be1-a538-aef5a603c67f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e18b781f4f14a3986628c6f60b73207'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:33.645198 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-f2932fb7-f94f-4be1-a538-aef5a603c67f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e18b781f4f14a3986628c6f60b73207'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:33.645989 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-f2932fb7-f94f-4be1-a538-aef5a603c67f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e18b781f4f14a3986628c6f60b73207'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:33.646614 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-f2932fb7-f94f-4be1-a538-aef5a603c67f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e18b781f4f14a3986628c6f60b73207'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:33.662110 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1103/2216] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:50:33 2022] DELETE /identity/v3/users/7e18b781f4f14a3986628c6f60b73207 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:33.931772 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0d96d-cc04-4597-90b0-790715f7bdaa admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:33.933317 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-a6c0d96d-cc04-4597-90b0-790715f7bdaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:33.946624 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0d96d-cc04-4597-90b0-790715f7bdaa admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:34.006575 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe131f-952f-45a5-a972-88c0008d171f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:34.007443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe131f-952f-45a5-a972-88c0008d171f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:34.007723 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe131f-952f-45a5-a972-88c0008d171f admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:34.007994 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe131f-952f-45a5-a972-88c0008d171f admin admin] PATH_INFO: `/v3/projects/1317ab023fe941429b09fe9e0fdf972b` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:34.009193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe131f-952f-45a5-a972-88c0008d171f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1317ab023fe941429b09fe9e0fdf972b)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:34.011191 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe131f-952f-45a5-a972-88c0008d171f admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:34.063461 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-17fe131f-952f-45a5-a972-88c0008d171f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1317ab023fe941429b09fe9e0fdf972b', 'request_id': 'req-17fe131f-952f-45a5-a972-88c0008d171f'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:34.072539 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-17fe131f-952f-45a5-a972-88c0008d171f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1317ab023fe941429b09fe9e0fdf972b', 'request_id': 'req-17fe131f-952f-45a5-a972-88c0008d171f'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:34.083300 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-17fe131f-952f-45a5-a972-88c0008d171f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1317ab023fe941429b09fe9e0fdf972b', 'request_id': 'req-17fe131f-952f-45a5-a972-88c0008d171f'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:34.097964 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-17fe131f-952f-45a5-a972-88c0008d171f admin admin] The token cache is being invalidate because project 1317ab023fe941429b09fe9e0fdf972b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:50:34.098474 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-17fe131f-952f-45a5-a972-88c0008d171f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:34.099204 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-17fe131f-952f-45a5-a972-88c0008d171f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:34.100898 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1114/2217] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:50:33 2022] DELETE /identity/v3/projects/1317ab023fe941429b09fe9e0fdf972b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:34.105241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2932fb7-f94f-4be1-a538-aef5a603c67f admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:34.106990 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-f2932fb7-f94f-4be1-a538-aef5a603c67f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:34.120717 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2932fb7-f94f-4be1-a538-aef5a603c67f admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:34.130499 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383be25-ecfe-4ba4-a781-99f9de8983a2 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:34.130975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383be25-ecfe-4ba4-a781-99f9de8983a2 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:34.131261 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383be25-ecfe-4ba4-a781-99f9de8983a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:34.145707 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:34.154759 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-3383be25-ecfe-4ba4-a781-99f9de8983a2 None None] MFA Rules not processed for user `c9647d15389e49e6b7c43ea1b1538a13`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:34.156185 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-3383be25-ecfe-4ba4-a781-99f9de8983a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:34.197530 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8a9dd-4b9d-4433-901c-65e17efca80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:34.198460 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8a9dd-4b9d-4433-901c-65e17efca80a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:34.198746 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8a9dd-4b9d-4433-901c-65e17efca80a admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:34.199023 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8a9dd-4b9d-4433-901c-65e17efca80a admin admin] PATH_INFO: `/v3/users/0f09a6350de3468f8708cb3191688346` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:34.200371 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8a9dd-4b9d-4433-901c-65e17efca80a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f09a6350de3468f8708cb3191688346)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:34.202418 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8a9dd-4b9d-4433-901c-65e17efca80a admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:34.224966 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1115/2218] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Jul 5 20:50:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:50:34.260030 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-4fd8a9dd-4b9d-4433-901c-65e17efca80a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f09a6350de3468f8708cb3191688346'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:34.271829 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-4fd8a9dd-4b9d-4433-901c-65e17efca80a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f09a6350de3468f8708cb3191688346'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:34.282547 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:34.290530 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383be25-ecfe-4ba4-a781-99f9de8983a2 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:34.292707 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-3383be25-ecfe-4ba4-a781-99f9de8983a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:34.302297 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-4fd8a9dd-4b9d-4433-901c-65e17efca80a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f09a6350de3468f8708cb3191688346'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:34.303710 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-4fd8a9dd-4b9d-4433-901c-65e17efca80a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f09a6350de3468f8708cb3191688346'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:34.304397 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-4fd8a9dd-4b9d-4433-901c-65e17efca80a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f09a6350de3468f8708cb3191688346'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:34.323055 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1104/2219] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:50:34 2022] DELETE /identity/v3/users/0f09a6350de3468f8708cb3191688346 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:34.409210 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383be25-ecfe-4ba4-a781-99f9de8983a2 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:34.495520 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c8dc99-02e1-4cb4-82eb-6d43180e86c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90aa580a2e10467a93c2d79d1906bd8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:34.496347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8dc99-02e1-4cb4-82eb-6d43180e86c6 service swift] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:34.496677 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8dc99-02e1-4cb4-82eb-6d43180e86c6 service swift] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:34.497024 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8dc99-02e1-4cb4-82eb-6d43180e86c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:34.499944 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-28c8dc99-02e1-4cb4-82eb-6d43180e86c6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:34.587328 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:34.592253 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c8dc99-02e1-4cb4-82eb-6d43180e86c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:34.593926 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c8dc99-02e1-4cb4-82eb-6d43180e86c6 service swift] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:34.606327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1116/2220] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Jul 5 20:50:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 05 20:50:34.638069 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8a9dd-4b9d-4433-901c-65e17efca80a admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:34.640088 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-4fd8a9dd-4b9d-4433-901c-65e17efca80a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:34.727689 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8a9dd-4b9d-4433-901c-65e17efca80a admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:34.734151 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f431a86-9e24-4f56-9d5d-9f3730232b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:34.735042 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f431a86-9e24-4f56-9d5d-9f3730232b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:34.735328 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f431a86-9e24-4f56-9d5d-9f3730232b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:34.735612 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f431a86-9e24-4f56-9d5d-9f3730232b22 admin admin] PATH_INFO: `/v3/users/505669e30e3c4c29b792a2faac0cafb5` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:34.737498 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f431a86-9e24-4f56-9d5d-9f3730232b22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=505669e30e3c4c29b792a2faac0cafb5)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:34.742652 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f431a86-9e24-4f56-9d5d-9f3730232b22 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:34.767870 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c8dc99-02e1-4cb4-82eb-6d43180e86c6 service swift] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:34.769394 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-28c8dc99-02e1-4cb4-82eb-6d43180e86c6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:34.786642 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c8dc99-02e1-4cb4-82eb-6d43180e86c6 service swift] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:34.794387 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1df30d-92c7-4a83-be54-96c6f8e89ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:34.795329 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1df30d-92c7-4a83-be54-96c6f8e89ccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:34.795660 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1df30d-92c7-4a83-be54-96c6f8e89ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:34.795881 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1df30d-92c7-4a83-be54-96c6f8e89ccc admin admin] PATH_INFO: `/v3/projects/54c9fff166c740488e6709bf5b9b8c7c` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:34.797316 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1df30d-92c7-4a83-be54-96c6f8e89ccc admin admin] RBAC: Authorizing `identity:delete_project(project_id=54c9fff166c740488e6709bf5b9b8c7c)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:34.799299 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1df30d-92c7-4a83-be54-96c6f8e89ccc admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:34.805585 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-2f431a86-9e24-4f56-9d5d-9f3730232b22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '505669e30e3c4c29b792a2faac0cafb5'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:34.812851 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-2f431a86-9e24-4f56-9d5d-9f3730232b22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '505669e30e3c4c29b792a2faac0cafb5'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:34.825517 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-2f431a86-9e24-4f56-9d5d-9f3730232b22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '505669e30e3c4c29b792a2faac0cafb5'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:34.826464 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-2f431a86-9e24-4f56-9d5d-9f3730232b22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '505669e30e3c4c29b792a2faac0cafb5'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:34.827628 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-2f431a86-9e24-4f56-9d5d-9f3730232b22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '505669e30e3c4c29b792a2faac0cafb5'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:34.843729 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1105/2221] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:50:34 2022] DELETE /identity/v3/users/505669e30e3c4c29b792a2faac0cafb5 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:34.848267 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0b042-38ef-466b-8ce4-f8ab5f8809e1 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:34.848557 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0b042-38ef-466b-8ce4-f8ab5f8809e1 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:34.848863 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0b042-38ef-466b-8ce4-f8ab5f8809e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:34.853873 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-cd1df30d-92c7-4a83-be54-96c6f8e89ccc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54c9fff166c740488e6709bf5b9b8c7c', 'request_id': 'req-cd1df30d-92c7-4a83-be54-96c6f8e89ccc'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:34.860120 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-cd1df30d-92c7-4a83-be54-96c6f8e89ccc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54c9fff166c740488e6709bf5b9b8c7c', 'request_id': 'req-cd1df30d-92c7-4a83-be54-96c6f8e89ccc'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:34.866691 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-e3c0b042-38ef-466b-8ce4-f8ab5f8809e1 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:34.868293 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-e3c0b042-38ef-466b-8ce4-f8ab5f8809e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:34.869362 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-cd1df30d-92c7-4a83-be54-96c6f8e89ccc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54c9fff166c740488e6709bf5b9b8c7c', 'request_id': 'req-cd1df30d-92c7-4a83-be54-96c6f8e89ccc'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:34.886128 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-cd1df30d-92c7-4a83-be54-96c6f8e89ccc admin admin] The token cache is being invalidate because project 54c9fff166c740488e6709bf5b9b8c7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:50:34.886408 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-cd1df30d-92c7-4a83-be54-96c6f8e89ccc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:34.887080 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-cd1df30d-92c7-4a83-be54-96c6f8e89ccc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:34.888760 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1117/2222] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:50:34 2022] DELETE /identity/v3/projects/54c9fff166c740488e6709bf5b9b8c7c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:50:34.893921 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4b067-c0e2-4500-bad4-caf383e1701c None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:34.894281 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4b067-c0e2-4500-bad4-caf383e1701c None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:34.894627 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4b067-c0e2-4500-bad4-caf383e1701c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:34.913877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-34c4b067-c0e2-4500-bad4-caf383e1701c None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:34.915384 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-34c4b067-c0e2-4500-bad4-caf383e1701c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:34.924024 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:34.949033 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1106/2223] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:50:34.954846 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0b042-38ef-466b-8ce4-f8ab5f8809e1 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:34.956511 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-e3c0b042-38ef-466b-8ce4-f8ab5f8809e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:34.989716 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1118/2224] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:50:34.997246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9cd9d4-23b5-4ae6-b12b-597c0b26ddb7 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:34.997654 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9cd9d4-23b5-4ae6-b12b-597c0b26ddb7 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:34.997952 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9cd9d4-23b5-4ae6-b12b-597c0b26ddb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:35.016206 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-3b9cd9d4-23b5-4ae6-b12b-597c0b26ddb7 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:35.017460 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-3b9cd9d4-23b5-4ae6-b12b-597c0b26ddb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:35.024409 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0b042-38ef-466b-8ce4-f8ab5f8809e1 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:35.026872 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1119/2225] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:50:35.030855 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c029b-421e-4fe3-90d3-65b27a805126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:35.030855 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c029b-421e-4fe3-90d3-65b27a805126 service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:35.030855 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c029b-421e-4fe3-90d3-65b27a805126 service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:35.030855 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c029b-421e-4fe3-90d3-65b27a805126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:35.032218 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9cd9d4-23b5-4ae6-b12b-597c0b26ddb7 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:35.040024 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8c029b-421e-4fe3-90d3-65b27a805126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:35.041462 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8c029b-421e-4fe3-90d3-65b27a805126 service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:35.042651 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9cd9d4-23b5-4ae6-b12b-597c0b26ddb7 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:35.047665 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3cab60-084d-4e34-b0c1-1a3b12ab8a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:35.048318 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3cab60-084d-4e34-b0c1-1a3b12ab8a8f admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:35.048594 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3cab60-084d-4e34-b0c1-1a3b12ab8a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:35.048867 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3cab60-084d-4e34-b0c1-1a3b12ab8a8f admin admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:35.049591 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3cab60-084d-4e34-b0c1-1a3b12ab8a8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:50:35.049926 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3cab60-084d-4e34-b0c1-1a3b12ab8a8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:35.051150 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1107/2226] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:50:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:50:35.051596 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3cab60-084d-4e34-b0c1-1a3b12ab8a8f admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:35.069938 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1120/2227] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:50:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:50:35.071186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c029b-421e-4fe3-90d3-65b27a805126 service neutron] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:35.087178 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c029b-421e-4fe3-90d3-65b27a805126 service neutron] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:35.092138 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a693eee-f375-45fe-a1ce-13d2887722d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:35.092805 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a693eee-f375-45fe-a1ce-13d2887722d2 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:35.093088 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a693eee-f375-45fe-a1ce-13d2887722d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:35.093358 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a693eee-f375-45fe-a1ce-13d2887722d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:35.094122 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a693eee-f375-45fe-a1ce-13d2887722d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:35.096352 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a693eee-f375-45fe-a1ce-13d2887722d2 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:35.133407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1108/2228] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:50:35 2022] POST /identity/v3/projects => generated 365 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:50:35.135048 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3cab60-084d-4e34-b0c1-1a3b12ab8a8f admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:35.159804 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3cab60-084d-4e34-b0c1-1a3b12ab8a8f admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:35.244196 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99578d-9764-462f-8d08-be7339f94498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:35.245305 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99578d-9764-462f-8d08-be7339f94498 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:35.245590 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99578d-9764-462f-8d08-be7339f94498 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:35.246120 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99578d-9764-462f-8d08-be7339f94498 admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:35.246656 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df99578d-9764-462f-8d08-be7339f94498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:35.249186 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df99578d-9764-462f-8d08-be7339f94498 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:35.256279 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:35.278221 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1121/2229] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:50:35 2022] POST /identity/v3/users => generated 283 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:50:35.279648 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a693eee-f375-45fe-a1ce-13d2887722d2 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:35.291905 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a693eee-f375-45fe-a1ce-13d2887722d2 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:35.296839 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328e743-ee47-4f51-b08a-e3ba79f6a6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:35.297516 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328e743-ee47-4f51-b08a-e3ba79f6a6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:35.297801 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328e743-ee47-4f51-b08a-e3ba79f6a6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:35.298104 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328e743-ee47-4f51-b08a-e3ba79f6a6e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:35.298873 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8328e743-ee47-4f51-b08a-e3ba79f6a6e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:35.300695 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8328e743-ee47-4f51-b08a-e3ba79f6a6e6 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:35.322494 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1109/2230] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:50:35.326868 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99578d-9764-462f-8d08-be7339f94498 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:35.338335 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99578d-9764-462f-8d08-be7339f94498 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:35.346593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442f1dc-3ab5-4404-b863-1404cef1d77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:35.347381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442f1dc-3ab5-4404-b863-1404cef1d77b admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:35.347729 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442f1dc-3ab5-4404-b863-1404cef1d77b admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:35.348080 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442f1dc-3ab5-4404-b863-1404cef1d77b admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:35.348945 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442f1dc-3ab5-4404-b863-1404cef1d77b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:35.352602 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442f1dc-3ab5-4404-b863-1404cef1d77b admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:35.371384 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1122/2231] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:50:35.372083 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328e743-ee47-4f51-b08a-e3ba79f6a6e6 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:35.382378 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328e743-ee47-4f51-b08a-e3ba79f6a6e6 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:35.389888 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f1173-5e15-4076-8b3e-cabf9a61853b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:35.390415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f1173-5e15-4076-8b3e-cabf9a61853b admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:35.390706 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f1173-5e15-4076-8b3e-cabf9a61853b admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:35.390981 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f1173-5e15-4076-8b3e-cabf9a61853b admin admin] PATH_INFO: `/v3/projects/2e0f90b236054255ae504cab6b0122f0/users/5dcea9fe7d2a40b0875ff1dcd5a4a645/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:35.407264 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442f1dc-3ab5-4404-b863-1404cef1d77b admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:35.409040 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f1173-5e15-4076-8b3e-cabf9a61853b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e0f90b236054255ae504cab6b0122f0, user_id=5dcea9fe7d2a40b0875ff1dcd5a4a645, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:35.411343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-a442f1dc-3ab5-4404-b863-1404cef1d77b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:35.417133 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f1173-5e15-4076-8b3e-cabf9a61853b admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:35.427017 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442f1dc-3ab5-4404-b863-1404cef1d77b admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:35.432170 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c24bf-dd92-4909-802c-f729c346585f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:35.433078 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c24bf-dd92-4909-802c-f729c346585f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:35.434036 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c24bf-dd92-4909-802c-f729c346585f admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:35.434317 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c24bf-dd92-4909-802c-f729c346585f admin admin] PATH_INFO: `/v3/projects/63f0c82305874582843a4e67a62e7e6a` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:35.435515 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c24bf-dd92-4909-802c-f729c346585f admin admin] RBAC: Authorizing `identity:delete_project(project_id=63f0c82305874582843a4e67a62e7e6a)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:35.437631 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c24bf-dd92-4909-802c-f729c346585f admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:35.452244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1110/2232] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:50:35 2022] PUT /identity/v3/projects/2e0f90b236054255ae504cab6b0122f0/users/5dcea9fe7d2a40b0875ff1dcd5a4a645/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:35.517906 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe788a5-9ffb-4d9a-948f-08f6942bb4cd None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:35.518117 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe788a5-9ffb-4d9a-948f-08f6942bb4cd None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:35.518404 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe788a5-9ffb-4d9a-948f-08f6942bb4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:35.537724 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-a69c24bf-dd92-4909-802c-f729c346585f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63f0c82305874582843a4e67a62e7e6a', 'request_id': 'req-a69c24bf-dd92-4909-802c-f729c346585f'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:35.554036 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-a69c24bf-dd92-4909-802c-f729c346585f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63f0c82305874582843a4e67a62e7e6a', 'request_id': 'req-a69c24bf-dd92-4909-802c-f729c346585f'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:35.555405 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-0fe788a5-9ffb-4d9a-948f-08f6942bb4cd None None] MFA Rules not processed for user `5dcea9fe7d2a40b0875ff1dcd5a4a645`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:35.557389 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-0fe788a5-9ffb-4d9a-948f-08f6942bb4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:35.567472 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-a69c24bf-dd92-4909-802c-f729c346585f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63f0c82305874582843a4e67a62e7e6a', 'request_id': 'req-a69c24bf-dd92-4909-802c-f729c346585f'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:35.586177 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-a69c24bf-dd92-4909-802c-f729c346585f admin admin] The token cache is being invalidate because project 63f0c82305874582843a4e67a62e7e6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:50:35.586470 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-a69c24bf-dd92-4909-802c-f729c346585f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:35.587342 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-a69c24bf-dd92-4909-802c-f729c346585f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:35.589536 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1123/2233] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:50:35 2022] DELETE /identity/v3/projects/63f0c82305874582843a4e67a62e7e6a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:50:35.595151 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13b544-c87f-4807-be06-f0b331b3d7f9 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:35.596704 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13b544-c87f-4807-be06-f0b331b3d7f9 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:35.597133 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13b544-c87f-4807-be06-f0b331b3d7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:35.623917 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-1b13b544-c87f-4807-be06-f0b331b3d7f9 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:35.625710 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-1b13b544-c87f-4807-be06-f0b331b3d7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:35.666720 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1111/2234] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:35 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:50:35.676098 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe788a5-9ffb-4d9a-948f-08f6942bb4cd None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:35.677567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-0fe788a5-9ffb-4d9a-948f-08f6942bb4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:35.725293 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:35.733489 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1124/2235] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:50:35.741754 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9284040-2165-4ec6-8c08-bb3d620b4d55 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:35.742369 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9284040-2165-4ec6-8c08-bb3d620b4d55 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:35.742868 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9284040-2165-4ec6-8c08-bb3d620b4d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:35.759689 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe788a5-9ffb-4d9a-948f-08f6942bb4cd None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:35.763887 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3d5dd-0597-4d9c-b9fc-a1798d51b4a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:35.764561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3d5dd-0597-4d9c-b9fc-a1798d51b4a0 service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:35.764854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3d5dd-0597-4d9c-b9fc-a1798d51b4a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:35.765162 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3d5dd-0597-4d9c-b9fc-a1798d51b4a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:35.768369 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-e9284040-2165-4ec6-8c08-bb3d620b4d55 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:35.770030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-e9284040-2165-4ec6-8c08-bb3d620b4d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:35.776181 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3d5dd-0597-4d9c-b9fc-a1798d51b4a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:35.777993 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3d5dd-0597-4d9c-b9fc-a1798d51b4a0 service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:35.780949 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1125/2236] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:50:35.785421 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9284040-2165-4ec6-8c08-bb3d620b4d55 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:35.797336 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1112/2237] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:50:35 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:50:35.802761 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9284040-2165-4ec6-8c08-bb3d620b4d55 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:35.809891 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943713f-cf91-46fc-b48a-bb2281402e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:35.811475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943713f-cf91-46fc-b48a-bb2281402e89 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:35.811475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943713f-cf91-46fc-b48a-bb2281402e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:35.811475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943713f-cf91-46fc-b48a-bb2281402e89 admin admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:35.812200 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943713f-cf91-46fc-b48a-bb2281402e89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:50:35.812527 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943713f-cf91-46fc-b48a-bb2281402e89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:35.814233 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943713f-cf91-46fc-b48a-bb2281402e89 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:35.840945 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1126/2238] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:50:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:50:35.842361 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3d5dd-0597-4d9c-b9fc-a1798d51b4a0 service cinder] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:35.855470 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3d5dd-0597-4d9c-b9fc-a1798d51b4a0 service cinder] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:35.863602 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c65e8-5b03-4628-bd7b-e39450190cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:35.864649 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c65e8-5b03-4628-bd7b-e39450190cd2 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:35.865251 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c65e8-5b03-4628-bd7b-e39450190cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:35.865595 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c65e8-5b03-4628-bd7b-e39450190cd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:35.866796 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c65e8-5b03-4628-bd7b-e39450190cd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:35.870277 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c65e8-5b03-4628-bd7b-e39450190cd2 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:35.936500 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1113/2239] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:50:35 2022] POST /identity/v3/projects => generated 383 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:50:35.938589 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943713f-cf91-46fc-b48a-bb2281402e89 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:35.956560 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943713f-cf91-46fc-b48a-bb2281402e89 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:36.070838 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:36.108201 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074e9e1-37c5-4ecf-8306-a0a075a32af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:36.109130 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074e9e1-37c5-4ecf-8306-a0a075a32af1 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:36.109977 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074e9e1-37c5-4ecf-8306-a0a075a32af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:36.110358 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074e9e1-37c5-4ecf-8306-a0a075a32af1 admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:36.111151 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f074e9e1-37c5-4ecf-8306-a0a075a32af1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:36.113943 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f074e9e1-37c5-4ecf-8306-a0a075a32af1 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:36.174492 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1127/2240] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:50:35 2022] POST /identity/v3/users => generated 292 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:50:36.178592 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c65e8-5b03-4628-bd7b-e39450190cd2 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:36.192655 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c65e8-5b03-4628-bd7b-e39450190cd2 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:36.198166 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d8191-d4dc-4bcb-af7e-0a7d775034c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:36.198604 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d8191-d4dc-4bcb-af7e-0a7d775034c5 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:36.198991 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d8191-d4dc-4bcb-af7e-0a7d775034c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:36.199374 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d8191-d4dc-4bcb-af7e-0a7d775034c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:36.200186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d8191-d4dc-4bcb-af7e-0a7d775034c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:36.202140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d8191-d4dc-4bcb-af7e-0a7d775034c5 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:36.215872 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1114/2241] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:50:36.220302 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074e9e1-37c5-4ecf-8306-a0a075a32af1 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:36.237608 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074e9e1-37c5-4ecf-8306-a0a075a32af1 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:36.246125 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8838245-fbf2-43db-8d0c-a7ab4e5e2f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:36.246853 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8838245-fbf2-43db-8d0c-a7ab4e5e2f2c admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:36.247636 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8838245-fbf2-43db-8d0c-a7ab4e5e2f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:36.247906 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8838245-fbf2-43db-8d0c-a7ab4e5e2f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:36.248729 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8838245-fbf2-43db-8d0c-a7ab4e5e2f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:36.250915 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8838245-fbf2-43db-8d0c-a7ab4e5e2f2c admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:36.266835 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1128/2242] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:50:36.271239 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d8191-d4dc-4bcb-af7e-0a7d775034c5 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:36.360860 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d8191-d4dc-4bcb-af7e-0a7d775034c5 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:36.398968 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b18d5-1131-41e2-bef9-6a271116dd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:36.400239 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b18d5-1131-41e2-bef9-6a271116dd23 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:36.400433 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b18d5-1131-41e2-bef9-6a271116dd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:36.401031 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b18d5-1131-41e2-bef9-6a271116dd23 admin admin] PATH_INFO: `/v3/projects/a8f18fbcc16841968031b8df7d270684/users/57da5da43bb44b9492cb0a295e878495/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:36.422218 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b18d5-1131-41e2-bef9-6a271116dd23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8f18fbcc16841968031b8df7d270684, user_id=57da5da43bb44b9492cb0a295e878495, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:36.428227 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b18d5-1131-41e2-bef9-6a271116dd23 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:36.453989 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1115/2243] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:50:36 2022] PUT /identity/v3/projects/a8f18fbcc16841968031b8df7d270684/users/57da5da43bb44b9492cb0a295e878495/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:36.466432 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ca638-7865-4c1b-873d-3bac8979a4b3 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:36.466701 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ca638-7865-4c1b-873d-3bac8979a4b3 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:36.466969 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ca638-7865-4c1b-873d-3bac8979a4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:36.505336 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-4b3ca638-7865-4c1b-873d-3bac8979a4b3 None None] MFA Rules not processed for user `57da5da43bb44b9492cb0a295e878495`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:36.506992 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-4b3ca638-7865-4c1b-873d-3bac8979a4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:36.607402 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1129/2244] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:50:36.618271 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b18d5-1131-41e2-bef9-6a271116dd23 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:36.698964 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b18d5-1131-41e2-bef9-6a271116dd23 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:36.702826 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfbd5b6-0559-4b19-bc0b-8f78e09ff1e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:36.704329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbd5b6-0559-4b19-bc0b-8f78e09ff1e6 service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:36.704329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbd5b6-0559-4b19-bc0b-8f78e09ff1e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:36.704329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbd5b6-0559-4b19-bc0b-8f78e09ff1e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:36.714098 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfbd5b6-0559-4b19-bc0b-8f78e09ff1e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:36.715710 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfbd5b6-0559-4b19-bc0b-8f78e09ff1e6 service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:36.726425 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1116/2245] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:50:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:50:42.381375 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ca638-7865-4c1b-873d-3bac8979a4b3 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:42.461227 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ca638-7865-4c1b-873d-3bac8979a4b3 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:42.467559 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe19ac-0d89-41fd-8383-0021ac66321e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:42.468887 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe19ac-0d89-41fd-8383-0021ac66321e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:42.469252 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe19ac-0d89-41fd-8383-0021ac66321e admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:42.471254 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe19ac-0d89-41fd-8383-0021ac66321e admin admin] PATH_INFO: `/v3/users/57da5da43bb44b9492cb0a295e878495` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:42.472422 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe19ac-0d89-41fd-8383-0021ac66321e admin admin] RBAC: Authorizing `identity:delete_user(user_id=57da5da43bb44b9492cb0a295e878495)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:42.475296 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe19ac-0d89-41fd-8383-0021ac66321e admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:42.543299 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-edbe19ac-0d89-41fd-8383-0021ac66321e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57da5da43bb44b9492cb0a295e878495'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:42.548694 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:42.562068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-edbe19ac-0d89-41fd-8383-0021ac66321e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57da5da43bb44b9492cb0a295e878495'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:42.571960 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-edbe19ac-0d89-41fd-8383-0021ac66321e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57da5da43bb44b9492cb0a295e878495'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:42.572916 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-edbe19ac-0d89-41fd-8383-0021ac66321e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57da5da43bb44b9492cb0a295e878495'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:42.574416 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-edbe19ac-0d89-41fd-8383-0021ac66321e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57da5da43bb44b9492cb0a295e878495'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:42.593894 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1130/2246] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:50:42 2022] DELETE /identity/v3/users/57da5da43bb44b9492cb0a295e878495 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:42.598766 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf8192-8a0d-4490-8d79-f9e3b458d1dc None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:42.599279 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf8192-8a0d-4490-8d79-f9e3b458d1dc None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:42.599429 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf8192-8a0d-4490-8d79-f9e3b458d1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:42.634989 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-5adf8192-8a0d-4490-8d79-f9e3b458d1dc None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:42.636278 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-5adf8192-8a0d-4490-8d79-f9e3b458d1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:42.706677 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1117/2247] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:50:42.716697 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe19ac-0d89-41fd-8383-0021ac66321e admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:42.718457 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-edbe19ac-0d89-41fd-8383-0021ac66321e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:42.785310 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe19ac-0d89-41fd-8383-0021ac66321e admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:42.789549 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ff89f-6b1b-4423-bc16-04ff763ca9fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:42.790321 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ff89f-6b1b-4423-bc16-04ff763ca9fc service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:42.790659 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ff89f-6b1b-4423-bc16-04ff763ca9fc service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:42.790939 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ff89f-6b1b-4423-bc16-04ff763ca9fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:42.800163 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ff89f-6b1b-4423-bc16-04ff763ca9fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:42.801609 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ff89f-6b1b-4423-bc16-04ff763ca9fc service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:42.811851 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1131/2248] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:50:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:50:43.288263 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf8192-8a0d-4490-8d79-f9e3b458d1dc None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:43.292765 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-5adf8192-8a0d-4490-8d79-f9e3b458d1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:43.317924 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf8192-8a0d-4490-8d79-f9e3b458d1dc None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:43.342761 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38501421-e533-403b-a9b3-84700615475a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:43.346695 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38501421-e533-403b-a9b3-84700615475a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:43.346695 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38501421-e533-403b-a9b3-84700615475a admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:43.346695 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38501421-e533-403b-a9b3-84700615475a admin admin] PATH_INFO: `/v3/projects/a8f18fbcc16841968031b8df7d270684` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:43.359075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38501421-e533-403b-a9b3-84700615475a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8f18fbcc16841968031b8df7d270684)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:43.359075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38501421-e533-403b-a9b3-84700615475a admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:43.402434 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:43.446137 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-38501421-e533-403b-a9b3-84700615475a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8f18fbcc16841968031b8df7d270684', 'request_id': 'req-38501421-e533-403b-a9b3-84700615475a'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:43.453305 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-38501421-e533-403b-a9b3-84700615475a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8f18fbcc16841968031b8df7d270684', 'request_id': 'req-38501421-e533-403b-a9b3-84700615475a'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:43.471121 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-38501421-e533-403b-a9b3-84700615475a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8f18fbcc16841968031b8df7d270684', 'request_id': 'req-38501421-e533-403b-a9b3-84700615475a'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:43.500159 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-38501421-e533-403b-a9b3-84700615475a admin admin] The token cache is being invalidate because project a8f18fbcc16841968031b8df7d270684 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:50:43.500364 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-38501421-e533-403b-a9b3-84700615475a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:43.501022 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-38501421-e533-403b-a9b3-84700615475a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:43.505886 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1118/2249] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:50:43 2022] DELETE /identity/v3/projects/a8f18fbcc16841968031b8df7d270684 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:43.508829 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f849bb7-20bc-4fca-8a23-3a8a4b342a8a None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:43.509392 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f849bb7-20bc-4fca-8a23-3a8a4b342a8a None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:43.509518 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f849bb7-20bc-4fca-8a23-3a8a4b342a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:43.532586 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-4f849bb7-20bc-4fca-8a23-3a8a4b342a8a None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:43.533987 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-4f849bb7-20bc-4fca-8a23-3a8a4b342a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:43.601756 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1132/2250] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:50:43.611576 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5dfc6-a293-4b77-be63-cdbd2e21ff83 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:43.612212 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5dfc6-a293-4b77-be63-cdbd2e21ff83 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:43.613908 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5dfc6-a293-4b77-be63-cdbd2e21ff83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:43.643274 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-e0f5dfc6-a293-4b77-be63-cdbd2e21ff83 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:43.644498 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-e0f5dfc6-a293-4b77-be63-cdbd2e21ff83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:43.653065 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1119/2251] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:50:43.657979 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f849bb7-20bc-4fca-8a23-3a8a4b342a8a None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:43.669495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f849bb7-20bc-4fca-8a23-3a8a4b342a8a None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:43.674207 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7a4a5-24d1-42eb-8c85-5a0b3a7e8f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:43.674904 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7a4a5-24d1-42eb-8c85-5a0b3a7e8f6b admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:43.675245 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7a4a5-24d1-42eb-8c85-5a0b3a7e8f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:43.675602 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7a4a5-24d1-42eb-8c85-5a0b3a7e8f6b admin admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:43.676412 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7a4a5-24d1-42eb-8c85-5a0b3a7e8f6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:50:43.676720 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7a4a5-24d1-42eb-8c85-5a0b3a7e8f6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:43.678492 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7a4a5-24d1-42eb-8c85-5a0b3a7e8f6b admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:43.697874 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1133/2252] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:50:43.705389 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5dfc6-a293-4b77-be63-cdbd2e21ff83 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:43.717366 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5dfc6-a293-4b77-be63-cdbd2e21ff83 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:43.722081 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a82553-5721-4bd9-8c9e-245852d7929c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:43.722746 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a82553-5721-4bd9-8c9e-245852d7929c admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:43.723022 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a82553-5721-4bd9-8c9e-245852d7929c admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:43.723297 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a82553-5721-4bd9-8c9e-245852d7929c admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:43.724059 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a82553-5721-4bd9-8c9e-245852d7929c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:43.726103 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a82553-5721-4bd9-8c9e-245852d7929c admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:43.761922 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1120/2253] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:50:43 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:50:43.763616 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7a4a5-24d1-42eb-8c85-5a0b3a7e8f6b admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:43.778823 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7a4a5-24d1-42eb-8c85-5a0b3a7e8f6b admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:43.875672 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d697ab-7a39-4b7f-afa0-cff882f51baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:43.876504 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d697ab-7a39-4b7f-afa0-cff882f51baf admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:43.876698 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d697ab-7a39-4b7f-afa0-cff882f51baf admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:43.876923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d697ab-7a39-4b7f-afa0-cff882f51baf admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:43.877615 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d697ab-7a39-4b7f-afa0-cff882f51baf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:43.879599 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d697ab-7a39-4b7f-afa0-cff882f51baf admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:43.886328 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:43.905402 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1134/2254] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:50:43 2022] POST /identity/v3/users => generated 288 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:50:43.906610 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a82553-5721-4bd9-8c9e-245852d7929c admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:43.917052 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a82553-5721-4bd9-8c9e-245852d7929c admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:43.921902 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd293a-c83f-4b7a-bd22-b8709d1af564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:43.922575 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd293a-c83f-4b7a-bd22-b8709d1af564 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:43.922851 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd293a-c83f-4b7a-bd22-b8709d1af564 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:43.923102 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd293a-c83f-4b7a-bd22-b8709d1af564 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:43.923826 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd293a-c83f-4b7a-bd22-b8709d1af564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:43.925423 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd293a-c83f-4b7a-bd22-b8709d1af564 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:43.936253 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1121/2255] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:50:43.940787 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d697ab-7a39-4b7f-afa0-cff882f51baf admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:43.952758 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d697ab-7a39-4b7f-afa0-cff882f51baf admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:43.958334 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80361d3d-0ba0-4b93-9229-2ed0669f3851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:43.959000 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80361d3d-0ba0-4b93-9229-2ed0669f3851 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:43.959281 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80361d3d-0ba0-4b93-9229-2ed0669f3851 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:43.959541 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80361d3d-0ba0-4b93-9229-2ed0669f3851 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:43.960273 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80361d3d-0ba0-4b93-9229-2ed0669f3851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:43.961950 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80361d3d-0ba0-4b93-9229-2ed0669f3851 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:43.972451 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1135/2256] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:50:43.976675 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd293a-c83f-4b7a-bd22-b8709d1af564 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:43.988398 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd293a-c83f-4b7a-bd22-b8709d1af564 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:43.995057 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690fb5a0-be6c-4997-bb61-29bce7248d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:43.996294 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fb5a0-be6c-4997-bb61-29bce7248d83 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:43.996701 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fb5a0-be6c-4997-bb61-29bce7248d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:43.997207 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fb5a0-be6c-4997-bb61-29bce7248d83 admin admin] PATH_INFO: `/v3/projects/13aaa05ecbb543e990bd343e65b4bdf4/users/fd0ca5e9c4654fdcaae9914f58acc14d/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:44.013771 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690fb5a0-be6c-4997-bb61-29bce7248d83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13aaa05ecbb543e990bd343e65b4bdf4, user_id=fd0ca5e9c4654fdcaae9914f58acc14d, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:44.026212 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690fb5a0-be6c-4997-bb61-29bce7248d83 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:44.033698 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1122/2257] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:50:43 2022] PUT /identity/v3/projects/13aaa05ecbb543e990bd343e65b4bdf4/users/fd0ca5e9c4654fdcaae9914f58acc14d/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:44.044876 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d05c4-acc1-46df-bb48-700568f02e26 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:44.045167 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d05c4-acc1-46df-bb48-700568f02e26 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:44.045444 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d05c4-acc1-46df-bb48-700568f02e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:44.075491 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-cf4d05c4-acc1-46df-bb48-700568f02e26 None None] MFA Rules not processed for user `fd0ca5e9c4654fdcaae9914f58acc14d`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:44.077209 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-cf4d05c4-acc1-46df-bb48-700568f02e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:44.170169 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1136/2258] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:50:44.181543 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690fb5a0-be6c-4997-bb61-29bce7248d83 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:44.183286 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-690fb5a0-be6c-4997-bb61-29bce7248d83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:44.245669 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690fb5a0-be6c-4997-bb61-29bce7248d83 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:44.250645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90778f4d-c657-4b3d-ae43-e0bc94358448 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:44.251452 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90778f4d-c657-4b3d-ae43-e0bc94358448 service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:44.251852 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90778f4d-c657-4b3d-ae43-e0bc94358448 service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:44.252134 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90778f4d-c657-4b3d-ae43-e0bc94358448 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:44.261912 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90778f4d-c657-4b3d-ae43-e0bc94358448 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:44.263512 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90778f4d-c657-4b3d-ae43-e0bc94358448 service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:44.273976 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1123/2259] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:50:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:50:47.642545 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d05c4-acc1-46df-bb48-700568f02e26 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:47.719768 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d05c4-acc1-46df-bb48-700568f02e26 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:47.724878 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216caab0-bcb3-4c3e-825f-796fd91e48b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:47.725811 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216caab0-bcb3-4c3e-825f-796fd91e48b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:47.726127 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216caab0-bcb3-4c3e-825f-796fd91e48b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:47.726453 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216caab0-bcb3-4c3e-825f-796fd91e48b0 admin admin] PATH_INFO: `/v3/users/fd0ca5e9c4654fdcaae9914f58acc14d` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:47.727829 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216caab0-bcb3-4c3e-825f-796fd91e48b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd0ca5e9c4654fdcaae9914f58acc14d)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:47.730130 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216caab0-bcb3-4c3e-825f-796fd91e48b0 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:47.782280 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-216caab0-bcb3-4c3e-825f-796fd91e48b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd0ca5e9c4654fdcaae9914f58acc14d'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:47.794676 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-216caab0-bcb3-4c3e-825f-796fd91e48b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd0ca5e9c4654fdcaae9914f58acc14d'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:47.799584 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:47.802584 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-216caab0-bcb3-4c3e-825f-796fd91e48b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd0ca5e9c4654fdcaae9914f58acc14d'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:47.803379 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-216caab0-bcb3-4c3e-825f-796fd91e48b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd0ca5e9c4654fdcaae9914f58acc14d'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:47.809870 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-216caab0-bcb3-4c3e-825f-796fd91e48b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd0ca5e9c4654fdcaae9914f58acc14d'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:47.823001 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1137/2260] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:50:47 2022] DELETE /identity/v3/users/fd0ca5e9c4654fdcaae9914f58acc14d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:47.827676 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809489b-ca10-407c-bb2e-a96c1052cde2 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:47.828150 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809489b-ca10-407c-bb2e-a96c1052cde2 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:47.828261 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809489b-ca10-407c-bb2e-a96c1052cde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:47.847155 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-3809489b-ca10-407c-bb2e-a96c1052cde2 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:47.848412 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-3809489b-ca10-407c-bb2e-a96c1052cde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:47.899492 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:47.923330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1124/2261] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:50:47.933999 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216caab0-bcb3-4c3e-825f-796fd91e48b0 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:47.935488 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-216caab0-bcb3-4c3e-825f-796fd91e48b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:48.005225 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216caab0-bcb3-4c3e-825f-796fd91e48b0 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:48.011591 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6568c-8546-4239-b6e6-265bc97d8006 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:48.013174 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6568c-8546-4239-b6e6-265bc97d8006 service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:48.013675 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6568c-8546-4239-b6e6-265bc97d8006 service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:48.014792 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6568c-8546-4239-b6e6-265bc97d8006 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:48.030995 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6568c-8546-4239-b6e6-265bc97d8006 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:48.032536 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6568c-8546-4239-b6e6-265bc97d8006 service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:48.044239 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1138/2262] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:50:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:50:48.488691 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809489b-ca10-407c-bb2e-a96c1052cde2 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:48.491102 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-3809489b-ca10-407c-bb2e-a96c1052cde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:48.513024 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809489b-ca10-407c-bb2e-a96c1052cde2 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:48.518654 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a6be4-c7ec-412d-9074-9e6d225f5f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:48.520153 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a6be4-c7ec-412d-9074-9e6d225f5f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:48.520617 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a6be4-c7ec-412d-9074-9e6d225f5f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:48.520900 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a6be4-c7ec-412d-9074-9e6d225f5f31 admin admin] PATH_INFO: `/v3/projects/13aaa05ecbb543e990bd343e65b4bdf4` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:48.522477 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a6be4-c7ec-412d-9074-9e6d225f5f31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13aaa05ecbb543e990bd343e65b4bdf4)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:48.524817 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a6be4-c7ec-412d-9074-9e6d225f5f31 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:48.613251 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-bb5a6be4-c7ec-412d-9074-9e6d225f5f31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13aaa05ecbb543e990bd343e65b4bdf4', 'request_id': 'req-bb5a6be4-c7ec-412d-9074-9e6d225f5f31'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:48.621135 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-bb5a6be4-c7ec-412d-9074-9e6d225f5f31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13aaa05ecbb543e990bd343e65b4bdf4', 'request_id': 'req-bb5a6be4-c7ec-412d-9074-9e6d225f5f31'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:48.631752 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-bb5a6be4-c7ec-412d-9074-9e6d225f5f31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13aaa05ecbb543e990bd343e65b4bdf4', 'request_id': 'req-bb5a6be4-c7ec-412d-9074-9e6d225f5f31'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:48.649044 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-bb5a6be4-c7ec-412d-9074-9e6d225f5f31 admin admin] The token cache is being invalidate because project 13aaa05ecbb543e990bd343e65b4bdf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:50:48.649361 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-bb5a6be4-c7ec-412d-9074-9e6d225f5f31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:48.650223 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-bb5a6be4-c7ec-412d-9074-9e6d225f5f31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:50:48.658068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1125/2263] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:50:48 2022] DELETE /identity/v3/projects/13aaa05ecbb543e990bd343e65b4bdf4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:50:48.659414 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f134686-677e-4d16-8d1f-70d00055a2e5 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:48.660052 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f134686-677e-4d16-8d1f-70d00055a2e5 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:48.660310 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f134686-677e-4d16-8d1f-70d00055a2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:48.687787 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-6f134686-677e-4d16-8d1f-70d00055a2e5 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:48.692733 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-6f134686-677e-4d16-8d1f-70d00055a2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:48.766008 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1139/2264] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:50:48.773175 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f9508-3bbf-4fd6-ab62-2800d9429c05 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:48.773680 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f9508-3bbf-4fd6-ab62-2800d9429c05 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:48.774136 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f9508-3bbf-4fd6-ab62-2800d9429c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:48.796175 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-e02f9508-3bbf-4fd6-ab62-2800d9429c05 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:48.797444 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-e02f9508-3bbf-4fd6-ab62-2800d9429c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:48.805680 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1126/2265] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:50:48.810572 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f134686-677e-4d16-8d1f-70d00055a2e5 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:48.821181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f134686-677e-4d16-8d1f-70d00055a2e5 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:48.833063 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b4923c-88d6-434a-af14-d06f1042acba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:48.833730 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b4923c-88d6-434a-af14-d06f1042acba admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:48.834042 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b4923c-88d6-434a-af14-d06f1042acba admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:48.834316 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b4923c-88d6-434a-af14-d06f1042acba admin admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:48.835050 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b4923c-88d6-434a-af14-d06f1042acba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:50:48.835355 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b4923c-88d6-434a-af14-d06f1042acba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:48.836966 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b4923c-88d6-434a-af14-d06f1042acba admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:48.850274 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1140/2266] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:50:48.854714 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f9508-3bbf-4fd6-ab62-2800d9429c05 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:48.864791 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f9508-3bbf-4fd6-ab62-2800d9429c05 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:48.870077 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588e003-94c4-4042-97b1-540c6eeba0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:48.870810 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588e003-94c4-4042-97b1-540c6eeba0f3 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:48.871118 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588e003-94c4-4042-97b1-540c6eeba0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:48.871395 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588e003-94c4-4042-97b1-540c6eeba0f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:48.872114 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b588e003-94c4-4042-97b1-540c6eeba0f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:48.875428 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b588e003-94c4-4042-97b1-540c6eeba0f3 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:48.910486 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1127/2267] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:50:48 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:50:48.915448 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b4923c-88d6-434a-af14-d06f1042acba admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:48.926045 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b4923c-88d6-434a-af14-d06f1042acba admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:48.989127 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1cb20b-6863-4dc6-848d-bac894dccca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:48.989865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1cb20b-6863-4dc6-848d-bac894dccca7 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:48.990177 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1cb20b-6863-4dc6-848d-bac894dccca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:48.990453 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1cb20b-6863-4dc6-848d-bac894dccca7 admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:48.991203 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1cb20b-6863-4dc6-848d-bac894dccca7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:48.993509 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1cb20b-6863-4dc6-848d-bac894dccca7 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:49.016459 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1141/2268] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:50:48 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:50:49.020336 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588e003-94c4-4042-97b1-540c6eeba0f3 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:49.031525 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588e003-94c4-4042-97b1-540c6eeba0f3 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:49.036574 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d06b38-732f-43a2-8b27-ad303838d3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:49.038081 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d06b38-732f-43a2-8b27-ad303838d3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:49.038829 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d06b38-732f-43a2-8b27-ad303838d3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:49.039121 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d06b38-732f-43a2-8b27-ad303838d3d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:49.039888 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d06b38-732f-43a2-8b27-ad303838d3d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:49.041536 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d06b38-732f-43a2-8b27-ad303838d3d8 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:49.068484 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1128/2269] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:50:49.069928 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1cb20b-6863-4dc6-848d-bac894dccca7 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:49.082337 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1cb20b-6863-4dc6-848d-bac894dccca7 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:49.088267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0a9e7-96c0-4ae9-ad96-df543b89a9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:49.089087 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0a9e7-96c0-4ae9-ad96-df543b89a9aa admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:49.089515 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0a9e7-96c0-4ae9-ad96-df543b89a9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:49.089866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0a9e7-96c0-4ae9-ad96-df543b89a9aa admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:49.090757 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c0a9e7-96c0-4ae9-ad96-df543b89a9aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:49.093190 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c0a9e7-96c0-4ae9-ad96-df543b89a9aa admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:49.094584 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:50:49.109534 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1142/2270] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:50:49.114158 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d06b38-732f-43a2-8b27-ad303838d3d8 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:49.126705 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d06b38-732f-43a2-8b27-ad303838d3d8 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:49.131767 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d85702-7d99-4ae2-a6aa-af7d6a38290c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:49.132729 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d85702-7d99-4ae2-a6aa-af7d6a38290c admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:49.133145 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d85702-7d99-4ae2-a6aa-af7d6a38290c admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:49.133599 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d85702-7d99-4ae2-a6aa-af7d6a38290c admin admin] PATH_INFO: `/v3/projects/e8800acebb704cff81f0ea665888d859/users/bbc71729315a4a1b8f913d3d523f6c3c/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:49.150566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d85702-7d99-4ae2-a6aa-af7d6a38290c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8800acebb704cff81f0ea665888d859, user_id=bbc71729315a4a1b8f913d3d523f6c3c, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:49.153722 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d85702-7d99-4ae2-a6aa-af7d6a38290c admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:49.170259 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1129/2271] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:50:49 2022] PUT /identity/v3/projects/e8800acebb704cff81f0ea665888d859/users/bbc71729315a4a1b8f913d3d523f6c3c/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:50:49.181448 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebd215-b439-4c09-a391-46acee6544dc None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:49.181944 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebd215-b439-4c09-a391-46acee6544dc None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:49.182450 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebd215-b439-4c09-a391-46acee6544dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:49.210574 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-1aebd215-b439-4c09-a391-46acee6544dc None None] MFA Rules not processed for user `bbc71729315a4a1b8f913d3d523f6c3c`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:49.212073 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-1aebd215-b439-4c09-a391-46acee6544dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:49.290492 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1143/2272] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:50:49.303327 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d85702-7d99-4ae2-a6aa-af7d6a38290c admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:50:49.305117 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-89d85702-7d99-4ae2-a6aa-af7d6a38290c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:49.379910 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d85702-7d99-4ae2-a6aa-af7d6a38290c admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:50:49.388544 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd666c-0a0b-40eb-81ce-d026e7218815 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:50:49.389596 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd666c-0a0b-40eb-81ce-d026e7218815 service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:49.390037 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd666c-0a0b-40eb-81ce-d026e7218815 service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:49.390392 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd666c-0a0b-40eb-81ce-d026e7218815 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:49.405924 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd666c-0a0b-40eb-81ce-d026e7218815 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:50:49.408700 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd666c-0a0b-40eb-81ce-d026e7218815 service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:50:49.424555 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1130/2273] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:50:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:50:51.066546 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b069db-a898-45ab-945c-c1b90b03fe8e None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:50:51.067153 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b069db-a898-45ab-945c-c1b90b03fe8e None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:50:51.067351 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b069db-a898-45ab-945c-c1b90b03fe8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:50:51.100795 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-13b069db-a898-45ab-945c-c1b90b03fe8e None None] MFA Rules not processed for user `bbc71729315a4a1b8f913d3d523f6c3c`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:50:51.102649 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-13b069db-a898-45ab-945c-c1b90b03fe8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:50:51.110444 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1144/2274] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:50:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:50:59.419470 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:51:01.082901 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=37 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:51:05.379268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54d375-a7b8-4347-b770-f74711466710 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:05.379791 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54d375-a7b8-4347-b770-f74711466710 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:05.380208 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54d375-a7b8-4347-b770-f74711466710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:05.422816 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-ab54d375-a7b8-4347-b770-f74711466710 None None] MFA Rules not processed for user `bc1c30d3677845c5b9185f4a4ad5ea03`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:51:05.424946 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-ab54d375-a7b8-4347-b770-f74711466710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:05.517634 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1131/2275] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:51:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:51:07.722923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0133f-6a3a-4e48-9f54-d4ed900a8470 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:07.723423 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0133f-6a3a-4e48-9f54-d4ed900a8470 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:07.723523 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0133f-6a3a-4e48-9f54-d4ed900a8470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:07.743434 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-b0c0133f-6a3a-4e48-9f54-d4ed900a8470 None None] MFA Rules not processed for user `c9647d15389e49e6b7c43ea1b1538a13`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:51:07.744576 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-b0c0133f-6a3a-4e48-9f54-d4ed900a8470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:07.828095 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1145/2276] 10.222.0.27 () {58 vars in 967 bytes} [Tue Jul 5 20:51:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:51:07.841131 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54d375-a7b8-4347-b770-f74711466710 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:07.845975 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-ab54d375-a7b8-4347-b770-f74711466710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:07.923794 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54d375-a7b8-4347-b770-f74711466710 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:07.933056 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271848e-113a-4fdd-bf87-aef350b8c3f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90aa580a2e10467a93c2d79d1906bd8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:07.934685 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271848e-113a-4fdd-bf87-aef350b8c3f2 service swift] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:07.934685 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271848e-113a-4fdd-bf87-aef350b8c3f2 service swift] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:07.934685 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271848e-113a-4fdd-bf87-aef350b8c3f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:07.949218 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271848e-113a-4fdd-bf87-aef350b8c3f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:07.950883 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271848e-113a-4fdd-bf87-aef350b8c3f2 service swift] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:07.959459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1132/2277] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Jul 5 20:51:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 20:51:10.011654 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aaba20-9646-41a2-a4ea-42c8fbdc1418 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:10.012788 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aaba20-9646-41a2-a4ea-42c8fbdc1418 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:10.014044 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aaba20-9646-41a2-a4ea-42c8fbdc1418 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:10.018272 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1146/2278] 10.222.0.27 () {54 vars in 921 bytes} [Tue Jul 5 20:51:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:51:10.061580 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a645c-021c-4995-bea1-be0c9f0459c6 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:10.062747 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a645c-021c-4995-bea1-be0c9f0459c6 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:10.063439 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a645c-021c-4995-bea1-be0c9f0459c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:10.095368 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-730a645c-021c-4995-bea1-be0c9f0459c6 None None] MFA Rules not processed for user `16662dd5e2e74163b6aa2e1e7ef07524`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:51:10.097213 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-730a645c-021c-4995-bea1-be0c9f0459c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:10.178835 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aaba20-9646-41a2-a4ea-42c8fbdc1418 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:10.180767 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-29aaba20-9646-41a2-a4ea-42c8fbdc1418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:10.204035 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:51:10.219724 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1133/2279] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Jul 5 20:51:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:51:10.256555 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a645c-021c-4995-bea1-be0c9f0459c6 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:10.258558 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-730a645c-021c-4995-bea1-be0c9f0459c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:10.276796 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a645c-021c-4995-bea1-be0c9f0459c6 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:10.286193 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7e93e-dcd9-40e7-bd7b-3b7579aad1a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16662dd5e2e74163b6aa2e1e7ef07524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:10.287026 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7e93e-dcd9-40e7-bd7b-3b7579aad1a0 service placement] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:10.287381 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7e93e-dcd9-40e7-bd7b-3b7579aad1a0 service placement] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:10.296252 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7e93e-dcd9-40e7-bd7b-3b7579aad1a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:10.310926 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7e93e-dcd9-40e7-bd7b-3b7579aad1a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:10.312831 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7e93e-dcd9-40e7-bd7b-3b7579aad1a0 service placement] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:10.333495 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1134/2280] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:51:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:51:10.536607 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aaba20-9646-41a2-a4ea-42c8fbdc1418 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:10.542451 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a1c72-8652-4443-9ada-021d70939267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:10.543458 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a1c72-8652-4443-9ada-021d70939267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:10.543800 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a1c72-8652-4443-9ada-021d70939267 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:10.544143 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a1c72-8652-4443-9ada-021d70939267 admin admin] PATH_INFO: `/v3/users/bd413f66141241979fac14c0c98fe406` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:10.545446 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a1c72-8652-4443-9ada-021d70939267 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd413f66141241979fac14c0c98fe406)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:10.547498 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a1c72-8652-4443-9ada-021d70939267 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:10.625192 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-208a1c72-8652-4443-9ada-021d70939267 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd413f66141241979fac14c0c98fe406'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:10.641437 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:51:10.644125 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-208a1c72-8652-4443-9ada-021d70939267 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd413f66141241979fac14c0c98fe406'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:10.663781 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-208a1c72-8652-4443-9ada-021d70939267 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd413f66141241979fac14c0c98fe406'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:10.666307 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-208a1c72-8652-4443-9ada-021d70939267 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd413f66141241979fac14c0c98fe406'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:10.667349 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-208a1c72-8652-4443-9ada-021d70939267 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd413f66141241979fac14c0c98fe406'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:10.688097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1147/2281] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:51:10 2022] DELETE /identity/v3/users/bd413f66141241979fac14c0c98fe406 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:51:10.949654 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7e93e-dcd9-40e7-bd7b-3b7579aad1a0 service placement] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:10.969893 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7e93e-dcd9-40e7-bd7b-3b7579aad1a0 service placement] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:11.064091 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d601b-8e61-4fde-b3e5-a5d41d469717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:11.066225 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d601b-8e61-4fde-b3e5-a5d41d469717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:11.066687 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d601b-8e61-4fde-b3e5-a5d41d469717 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:11.067142 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d601b-8e61-4fde-b3e5-a5d41d469717 admin admin] PATH_INFO: `/v3/projects/fc93e462659e439896c94ae57b4f7f3d` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:11.071466 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d601b-8e61-4fde-b3e5-a5d41d469717 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc93e462659e439896c94ae57b4f7f3d)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:11.073885 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d601b-8e61-4fde-b3e5-a5d41d469717 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:11.140196 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c35d601b-8e61-4fde-b3e5-a5d41d469717 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc93e462659e439896c94ae57b4f7f3d', 'request_id': 'req-c35d601b-8e61-4fde-b3e5-a5d41d469717'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:11.147814 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c35d601b-8e61-4fde-b3e5-a5d41d469717 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc93e462659e439896c94ae57b4f7f3d', 'request_id': 'req-c35d601b-8e61-4fde-b3e5-a5d41d469717'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:11.165781 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c35d601b-8e61-4fde-b3e5-a5d41d469717 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc93e462659e439896c94ae57b4f7f3d', 'request_id': 'req-c35d601b-8e61-4fde-b3e5-a5d41d469717'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:11.180915 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c35d601b-8e61-4fde-b3e5-a5d41d469717 admin admin] The token cache is being invalidate because project fc93e462659e439896c94ae57b4f7f3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:51:11.181172 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c35d601b-8e61-4fde-b3e5-a5d41d469717 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:11.181922 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c35d601b-8e61-4fde-b3e5-a5d41d469717 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:11.186762 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1135/2282] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:51:10 2022] DELETE /identity/v3/projects/fc93e462659e439896c94ae57b4f7f3d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:51:13.602044 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135740ba-c4f1-4c25-bd2f-9ac34e7828e6 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:13.602900 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135740ba-c4f1-4c25-bd2f-9ac34e7828e6 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:13.603073 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135740ba-c4f1-4c25-bd2f-9ac34e7828e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:13.668496 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-135740ba-c4f1-4c25-bd2f-9ac34e7828e6 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:51:13.669714 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-135740ba-c4f1-4c25-bd2f-9ac34e7828e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:13.732535 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1148/2283] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Jul 5 20:51:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:51:13.761865 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d601b-8e61-4fde-b3e5-a5d41d469717 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:13.764040 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-c35d601b-8e61-4fde-b3e5-a5d41d469717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:13.853339 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d601b-8e61-4fde-b3e5-a5d41d469717 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:13.859498 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44968df-b39e-454b-abb8-7fcb84825a06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:13.860160 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44968df-b39e-454b-abb8-7fcb84825a06 service nova] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:13.860440 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44968df-b39e-454b-abb8-7fcb84825a06 service nova] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:13.860715 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44968df-b39e-454b-abb8-7fcb84825a06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:13.869607 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44968df-b39e-454b-abb8-7fcb84825a06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:13.871324 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44968df-b39e-454b-abb8-7fcb84825a06 service nova] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:13.876662 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:51:13.886375 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1136/2284] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:51:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:51:19.402397 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd46e0e-d57d-46aa-bd61-c8aea91ec542 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:19.402894 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd46e0e-d57d-46aa-bd61-c8aea91ec542 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:19.402991 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd46e0e-d57d-46aa-bd61-c8aea91ec542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:19.422078 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-dbd46e0e-d57d-46aa-bd61-c8aea91ec542 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:51:19.423222 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-dbd46e0e-d57d-46aa-bd61-c8aea91ec542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:19.431661 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1149/2285] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Jul 5 20:51:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:51:19.474292 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44968df-b39e-454b-abb8-7fcb84825a06 service nova] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:19.487100 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44968df-b39e-454b-abb8-7fcb84825a06 service nova] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:19.493086 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e9a40-1110-4168-a617-6e232909290b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:19.493735 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e9a40-1110-4168-a617-6e232909290b service nova] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:19.494084 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e9a40-1110-4168-a617-6e232909290b service nova] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:19.494360 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e9a40-1110-4168-a617-6e232909290b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:19.503748 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e9a40-1110-4168-a617-6e232909290b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:19.505416 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e9a40-1110-4168-a617-6e232909290b service nova] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:19.523399 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1137/2286] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:51:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:51:21.264722 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f712bd-b7e9-42ed-ae0e-58cfa04e23e3 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:21.265256 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f712bd-b7e9-42ed-ae0e-58cfa04e23e3 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:21.265256 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f712bd-b7e9-42ed-ae0e-58cfa04e23e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:21.297509 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-03f712bd-b7e9-42ed-ae0e-58cfa04e23e3 None None] MFA Rules not processed for user `c9647d15389e49e6b7c43ea1b1538a13`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:51:21.298737 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-03f712bd-b7e9-42ed-ae0e-58cfa04e23e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:21.369041 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1150/2287] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Jul 5 20:51:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:51:21.381073 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e9a40-1110-4168-a617-6e232909290b service nova] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:21.382616 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-224e9a40-1110-4168-a617-6e232909290b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:21.458221 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e9a40-1110-4168-a617-6e232909290b service nova] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:21.463750 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cd299-6fd3-403e-b8f4-b972a04d0aca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90aa580a2e10467a93c2d79d1906bd8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:21.464481 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cd299-6fd3-403e-b8f4-b972a04d0aca service swift] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:21.464791 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cd299-6fd3-403e-b8f4-b972a04d0aca service swift] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:21.465063 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cd299-6fd3-403e-b8f4-b972a04d0aca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:21.476100 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86cd299-6fd3-403e-b8f4-b972a04d0aca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:21.477715 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86cd299-6fd3-403e-b8f4-b972a04d0aca service swift] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:21.491561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1138/2288] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Jul 5 20:51:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 20:51:21.697567 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f712bd-b7e9-42ed-ae0e-58cfa04e23e3 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:21.699261 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-03f712bd-b7e9-42ed-ae0e-58cfa04e23e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:21.718080 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f712bd-b7e9-42ed-ae0e-58cfa04e23e3 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:21.723225 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93805c-38ef-43bd-b133-9e830ca39013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:21.724110 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93805c-38ef-43bd-b133-9e830ca39013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:21.724399 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93805c-38ef-43bd-b133-9e830ca39013 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:21.724676 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93805c-38ef-43bd-b133-9e830ca39013 admin admin] PATH_INFO: `/v3/users/5dcea9fe7d2a40b0875ff1dcd5a4a645` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:21.725921 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93805c-38ef-43bd-b133-9e830ca39013 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dcea9fe7d2a40b0875ff1dcd5a4a645)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:21.728761 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93805c-38ef-43bd-b133-9e830ca39013 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:21.765370 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:51:21.789096 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-4c93805c-38ef-43bd-b133-9e830ca39013 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dcea9fe7d2a40b0875ff1dcd5a4a645'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:21.827638 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-4c93805c-38ef-43bd-b133-9e830ca39013 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dcea9fe7d2a40b0875ff1dcd5a4a645'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:21.843664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-4c93805c-38ef-43bd-b133-9e830ca39013 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dcea9fe7d2a40b0875ff1dcd5a4a645'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:21.846862 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-4c93805c-38ef-43bd-b133-9e830ca39013 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dcea9fe7d2a40b0875ff1dcd5a4a645'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:21.847764 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-4c93805c-38ef-43bd-b133-9e830ca39013 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dcea9fe7d2a40b0875ff1dcd5a4a645'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:21.872313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1151/2289] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:51:21 2022] DELETE /identity/v3/users/5dcea9fe7d2a40b0875ff1dcd5a4a645 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:51:21.876970 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826773e-d2e1-41e5-8ac9-7c76be6f6383 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:21.877447 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826773e-d2e1-41e5-8ac9-7c76be6f6383 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:21.877682 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826773e-d2e1-41e5-8ac9-7c76be6f6383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:21.908917 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-c826773e-d2e1-41e5-8ac9-7c76be6f6383 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:51:21.914198 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-c826773e-d2e1-41e5-8ac9-7c76be6f6383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:22.030654 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1139/2290] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:51:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:51:22.035878 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93805c-38ef-43bd-b133-9e830ca39013 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:22.037399 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-4c93805c-38ef-43bd-b133-9e830ca39013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:22.153707 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93805c-38ef-43bd-b133-9e830ca39013 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:22.160057 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3cd45-4b0b-4684-b991-0abba10b962f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:22.160978 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3cd45-4b0b-4684-b991-0abba10b962f service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:22.161433 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3cd45-4b0b-4684-b991-0abba10b962f service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:22.161909 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3cd45-4b0b-4684-b991-0abba10b962f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:22.179380 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3cd45-4b0b-4684-b991-0abba10b962f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:22.185252 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3cd45-4b0b-4684-b991-0abba10b962f service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:22.204345 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1152/2291] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:51:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:51:22.763612 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826773e-d2e1-41e5-8ac9-7c76be6f6383 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:22.765142 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-c826773e-d2e1-41e5-8ac9-7c76be6f6383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:22.778876 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826773e-d2e1-41e5-8ac9-7c76be6f6383 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:22.785445 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee4220-77d0-4bd0-9794-6be45884a759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:22.786975 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee4220-77d0-4bd0-9794-6be45884a759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:22.788097 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee4220-77d0-4bd0-9794-6be45884a759 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:22.788597 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee4220-77d0-4bd0-9794-6be45884a759 admin admin] PATH_INFO: `/v3/projects/2e0f90b236054255ae504cab6b0122f0` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:22.790448 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee4220-77d0-4bd0-9794-6be45884a759 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e0f90b236054255ae504cab6b0122f0)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:22.792738 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee4220-77d0-4bd0-9794-6be45884a759 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:22.876170 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-8dee4220-77d0-4bd0-9794-6be45884a759 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e0f90b236054255ae504cab6b0122f0', 'request_id': 'req-8dee4220-77d0-4bd0-9794-6be45884a759'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:22.884657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-8dee4220-77d0-4bd0-9794-6be45884a759 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e0f90b236054255ae504cab6b0122f0', 'request_id': 'req-8dee4220-77d0-4bd0-9794-6be45884a759'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:22.898795 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-8dee4220-77d0-4bd0-9794-6be45884a759 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e0f90b236054255ae504cab6b0122f0', 'request_id': 'req-8dee4220-77d0-4bd0-9794-6be45884a759'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:22.911544 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:51:22.916750 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-8dee4220-77d0-4bd0-9794-6be45884a759 admin admin] The token cache is being invalidate because project 2e0f90b236054255ae504cab6b0122f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:51:22.917657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-8dee4220-77d0-4bd0-9794-6be45884a759 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:22.918667 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-8dee4220-77d0-4bd0-9794-6be45884a759 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:22.921186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1140/2292] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:51:22 2022] DELETE /identity/v3/projects/2e0f90b236054255ae504cab6b0122f0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:51:22.926773 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455db61-d4c8-49f0-98ff-7ac0ba01ae9d None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:22.927405 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455db61-d4c8-49f0-98ff-7ac0ba01ae9d None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:22.927585 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455db61-d4c8-49f0-98ff-7ac0ba01ae9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:22.948344 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-9455db61-d4c8-49f0-98ff-7ac0ba01ae9d None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:51:22.949966 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-9455db61-d4c8-49f0-98ff-7ac0ba01ae9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:23.056314 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98229f46-945a-4f49-a00c-9f69d4e00b2f None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:23.056612 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98229f46-945a-4f49-a00c-9f69d4e00b2f None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:23.057344 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98229f46-945a-4f49-a00c-9f69d4e00b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:23.062241 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1153/2293] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:51:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:51:23.090191 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-98229f46-945a-4f49-a00c-9f69d4e00b2f None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:51:23.091494 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-98229f46-945a-4f49-a00c-9f69d4e00b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:23.100882 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1141/2294] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:51:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:51:23.105479 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455db61-d4c8-49f0-98ff-7ac0ba01ae9d None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:23.116818 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455db61-d4c8-49f0-98ff-7ac0ba01ae9d None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:23.121549 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a3493-8442-46ac-84a8-cc7e2b5f1d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:23.122295 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a3493-8442-46ac-84a8-cc7e2b5f1d3b admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:23.122579 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a3493-8442-46ac-84a8-cc7e2b5f1d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:23.123001 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a3493-8442-46ac-84a8-cc7e2b5f1d3b admin admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:23.123747 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a3493-8442-46ac-84a8-cc7e2b5f1d3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:51:23.125751 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a3493-8442-46ac-84a8-cc7e2b5f1d3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:23.127870 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a3493-8442-46ac-84a8-cc7e2b5f1d3b admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:23.158432 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1154/2295] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:51:23.163236 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98229f46-945a-4f49-a00c-9f69d4e00b2f None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:23.183753 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98229f46-945a-4f49-a00c-9f69d4e00b2f None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:23.188867 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cc503-9fa3-453c-afb3-655a438b2fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:23.189539 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cc503-9fa3-453c-afb3-655a438b2fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:23.189816 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cc503-9fa3-453c-afb3-655a438b2fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:23.190123 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cc503-9fa3-453c-afb3-655a438b2fa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:23.190815 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6cc503-9fa3-453c-afb3-655a438b2fa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:23.192935 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6cc503-9fa3-453c-afb3-655a438b2fa2 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:23.228346 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1142/2296] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:51:23 2022] POST /identity/v3/projects => generated 371 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:51:23.229566 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a3493-8442-46ac-84a8-cc7e2b5f1d3b admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:23.240196 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a3493-8442-46ac-84a8-cc7e2b5f1d3b admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:23.255421 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:51:23.305695 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e2540-6d48-4fa5-a9bb-6efa58107d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:23.306421 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e2540-6d48-4fa5-a9bb-6efa58107d19 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:23.306760 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e2540-6d48-4fa5-a9bb-6efa58107d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:23.307181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e2540-6d48-4fa5-a9bb-6efa58107d19 admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:23.307913 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e2540-6d48-4fa5-a9bb-6efa58107d19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:23.309950 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e2540-6d48-4fa5-a9bb-6efa58107d19 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:23.336378 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1155/2297] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:51:23 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:51:23.337751 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cc503-9fa3-453c-afb3-655a438b2fa2 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:23.354799 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cc503-9fa3-453c-afb3-655a438b2fa2 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:23.360566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb613d-d8d9-4d3f-bc19-c0a3c124880e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:23.361484 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb613d-d8d9-4d3f-bc19-c0a3c124880e admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:23.361771 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb613d-d8d9-4d3f-bc19-c0a3c124880e admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:23.362095 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb613d-d8d9-4d3f-bc19-c0a3c124880e admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:23.362839 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb613d-d8d9-4d3f-bc19-c0a3c124880e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:23.364498 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb613d-d8d9-4d3f-bc19-c0a3c124880e admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:23.380606 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1143/2298] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:51:23.381905 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e2540-6d48-4fa5-a9bb-6efa58107d19 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:23.392361 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e2540-6d48-4fa5-a9bb-6efa58107d19 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:23.397040 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747986ed-684c-44ef-b81e-f0a112442493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:23.397820 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747986ed-684c-44ef-b81e-f0a112442493 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:23.398144 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747986ed-684c-44ef-b81e-f0a112442493 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:23.398402 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747986ed-684c-44ef-b81e-f0a112442493 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:23.399162 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747986ed-684c-44ef-b81e-f0a112442493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:23.400792 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747986ed-684c-44ef-b81e-f0a112442493 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:23.417886 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1156/2299] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:51:23.420831 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb613d-d8d9-4d3f-bc19-c0a3c124880e admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:23.437638 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb613d-d8d9-4d3f-bc19-c0a3c124880e admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:23.446340 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4592948-ebbd-4a49-b5c8-073eddfb28ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:23.447555 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4592948-ebbd-4a49-b5c8-073eddfb28ab admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:23.448347 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4592948-ebbd-4a49-b5c8-073eddfb28ab admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:23.449375 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4592948-ebbd-4a49-b5c8-073eddfb28ab admin admin] PATH_INFO: `/v3/projects/e48aae928cc94329a4f2279671fa3d72/users/392054fc2d1c4589837014f9720559b5/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:23.479350 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4592948-ebbd-4a49-b5c8-073eddfb28ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=e48aae928cc94329a4f2279671fa3d72, user_id=392054fc2d1c4589837014f9720559b5, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:23.482488 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4592948-ebbd-4a49-b5c8-073eddfb28ab admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:23.515418 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1144/2300] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:51:23 2022] PUT /identity/v3/projects/e48aae928cc94329a4f2279671fa3d72/users/392054fc2d1c4589837014f9720559b5/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:51:23.518000 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2f6b0-7537-49c6-b87e-422ba6122c78 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:23.518479 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2f6b0-7537-49c6-b87e-422ba6122c78 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:23.518889 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2f6b0-7537-49c6-b87e-422ba6122c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:23.550305 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-38a2f6b0-7537-49c6-b87e-422ba6122c78 None None] MFA Rules not processed for user `392054fc2d1c4589837014f9720559b5`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:51:23.551964 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-38a2f6b0-7537-49c6-b87e-422ba6122c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:23.670020 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1157/2301] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:51:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:51:23.683085 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4592948-ebbd-4a49-b5c8-073eddfb28ab admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:23.685273 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-a4592948-ebbd-4a49-b5c8-073eddfb28ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:23.747558 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4592948-ebbd-4a49-b5c8-073eddfb28ab admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:23.752055 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfcda37-d24b-44a2-a501-560bd2ccbdde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:23.752753 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcda37-d24b-44a2-a501-560bd2ccbdde service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:23.753034 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcda37-d24b-44a2-a501-560bd2ccbdde service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:23.753305 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcda37-d24b-44a2-a501-560bd2ccbdde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:23.762662 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfcda37-d24b-44a2-a501-560bd2ccbdde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:23.764546 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfcda37-d24b-44a2-a501-560bd2ccbdde service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:23.774703 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1145/2302] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:51:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:51:23.799171 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b5341-43cf-499a-84ae-4fd4816a3131 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:23.799468 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b5341-43cf-499a-84ae-4fd4816a3131 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:23.799746 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b5341-43cf-499a-84ae-4fd4816a3131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:23.808461 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfcda37-d24b-44a2-a501-560bd2ccbdde service cinder] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:23.832341 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-fd8b5341-43cf-499a-84ae-4fd4816a3131 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:51:23.833882 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-fd8b5341-43cf-499a-84ae-4fd4816a3131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:23.893455 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfcda37-d24b-44a2-a501-560bd2ccbdde service cinder] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:23.900953 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3411bb2-e55a-4917-a0d5-19f398323545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:23.902383 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3411bb2-e55a-4917-a0d5-19f398323545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:23.902712 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3411bb2-e55a-4917-a0d5-19f398323545 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:23.902992 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3411bb2-e55a-4917-a0d5-19f398323545 admin admin] PATH_INFO: `/v3/users/392054fc2d1c4589837014f9720559b5` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:23.909289 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3411bb2-e55a-4917-a0d5-19f398323545 admin admin] RBAC: Authorizing `identity:delete_user(user_id=392054fc2d1c4589837014f9720559b5)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:23.912716 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3411bb2-e55a-4917-a0d5-19f398323545 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:23.949970 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1158/2303] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Jul 5 20:51:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:51:23.981205 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b5341-43cf-499a-84ae-4fd4816a3131 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:23.982830 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-fd8b5341-43cf-499a-84ae-4fd4816a3131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:23.994660 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:51:24.002158 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-e3411bb2-e55a-4917-a0d5-19f398323545 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '392054fc2d1c4589837014f9720559b5'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:24.011072 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-e3411bb2-e55a-4917-a0d5-19f398323545 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '392054fc2d1c4589837014f9720559b5'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:24.024176 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:51:24.034037 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-e3411bb2-e55a-4917-a0d5-19f398323545 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '392054fc2d1c4589837014f9720559b5'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:24.034789 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-e3411bb2-e55a-4917-a0d5-19f398323545 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '392054fc2d1c4589837014f9720559b5'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:24.035405 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-e3411bb2-e55a-4917-a0d5-19f398323545 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '392054fc2d1c4589837014f9720559b5'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:24.056436 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1146/2304] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:51:23 2022] DELETE /identity/v3/users/392054fc2d1c4589837014f9720559b5 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:51:24.061568 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532974a-7c90-45df-b93f-15ac8ef50fab None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:24.061783 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532974a-7c90-45df-b93f-15ac8ef50fab None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:24.066259 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532974a-7c90-45df-b93f-15ac8ef50fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:24.093137 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-3532974a-7c90-45df-b93f-15ac8ef50fab None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:51:24.094431 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-3532974a-7c90-45df-b93f-15ac8ef50fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:24.180179 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1147/2305] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:51:24.191683 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b5341-43cf-499a-84ae-4fd4816a3131 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:24.192751 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532974a-7c90-45df-b93f-15ac8ef50fab None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:24.196417 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-3532974a-7c90-45df-b93f-15ac8ef50fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:24.273528 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532974a-7c90-45df-b93f-15ac8ef50fab None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:24.283346 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166de5b-8085-4a4f-b461-056e2bc4f66d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:24.284417 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166de5b-8085-4a4f-b461-056e2bc4f66d service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:24.284813 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166de5b-8085-4a4f-b461-056e2bc4f66d service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:24.285791 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166de5b-8085-4a4f-b461-056e2bc4f66d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:24.304306 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166de5b-8085-4a4f-b461-056e2bc4f66d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:24.308937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166de5b-8085-4a4f-b461-056e2bc4f66d service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:24.325935 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1148/2306] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:51:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:51:24.334427 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87284b52-92aa-4313-b5c3-cdcbe211123e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:24.335196 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87284b52-92aa-4313-b5c3-cdcbe211123e service nova] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:24.335678 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87284b52-92aa-4313-b5c3-cdcbe211123e service nova] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:24.336334 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87284b52-92aa-4313-b5c3-cdcbe211123e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:24.338999 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-87284b52-92aa-4313-b5c3-cdcbe211123e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:24.352813 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87284b52-92aa-4313-b5c3-cdcbe211123e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:24.354563 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87284b52-92aa-4313-b5c3-cdcbe211123e service nova] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:24.379134 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1159/2307] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:51:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:51:24.861077 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790230e9-43a2-469f-81f7-c9296783d789 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:24.861663 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790230e9-43a2-469f-81f7-c9296783d789 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:24.862474 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790230e9-43a2-469f-81f7-c9296783d789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:24.883769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-790230e9-43a2-469f-81f7-c9296783d789 None None] MFA Rules not processed for user `c9647d15389e49e6b7c43ea1b1538a13`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:51:24.885264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-790230e9-43a2-469f-81f7-c9296783d789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:24.970597 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1149/2308] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Jul 5 20:51:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:51:24.986925 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87284b52-92aa-4313-b5c3-cdcbe211123e service nova] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:24.989308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-87284b52-92aa-4313-b5c3-cdcbe211123e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:25.008723 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790230e9-43a2-469f-81f7-c9296783d789 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:25.010018 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87284b52-92aa-4313-b5c3-cdcbe211123e service nova] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:25.010230 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-790230e9-43a2-469f-81f7-c9296783d789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:25.018696 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2febf46-4485-4957-8560-e789a66e38bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:25.019635 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2febf46-4485-4957-8560-e789a66e38bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:25.019942 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2febf46-4485-4957-8560-e789a66e38bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:25.020906 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2febf46-4485-4957-8560-e789a66e38bb admin admin] PATH_INFO: `/v3/projects/e48aae928cc94329a4f2279671fa3d72` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:25.022623 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2febf46-4485-4957-8560-e789a66e38bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e48aae928cc94329a4f2279671fa3d72)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:25.024617 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:51:25.026963 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2febf46-4485-4957-8560-e789a66e38bb admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:25.111512 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790230e9-43a2-469f-81f7-c9296783d789 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:25.119222 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f8174-7e21-4117-8269-191bc78e0fb8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90aa580a2e10467a93c2d79d1906bd8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:25.120165 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f8174-7e21-4117-8269-191bc78e0fb8 service swift] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:25.120540 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f8174-7e21-4117-8269-191bc78e0fb8 service swift] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:25.120838 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f8174-7e21-4117-8269-191bc78e0fb8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:25.131538 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f8174-7e21-4117-8269-191bc78e0fb8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:25.133200 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f8174-7e21-4117-8269-191bc78e0fb8 service swift] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:25.169279 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1150/2309] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Jul 5 20:51:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 20:51:25.171212 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-f2febf46-4485-4957-8560-e789a66e38bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e48aae928cc94329a4f2279671fa3d72', 'request_id': 'req-f2febf46-4485-4957-8560-e789a66e38bb'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:25.180810 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-f2febf46-4485-4957-8560-e789a66e38bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e48aae928cc94329a4f2279671fa3d72', 'request_id': 'req-f2febf46-4485-4957-8560-e789a66e38bb'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:25.201047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-f2febf46-4485-4957-8560-e789a66e38bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e48aae928cc94329a4f2279671fa3d72', 'request_id': 'req-f2febf46-4485-4957-8560-e789a66e38bb'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:25.216774 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-f2febf46-4485-4957-8560-e789a66e38bb admin admin] The token cache is being invalidate because project e48aae928cc94329a4f2279671fa3d72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:51:25.217193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-f2febf46-4485-4957-8560-e789a66e38bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:25.218234 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-f2febf46-4485-4957-8560-e789a66e38bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:25.220169 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1160/2310] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:51:24 2022] DELETE /identity/v3/projects/e48aae928cc94329a4f2279671fa3d72 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:51:26.030523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe422c-5749-458a-8e97-b5ef651ecfe4 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:26.031045 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe422c-5749-458a-8e97-b5ef651ecfe4 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:26.031186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe422c-5749-458a-8e97-b5ef651ecfe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:26.056215 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-eafe422c-5749-458a-8e97-b5ef651ecfe4 None None] MFA Rules not processed for user `c9647d15389e49e6b7c43ea1b1538a13`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:51:26.059226 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-eafe422c-5749-458a-8e97-b5ef651ecfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:26.133166 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1151/2311] 10.222.0.27 () {58 vars in 967 bytes} [Tue Jul 5 20:51:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:51:26.180214 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2febf46-4485-4957-8560-e789a66e38bb admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:26.181708 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-f2febf46-4485-4957-8560-e789a66e38bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:26.199734 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:51:26.276114 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2febf46-4485-4957-8560-e789a66e38bb admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:26.281164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615f8c7-6465-4cb9-86d6-27f99ebafd32 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90aa580a2e10467a93c2d79d1906bd8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:26.281819 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615f8c7-6465-4cb9-86d6-27f99ebafd32 service swift] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:26.282131 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615f8c7-6465-4cb9-86d6-27f99ebafd32 service swift] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:26.282409 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615f8c7-6465-4cb9-86d6-27f99ebafd32 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:26.301409 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615f8c7-6465-4cb9-86d6-27f99ebafd32 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:26.303467 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615f8c7-6465-4cb9-86d6-27f99ebafd32 service swift] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:26.317963 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1161/2312] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Jul 5 20:51:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 20:51:26.593538 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a71ec-4e96-4f34-b22f-30bead4d3d24 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:26.593757 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a71ec-4e96-4f34-b22f-30bead4d3d24 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:26.594189 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a71ec-4e96-4f34-b22f-30bead4d3d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:26.616132 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-c94a71ec-4e96-4f34-b22f-30bead4d3d24 None None] MFA Rules not processed for user `c9647d15389e49e6b7c43ea1b1538a13`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:51:26.617358 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-c94a71ec-4e96-4f34-b22f-30bead4d3d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:26.633701 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1152/2313] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Jul 5 20:51:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:51:26.647430 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615f8c7-6465-4cb9-86d6-27f99ebafd32 service swift] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:26.666709 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615f8c7-6465-4cb9-86d6-27f99ebafd32 service swift] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:26.677193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d2570-069c-4a90-8a88-4b5cd389b36b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90aa580a2e10467a93c2d79d1906bd8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:26.678164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d2570-069c-4a90-8a88-4b5cd389b36b service swift] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:26.678445 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d2570-069c-4a90-8a88-4b5cd389b36b service swift] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:26.678722 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d2570-069c-4a90-8a88-4b5cd389b36b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:26.699416 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d2570-069c-4a90-8a88-4b5cd389b36b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:26.701270 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d2570-069c-4a90-8a88-4b5cd389b36b service swift] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:26.720901 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1162/2314] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Jul 5 20:51:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 20:51:26.995542 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212347c-5f5b-44fa-8de7-edfaec28774d None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:26.995935 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212347c-5f5b-44fa-8de7-edfaec28774d None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:26.996325 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212347c-5f5b-44fa-8de7-edfaec28774d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:27.028109 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-3212347c-5f5b-44fa-8de7-edfaec28774d None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:51:27.029592 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-3212347c-5f5b-44fa-8de7-edfaec28774d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:27.176092 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1153/2315] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Jul 5 20:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:51:27.205026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d2570-069c-4a90-8a88-4b5cd389b36b service swift] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:27.206780 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-2b0d2570-069c-4a90-8a88-4b5cd389b36b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:27.311144 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4cd9f-9b25-4045-9074-d40b89593f89 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:27.311870 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4cd9f-9b25-4045-9074-d40b89593f89 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:27.312347 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4cd9f-9b25-4045-9074-d40b89593f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:27.341784 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-53c4cd9f-9b25-4045-9074-d40b89593f89 None None] MFA Rules not processed for user `c9647d15389e49e6b7c43ea1b1538a13`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:51:27.344277 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-53c4cd9f-9b25-4045-9074-d40b89593f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:27.354915 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d2570-069c-4a90-8a88-4b5cd389b36b service swift] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:27.366203 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e2258-3027-4349-8142-6400befae365 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:27.366884 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e2258-3027-4349-8142-6400befae365 service nova] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:27.367148 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e2258-3027-4349-8142-6400befae365 service nova] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:27.367426 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e2258-3027-4349-8142-6400befae365 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:27.370968 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1154/2316] 10.222.0.27 () {58 vars in 967 bytes} [Tue Jul 5 20:51:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:51:27.383574 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4cd9f-9b25-4045-9074-d40b89593f89 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:27.387474 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e2258-3027-4349-8142-6400befae365 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:27.390032 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e2258-3027-4349-8142-6400befae365 service nova] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:27.410343 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4cd9f-9b25-4045-9074-d40b89593f89 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:27.419937 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1163/2317] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:51:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:51:27.423699 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7952113-1f01-44aa-98b9-f42a818192f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90aa580a2e10467a93c2d79d1906bd8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:27.424622 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7952113-1f01-44aa-98b9-f42a818192f3 service swift] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:27.425151 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7952113-1f01-44aa-98b9-f42a818192f3 service swift] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:27.425651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7952113-1f01-44aa-98b9-f42a818192f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:27.440278 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7952113-1f01-44aa-98b9-f42a818192f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:27.442272 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7952113-1f01-44aa-98b9-f42a818192f3 service swift] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:27.452719 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1155/2318] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Jul 5 20:51:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 20:51:29.855018 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e2258-3027-4349-8142-6400befae365 service nova] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:29.856622 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-559e2258-3027-4349-8142-6400befae365 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:29.870986 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e2258-3027-4349-8142-6400befae365 service nova] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:29.876585 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae64fb-ae0c-4206-8d22-e9c8166d0ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:29.877638 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae64fb-ae0c-4206-8d22-e9c8166d0ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:29.878031 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae64fb-ae0c-4206-8d22-e9c8166d0ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:29.878401 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae64fb-ae0c-4206-8d22-e9c8166d0ecd admin admin] PATH_INFO: `/v3/users/bbc71729315a4a1b8f913d3d523f6c3c` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:29.879764 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae64fb-ae0c-4206-8d22-e9c8166d0ecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbc71729315a4a1b8f913d3d523f6c3c)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:29.881785 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae64fb-ae0c-4206-8d22-e9c8166d0ecd admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:29.937063 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-31ae64fb-ae0c-4206-8d22-e9c8166d0ecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbc71729315a4a1b8f913d3d523f6c3c'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:29.949741 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-31ae64fb-ae0c-4206-8d22-e9c8166d0ecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbc71729315a4a1b8f913d3d523f6c3c'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:29.951874 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:51:29.958431 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-31ae64fb-ae0c-4206-8d22-e9c8166d0ecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbc71729315a4a1b8f913d3d523f6c3c'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:29.959313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-31ae64fb-ae0c-4206-8d22-e9c8166d0ecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbc71729315a4a1b8f913d3d523f6c3c'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:29.959904 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-31ae64fb-ae0c-4206-8d22-e9c8166d0ecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbc71729315a4a1b8f913d3d523f6c3c'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:29.981282 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1164/2319] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:51:29 2022] DELETE /identity/v3/users/bbc71729315a4a1b8f913d3d523f6c3c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:51:29.986428 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4863d-ac2a-493c-b975-784fbbc4c2b1 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:29.987363 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4863d-ac2a-493c-b975-784fbbc4c2b1 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:29.987363 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4863d-ac2a-493c-b975-784fbbc4c2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:30.017058 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-00f4863d-ac2a-493c-b975-784fbbc4c2b1 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:51:30.019981 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-00f4863d-ac2a-493c-b975-784fbbc4c2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:30.033421 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:51:30.110839 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1156/2320] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:51:30.125375 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae64fb-ae0c-4206-8d22-e9c8166d0ecd admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:30.126833 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-31ae64fb-ae0c-4206-8d22-e9c8166d0ecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:30.152355 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24350b5a-77d4-49aa-a69b-a2d11efaf472 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:30.152551 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24350b5a-77d4-49aa-a69b-a2d11efaf472 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:30.153294 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24350b5a-77d4-49aa-a69b-a2d11efaf472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:30.187707 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-24350b5a-77d4-49aa-a69b-a2d11efaf472 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:51:30.188951 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-24350b5a-77d4-49aa-a69b-a2d11efaf472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:30.202423 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1157/2321] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Jul 5 20:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:51:30.206314 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae64fb-ae0c-4206-8d22-e9c8166d0ecd admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:30.211927 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db71ae-3e36-4ff9-94f3-084e8489c404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:30.212729 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db71ae-3e36-4ff9-94f3-084e8489c404 service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:30.213129 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db71ae-3e36-4ff9-94f3-084e8489c404 service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:30.213411 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db71ae-3e36-4ff9-94f3-084e8489c404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:30.225091 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db71ae-3e36-4ff9-94f3-084e8489c404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:30.229982 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db71ae-3e36-4ff9-94f3-084e8489c404 service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:30.236104 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24350b5a-77d4-49aa-a69b-a2d11efaf472 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:30.237737 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-24350b5a-77d4-49aa-a69b-a2d11efaf472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:30.244266 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1165/2322] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:51:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:51:30.330864 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24350b5a-77d4-49aa-a69b-a2d11efaf472 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:30.336497 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0602d-edd6-4ebe-8fa3-a284bd817608 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:30.337153 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0602d-edd6-4ebe-8fa3-a284bd817608 service nova] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:30.337430 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0602d-edd6-4ebe-8fa3-a284bd817608 service nova] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:30.337700 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0602d-edd6-4ebe-8fa3-a284bd817608 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:30.351293 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0602d-edd6-4ebe-8fa3-a284bd817608 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:30.353151 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0602d-edd6-4ebe-8fa3-a284bd817608 service nova] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:30.365030 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1158/2323] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:51:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:51:30.471888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db71ae-3e36-4ff9-94f3-084e8489c404 service neutron] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:30.473417 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-12db71ae-3e36-4ff9-94f3-084e8489c404 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:30.493995 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db71ae-3e36-4ff9-94f3-084e8489c404 service neutron] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:30.509271 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4e92c-4ce5-49b8-a631-ce91a77d7a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:30.511683 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4e92c-4ce5-49b8-a631-ce91a77d7a42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:30.512875 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4e92c-4ce5-49b8-a631-ce91a77d7a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:30.513373 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4e92c-4ce5-49b8-a631-ce91a77d7a42 admin admin] PATH_INFO: `/v3/projects/e8800acebb704cff81f0ea665888d859` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:30.517627 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b4e92c-4ce5-49b8-a631-ce91a77d7a42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8800acebb704cff81f0ea665888d859)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:30.528246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b4e92c-4ce5-49b8-a631-ce91a77d7a42 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:30.620334 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-d7b4e92c-4ce5-49b8-a631-ce91a77d7a42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8800acebb704cff81f0ea665888d859', 'request_id': 'req-d7b4e92c-4ce5-49b8-a631-ce91a77d7a42'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:30.627103 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-d7b4e92c-4ce5-49b8-a631-ce91a77d7a42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8800acebb704cff81f0ea665888d859', 'request_id': 'req-d7b4e92c-4ce5-49b8-a631-ce91a77d7a42'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:30.636408 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-d7b4e92c-4ce5-49b8-a631-ce91a77d7a42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8800acebb704cff81f0ea665888d859', 'request_id': 'req-d7b4e92c-4ce5-49b8-a631-ce91a77d7a42'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:30.649666 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-d7b4e92c-4ce5-49b8-a631-ce91a77d7a42 admin admin] The token cache is being invalidate because project e8800acebb704cff81f0ea665888d859 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:51:30.649988 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-d7b4e92c-4ce5-49b8-a631-ce91a77d7a42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:30.650985 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-d7b4e92c-4ce5-49b8-a631-ce91a77d7a42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:51:30.653095 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1166/2324] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:51:30 2022] DELETE /identity/v3/projects/e8800acebb704cff81f0ea665888d859 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:51:30.658152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a41b11-c4cf-448c-b392-2c9703a8eed3 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:30.658671 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a41b11-c4cf-448c-b392-2c9703a8eed3 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:30.658965 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a41b11-c4cf-448c-b392-2c9703a8eed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:30.678538 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-49a41b11-c4cf-448c-b392-2c9703a8eed3 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:51:30.679775 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-49a41b11-c4cf-448c-b392-2c9703a8eed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:30.749100 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1159/2325] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:51:30.756597 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9380b-386f-4942-8ee2-09be852a7a82 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:30.756882 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9380b-386f-4942-8ee2-09be852a7a82 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:30.757160 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9380b-386f-4942-8ee2-09be852a7a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:30.777819 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-3dd9380b-386f-4942-8ee2-09be852a7a82 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:51:30.779085 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-3dd9380b-386f-4942-8ee2-09be852a7a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:30.790948 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1167/2326] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:51:30.791918 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a41b11-c4cf-448c-b392-2c9703a8eed3 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:30.802511 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a41b11-c4cf-448c-b392-2c9703a8eed3 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:30.808184 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc0bd9-599d-4426-bbc0-4907ab6aaaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:30.808954 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc0bd9-599d-4426-bbc0-4907ab6aaaa7 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:30.809462 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc0bd9-599d-4426-bbc0-4907ab6aaaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:30.809673 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fc0bd9-599d-4426-bbc0-4907ab6aaaa7 admin admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:30.810547 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fc0bd9-599d-4426-bbc0-4907ab6aaaa7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:51:30.810973 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fc0bd9-599d-4426-bbc0-4907ab6aaaa7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:30.812711 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fc0bd9-599d-4426-bbc0-4907ab6aaaa7 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:30.825572 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1160/2327] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:51:30.830091 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9380b-386f-4942-8ee2-09be852a7a82 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:30.839857 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9380b-386f-4942-8ee2-09be852a7a82 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:30.844524 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3a3f9-d5c7-4861-94a9-a4dc65dbe25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:30.845394 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3a3f9-d5c7-4861-94a9-a4dc65dbe25e admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:30.845515 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3a3f9-d5c7-4861-94a9-a4dc65dbe25e admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:30.845865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3a3f9-d5c7-4861-94a9-a4dc65dbe25e admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:30.846504 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f3a3f9-d5c7-4861-94a9-a4dc65dbe25e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:30.848471 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f3a3f9-d5c7-4861-94a9-a4dc65dbe25e admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:30.882797 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc0bd9-599d-4426-bbc0-4907ab6aaaa7 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:30.884973 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1168/2328] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:51:30 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:51:30.895294 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fc0bd9-599d-4426-bbc0-4907ab6aaaa7 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:30.918998 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:51:30.966559 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01062a85-5941-433a-9939-3cb2441a8f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:30.967372 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01062a85-5941-433a-9939-3cb2441a8f02 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:30.967786 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01062a85-5941-433a-9939-3cb2441a8f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:30.968064 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01062a85-5941-433a-9939-3cb2441a8f02 admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:30.968890 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01062a85-5941-433a-9939-3cb2441a8f02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:30.972059 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01062a85-5941-433a-9939-3cb2441a8f02 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:30.995680 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1161/2329] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:51:30 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:51:30.999783 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3a3f9-d5c7-4861-94a9-a4dc65dbe25e admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:31.011568 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3a3f9-d5c7-4861-94a9-a4dc65dbe25e admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:31.016731 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8565ab1-68ae-4573-a59e-567983c3a626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:31.017431 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8565ab1-68ae-4573-a59e-567983c3a626 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:31.017711 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8565ab1-68ae-4573-a59e-567983c3a626 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:31.018085 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8565ab1-68ae-4573-a59e-567983c3a626 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:31.018816 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8565ab1-68ae-4573-a59e-567983c3a626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:31.020621 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8565ab1-68ae-4573-a59e-567983c3a626 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:31.040149 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1169/2330] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:51:31.041736 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01062a85-5941-433a-9939-3cb2441a8f02 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:31.057969 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01062a85-5941-433a-9939-3cb2441a8f02 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:31.068434 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc3097-25e5-43c0-b3a7-98b3c942fb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:31.069907 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc3097-25e5-43c0-b3a7-98b3c942fb59 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:31.070800 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc3097-25e5-43c0-b3a7-98b3c942fb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:31.071367 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc3097-25e5-43c0-b3a7-98b3c942fb59 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:31.072764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc3097-25e5-43c0-b3a7-98b3c942fb59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:31.074988 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc3097-25e5-43c0-b3a7-98b3c942fb59 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:31.089588 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1162/2331] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:51:31.090856 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8565ab1-68ae-4573-a59e-567983c3a626 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:31.102474 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8565ab1-68ae-4573-a59e-567983c3a626 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:31.107616 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70941dd8-9937-4297-94ad-5297daa45f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:31.108533 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70941dd8-9937-4297-94ad-5297daa45f63 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:31.108814 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70941dd8-9937-4297-94ad-5297daa45f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:31.109093 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70941dd8-9937-4297-94ad-5297daa45f63 admin admin] PATH_INFO: `/v3/projects/b00e5f5f4cee424ba278dbde85c96625/users/6a0aa7299eb64cb4b9211ce197c6ab4c/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:31.127657 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70941dd8-9937-4297-94ad-5297daa45f63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b00e5f5f4cee424ba278dbde85c96625, user_id=6a0aa7299eb64cb4b9211ce197c6ab4c, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:31.130409 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70941dd8-9937-4297-94ad-5297daa45f63 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:31.153081 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1170/2332] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:51:31 2022] PUT /identity/v3/projects/b00e5f5f4cee424ba278dbde85c96625/users/6a0aa7299eb64cb4b9211ce197c6ab4c/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:51:31.156422 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246924c-b33d-44d0-b2bb-99470e35080b None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:31.157407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246924c-b33d-44d0-b2bb-99470e35080b None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:31.157963 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246924c-b33d-44d0-b2bb-99470e35080b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:31.181036 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-8246924c-b33d-44d0-b2bb-99470e35080b None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:51:31.182453 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-8246924c-b33d-44d0-b2bb-99470e35080b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:31.258662 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1163/2333] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:51:31.268566 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70941dd8-9937-4297-94ad-5297daa45f63 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:31.270313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-70941dd8-9937-4297-94ad-5297daa45f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:31.285409 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:51:31.344335 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70941dd8-9937-4297-94ad-5297daa45f63 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:31.348103 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58d71a-4d6d-49c6-8ba9-43a7a080b7fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:31.348839 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58d71a-4d6d-49c6-8ba9-43a7a080b7fd service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:31.349191 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58d71a-4d6d-49c6-8ba9-43a7a080b7fd service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:31.349469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58d71a-4d6d-49c6-8ba9-43a7a080b7fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:31.362617 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58d71a-4d6d-49c6-8ba9-43a7a080b7fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:31.364148 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58d71a-4d6d-49c6-8ba9-43a7a080b7fd service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:31.374580 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1171/2334] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:51:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:51:33.417714 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cc78b-4d9a-4902-b79d-6005a0188e47 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:33.418355 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cc78b-4d9a-4902-b79d-6005a0188e47 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:33.418355 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cc78b-4d9a-4902-b79d-6005a0188e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:33.439784 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-585cc78b-4d9a-4902-b79d-6005a0188e47 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:51:33.441196 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-585cc78b-4d9a-4902-b79d-6005a0188e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:33.450590 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1164/2335] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Jul 5 20:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:51:33.482440 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58d71a-4d6d-49c6-8ba9-43a7a080b7fd service neutron] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:33.483982 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-2d58d71a-4d6d-49c6-8ba9-43a7a080b7fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:33.564742 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58d71a-4d6d-49c6-8ba9-43a7a080b7fd service neutron] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:33.570582 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84cd6a1-c8c1-498d-9be1-863a71e42be1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:33.571245 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cd6a1-c8c1-498d-9be1-863a71e42be1 service nova] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:33.571520 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cd6a1-c8c1-498d-9be1-863a71e42be1 service nova] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:33.571797 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cd6a1-c8c1-498d-9be1-863a71e42be1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:33.580655 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84cd6a1-c8c1-498d-9be1-863a71e42be1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:33.582468 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84cd6a1-c8c1-498d-9be1-863a71e42be1 service nova] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:33.594157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1172/2336] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:51:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:51:36.365287 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7407c1-4b52-45ae-a874-4bfdf404f917 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:36.365813 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7407c1-4b52-45ae-a874-4bfdf404f917 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:36.365813 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7407c1-4b52-45ae-a874-4bfdf404f917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:36.401200 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-5c7407c1-4b52-45ae-a874-4bfdf404f917 None None] MFA Rules not processed for user `6a0aa7299eb64cb4b9211ce197c6ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:51:36.402647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-5c7407c1-4b52-45ae-a874-4bfdf404f917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:36.472996 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1165/2337] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:51:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:51:36.477510 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84cd6a1-c8c1-498d-9be1-863a71e42be1 service nova] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:36.491874 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84cd6a1-c8c1-498d-9be1-863a71e42be1 service nova] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:36.499618 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3263109-917c-4b70-b4ce-648c70bbb1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:36.500299 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3263109-917c-4b70-b4ce-648c70bbb1e4 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:36.500576 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3263109-917c-4b70-b4ce-648c70bbb1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:36.500848 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3263109-917c-4b70-b4ce-648c70bbb1e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:36.501562 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3263109-917c-4b70-b4ce-648c70bbb1e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:36.508519 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3263109-917c-4b70-b4ce-648c70bbb1e4 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:36.544931 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1173/2338] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:51:36 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:51:36.546315 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7407c1-4b52-45ae-a874-4bfdf404f917 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:36.557320 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7407c1-4b52-45ae-a874-4bfdf404f917 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:36.577287 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:51:36.614503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970f1eb-1641-436a-8a00-9699978ad115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:36.615281 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970f1eb-1641-436a-8a00-9699978ad115 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:36.615625 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970f1eb-1641-436a-8a00-9699978ad115 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:36.615965 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970f1eb-1641-436a-8a00-9699978ad115 admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:36.616718 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970f1eb-1641-436a-8a00-9699978ad115 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:36.618955 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970f1eb-1641-436a-8a00-9699978ad115 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:36.641169 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1166/2339] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:51:36 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:51:36.645335 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3263109-917c-4b70-b4ce-648c70bbb1e4 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:36.655851 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3263109-917c-4b70-b4ce-648c70bbb1e4 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:36.660438 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3751e15-707a-4a11-88ac-62ffd1785e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:36.661091 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3751e15-707a-4a11-88ac-62ffd1785e75 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:36.661370 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3751e15-707a-4a11-88ac-62ffd1785e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:36.662604 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3751e15-707a-4a11-88ac-62ffd1785e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:36.662739 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3751e15-707a-4a11-88ac-62ffd1785e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:36.664603 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3751e15-707a-4a11-88ac-62ffd1785e75 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:36.679574 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1174/2340] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:51:36.680803 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970f1eb-1641-436a-8a00-9699978ad115 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:36.691281 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970f1eb-1641-436a-8a00-9699978ad115 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:36.695840 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70be8fa-b07a-422f-8849-5a206953ee5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:36.696732 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70be8fa-b07a-422f-8849-5a206953ee5e admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:36.697061 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70be8fa-b07a-422f-8849-5a206953ee5e admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:36.697351 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70be8fa-b07a-422f-8849-5a206953ee5e admin admin] PATH_INFO: `/v3/projects/efbc1e9aa66245e59f1c5a0b7aae04ce/users/b9eff5fa55e3489aa5f972682390d963/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:36.712562 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70be8fa-b07a-422f-8849-5a206953ee5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=efbc1e9aa66245e59f1c5a0b7aae04ce, user_id=b9eff5fa55e3489aa5f972682390d963, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:36.715452 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70be8fa-b07a-422f-8849-5a206953ee5e admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:36.731793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1167/2341] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:51:36 2022] PUT /identity/v3/projects/efbc1e9aa66245e59f1c5a0b7aae04ce/users/b9eff5fa55e3489aa5f972682390d963/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:51:36.735941 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3751e15-707a-4a11-88ac-62ffd1785e75 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:36.750195 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3751e15-707a-4a11-88ac-62ffd1785e75 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:36.807598 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f38bc-08a6-4ecd-b3ef-e93871221e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:36.808264 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f38bc-08a6-4ecd-b3ef-e93871221e8d admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:36.808544 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f38bc-08a6-4ecd-b3ef-e93871221e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:36.808815 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f38bc-08a6-4ecd-b3ef-e93871221e8d admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:36.809531 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f38bc-08a6-4ecd-b3ef-e93871221e8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:36.811175 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f38bc-08a6-4ecd-b3ef-e93871221e8d admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:36.813272 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:51:36.822308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1175/2342] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:51:36.826477 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70be8fa-b07a-422f-8849-5a206953ee5e admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:36.836771 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70be8fa-b07a-422f-8849-5a206953ee5e admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:36.841667 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed9a56-25cf-4c53-94a6-aa2310b44983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:36.842585 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed9a56-25cf-4c53-94a6-aa2310b44983 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:36.842850 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed9a56-25cf-4c53-94a6-aa2310b44983 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:36.843137 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed9a56-25cf-4c53-94a6-aa2310b44983 admin admin] PATH_INFO: `/v3/projects/efbc1e9aa66245e59f1c5a0b7aae04ce/users/b9eff5fa55e3489aa5f972682390d963/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:36.845108 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed9a56-25cf-4c53-94a6-aa2310b44983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efbc1e9aa66245e59f1c5a0b7aae04ce, user_id=b9eff5fa55e3489aa5f972682390d963, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:36.847798 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed9a56-25cf-4c53-94a6-aa2310b44983 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:36.859460 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1168/2343] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:51:36 2022] PUT /identity/v3/projects/efbc1e9aa66245e59f1c5a0b7aae04ce/users/b9eff5fa55e3489aa5f972682390d963/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:51:40.555297 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025b44e-9bba-4aad-96bd-7b4b48411613 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:40.557062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025b44e-9bba-4aad-96bd-7b4b48411613 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:40.558467 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025b44e-9bba-4aad-96bd-7b4b48411613 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:40.560475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1176/2344] 10.222.0.27 () {54 vars in 921 bytes} [Tue Jul 5 20:51:40 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:51:40.566451 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f9080-929b-4a67-ac55-f21be56fb1df None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:40.567507 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f9080-929b-4a67-ac55-f21be56fb1df None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:40.567928 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f9080-929b-4a67-ac55-f21be56fb1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:40.651879 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-6d6f9080-929b-4a67-ac55-f21be56fb1df None None] MFA Rules not processed for user `814b675b98b844a2a12a39890ee69d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:51:40.664319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-6d6f9080-929b-4a67-ac55-f21be56fb1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:40.785023 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1169/2345] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Jul 5 20:51:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:51:40.794709 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025b44e-9bba-4aad-96bd-7b4b48411613 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:40.796864 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-a025b44e-9bba-4aad-96bd-7b4b48411613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:40.874707 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025b44e-9bba-4aad-96bd-7b4b48411613 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:40.880831 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09559075-86bc-4f70-993a-d6be5ffc5367 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05f331339d143c09eaa12efe2b80653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:40.881711 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09559075-86bc-4f70-993a-d6be5ffc5367 service glance] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:40.882022 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09559075-86bc-4f70-993a-d6be5ffc5367 service glance] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:40.882294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09559075-86bc-4f70-993a-d6be5ffc5367 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:40.897431 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09559075-86bc-4f70-993a-d6be5ffc5367 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:40.899274 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09559075-86bc-4f70-993a-d6be5ffc5367 service glance] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:40.914247 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1177/2346] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:51:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:51:41.049806 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3dfbf-1c9c-48fa-a6ce-bf2ecd3bb238 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:41.050662 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3dfbf-1c9c-48fa-a6ce-bf2ecd3bb238 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:41.051127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3dfbf-1c9c-48fa-a6ce-bf2ecd3bb238 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:41.054529 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1170/2347] 10.222.0.27 () {54 vars in 921 bytes} [Tue Jul 5 20:51:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:51:41.067452 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039699c7-591e-4e59-9543-3bd877690faf None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:41.067743 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039699c7-591e-4e59-9543-3bd877690faf None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:41.068018 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039699c7-591e-4e59-9543-3bd877690faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:41.106660 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-039699c7-591e-4e59-9543-3bd877690faf None None] MFA Rules not processed for user `157a258bcff642cb91a0a474f8f50941`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:51:41.108252 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-039699c7-591e-4e59-9543-3bd877690faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:41.223112 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1178/2348] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Jul 5 20:51:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:51:41.237379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3dfbf-1c9c-48fa-a6ce-bf2ecd3bb238 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:41.249155 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3dfbf-1c9c-48fa-a6ce-bf2ecd3bb238 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:41.254750 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba408b22-af02-460c-bf6b-036bb9db7000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:41.255882 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba408b22-af02-460c-bf6b-036bb9db7000 service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:41.256229 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba408b22-af02-460c-bf6b-036bb9db7000 service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:41.256570 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba408b22-af02-460c-bf6b-036bb9db7000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:41.271640 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba408b22-af02-460c-bf6b-036bb9db7000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:41.274511 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba408b22-af02-460c-bf6b-036bb9db7000 service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:41.288509 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1171/2349] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:51:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:51:41.383410 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a42012-210a-40b8-80f3-543b14423858 None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:41.384919 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a42012-210a-40b8-80f3-543b14423858 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:41.385422 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a42012-210a-40b8-80f3-543b14423858 None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:41.387765 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1179/2350] 10.222.0.27 () {54 vars in 921 bytes} [Tue Jul 5 20:51:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:51:41.394343 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56390b-dd2e-46df-8a0b-3d0385024e51 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:41.394704 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56390b-dd2e-46df-8a0b-3d0385024e51 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:41.394894 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56390b-dd2e-46df-8a0b-3d0385024e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:41.421190 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-af56390b-dd2e-46df-8a0b-3d0385024e51 None None] MFA Rules not processed for user `814b675b98b844a2a12a39890ee69d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:51:41.422631 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-af56390b-dd2e-46df-8a0b-3d0385024e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:41.440428 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1172/2351] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Jul 5 20:51:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:51:41.450958 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a42012-210a-40b8-80f3-543b14423858 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:41.463086 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a42012-210a-40b8-80f3-543b14423858 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:41.469000 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4bd74-520f-4787-88ab-08ccf7db2223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:41.470476 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4bd74-520f-4787-88ab-08ccf7db2223 service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:41.470635 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4bd74-520f-4787-88ab-08ccf7db2223 service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:41.471109 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4bd74-520f-4787-88ab-08ccf7db2223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:41.482429 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e4bd74-520f-4787-88ab-08ccf7db2223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:41.484194 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e4bd74-520f-4787-88ab-08ccf7db2223 service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:41.497693 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1180/2352] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:51:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:51:42.236336 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d81b13-0e4e-4909-b015-53e7c2d34c53 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:42.236808 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d81b13-0e4e-4909-b015-53e7c2d34c53 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:42.236904 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d81b13-0e4e-4909-b015-53e7c2d34c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:42.277383 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-34d81b13-0e4e-4909-b015-53e7c2d34c53 None None] MFA Rules not processed for user `b9eff5fa55e3489aa5f972682390d963`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:51:42.279038 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-34d81b13-0e4e-4909-b015-53e7c2d34c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:42.311284 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:51:42.361010 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1173/2353] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:51:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:51:42.373083 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4bd74-520f-4787-88ab-08ccf7db2223 service neutron] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:42.382807 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4bd74-520f-4787-88ab-08ccf7db2223 service neutron] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:42.386583 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c5aa9-153b-498a-9236-44f8e54eaed0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05f331339d143c09eaa12efe2b80653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:42.387521 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c5aa9-153b-498a-9236-44f8e54eaed0 service glance] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:42.387860 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c5aa9-153b-498a-9236-44f8e54eaed0 service glance] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:42.388196 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c5aa9-153b-498a-9236-44f8e54eaed0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:42.447164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c5aa9-153b-498a-9236-44f8e54eaed0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:42.448615 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c5aa9-153b-498a-9236-44f8e54eaed0 service glance] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:42.459951 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1181/2354] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:51:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:51:42.571810 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30101a3f-f0d0-486c-9510-116fba3e81ae None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:42.572278 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30101a3f-f0d0-486c-9510-116fba3e81ae None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:42.572763 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30101a3f-f0d0-486c-9510-116fba3e81ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:42.596237 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-30101a3f-f0d0-486c-9510-116fba3e81ae None None] MFA Rules not processed for user `c9647d15389e49e6b7c43ea1b1538a13`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:51:42.597480 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-30101a3f-f0d0-486c-9510-116fba3e81ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:42.684687 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1174/2355] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Jul 5 20:51:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:51:42.716238 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c5aa9-153b-498a-9236-44f8e54eaed0 service glance] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:42.718007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-f57c5aa9-153b-498a-9236-44f8e54eaed0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:42.760043 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:51:42.791685 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c5aa9-153b-498a-9236-44f8e54eaed0 service glance] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:42.796948 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9dab93-687e-4f33-8d9d-df70235fca3d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90aa580a2e10467a93c2d79d1906bd8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:42.797609 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dab93-687e-4f33-8d9d-df70235fca3d service swift] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:42.797922 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dab93-687e-4f33-8d9d-df70235fca3d service swift] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:42.798202 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9dab93-687e-4f33-8d9d-df70235fca3d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:42.807367 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9dab93-687e-4f33-8d9d-df70235fca3d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:42.808977 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9dab93-687e-4f33-8d9d-df70235fca3d service swift] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:42.817485 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1182/2356] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Jul 5 20:51:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 20:51:47.648657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30101a3f-f0d0-486c-9510-116fba3e81ae None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:47.650851 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-30101a3f-f0d0-486c-9510-116fba3e81ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:47.788817 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30101a3f-f0d0-486c-9510-116fba3e81ae None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:47.795331 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a15c1-863b-41fd-b287-b385ad9c21cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16662dd5e2e74163b6aa2e1e7ef07524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:47.796002 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a15c1-863b-41fd-b287-b385ad9c21cd service placement] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:47.796280 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a15c1-863b-41fd-b287-b385ad9c21cd service placement] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:47.796557 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a15c1-863b-41fd-b287-b385ad9c21cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:47.798538 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-fe1a15c1-863b-41fd-b287-b385ad9c21cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:47.813012 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a15c1-863b-41fd-b287-b385ad9c21cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:47.814715 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a15c1-863b-41fd-b287-b385ad9c21cd service placement] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:47.826428 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1175/2357] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:51:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:51:48.943371 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fad517-95b9-4809-b66d-2135dd1825ea None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:48.943907 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fad517-95b9-4809-b66d-2135dd1825ea None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:48.944060 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fad517-95b9-4809-b66d-2135dd1825ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:48.998895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-f5fad517-95b9-4809-b66d-2135dd1825ea None None] MFA Rules not processed for user `c9647d15389e49e6b7c43ea1b1538a13`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:51:49.000144 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-f5fad517-95b9-4809-b66d-2135dd1825ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:49.020588 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1183/2358] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Jul 5 20:51:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:51:49.033834 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a15c1-863b-41fd-b287-b385ad9c21cd service placement] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:51:49.057770 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a15c1-863b-41fd-b287-b385ad9c21cd service placement] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:51:49.063806 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6e01d-0d80-45d3-bd49-40bf66889965 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90aa580a2e10467a93c2d79d1906bd8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:51:49.064482 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6e01d-0d80-45d3-bd49-40bf66889965 service swift] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:49.064765 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6e01d-0d80-45d3-bd49-40bf66889965 service swift] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:49.065043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6e01d-0d80-45d3-bd49-40bf66889965 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:49.074606 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c6e01d-0d80-45d3-bd49-40bf66889965 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:51:49.076268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c6e01d-0d80-45d3-bd49-40bf66889965 service swift] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:51:49.108722 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1176/2359] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Jul 5 20:51:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 20:51:53.174896 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825d668-eb36-4e76-9179-22e9bdb8c09e None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:53.175924 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825d668-eb36-4e76-9179-22e9bdb8c09e None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:53.176422 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825d668-eb36-4e76-9179-22e9bdb8c09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:53.206556 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-3825d668-eb36-4e76-9179-22e9bdb8c09e None None] MFA Rules not processed for user `148f32f6cd4e4af89681bcd5f4ba87b7`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:51:53.208022 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-3825d668-eb36-4e76-9179-22e9bdb8c09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:53.334313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1184/2360] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:51:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:51:53.811854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a254f2-1783-4975-b806-9c68acdc4458 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:51:53.812467 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a254f2-1783-4975-b806-9c68acdc4458 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:51:53.812467 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a254f2-1783-4975-b806-9c68acdc4458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:51:53.830025 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-c0a254f2-1783-4975-b806-9c68acdc4458 None None] MFA Rules not processed for user `6a0aa7299eb64cb4b9211ce197c6ab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:51:53.831278 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-c0a254f2-1783-4975-b806-9c68acdc4458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:51:53.838617 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1177/2361] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:51:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:52:01.717777 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f9a3a-dd8c-448c-ab57-06eb0354d0ff None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:01.718377 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f9a3a-dd8c-448c-ab57-06eb0354d0ff None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:01.718499 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f9a3a-dd8c-448c-ab57-06eb0354d0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:01.746764 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-5b5f9a3a-dd8c-448c-ab57-06eb0354d0ff None None] MFA Rules not processed for user `c9647d15389e49e6b7c43ea1b1538a13`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:52:01.748262 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-5b5f9a3a-dd8c-448c-ab57-06eb0354d0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:52:01.756049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1185/2362] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Jul 5 20:52:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:52:01.768145 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a254f2-1783-4975-b806-9c68acdc4458 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:52:01.780368 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a254f2-1783-4975-b806-9c68acdc4458 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:52:01.791470 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24502af0-6347-4e3a-b815-47276ec74dd2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90aa580a2e10467a93c2d79d1906bd8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:52:01.792573 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24502af0-6347-4e3a-b815-47276ec74dd2 service swift] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:01.792862 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24502af0-6347-4e3a-b815-47276ec74dd2 service swift] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:01.793143 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24502af0-6347-4e3a-b815-47276ec74dd2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:01.800770 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:52:01.805969 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24502af0-6347-4e3a-b815-47276ec74dd2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:52:01.807719 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24502af0-6347-4e3a-b815-47276ec74dd2 service swift] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:52:01.817477 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1178/2363] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Jul 5 20:52:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 05 20:52:11.740157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=62 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:52:11.814011 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:52:12.956981 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb48b35-e378-43dd-821b-90224bf03a6d None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:12.957501 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb48b35-e378-43dd-821b-90224bf03a6d None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:12.957604 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb48b35-e378-43dd-821b-90224bf03a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:12.978314 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-7bb48b35-e378-43dd-821b-90224bf03a6d None None] MFA Rules not processed for user `c9647d15389e49e6b7c43ea1b1538a13`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:52:12.979741 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-7bb48b35-e378-43dd-821b-90224bf03a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:52:12.988958 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1186/2364] 10.222.0.27 () {58 vars in 967 bytes} [Tue Jul 5 20:52:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:52:13.005752 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24502af0-6347-4e3a-b815-47276ec74dd2 service swift] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:52:13.018453 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24502af0-6347-4e3a-b815-47276ec74dd2 service swift] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:52:13.023983 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb70b7-1562-45fb-b5bb-302c3fb8c78a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90aa580a2e10467a93c2d79d1906bd8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:52:13.024923 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb70b7-1562-45fb-b5bb-302c3fb8c78a service swift] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:13.025400 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb70b7-1562-45fb-b5bb-302c3fb8c78a service swift] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:13.026060 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb70b7-1562-45fb-b5bb-302c3fb8c78a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:13.035060 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb70b7-1562-45fb-b5bb-302c3fb8c78a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:52:13.037347 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb70b7-1562-45fb-b5bb-302c3fb8c78a service swift] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:52:13.045741 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1179/2365] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Jul 5 20:52:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 20:52:22.972035 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=3 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:52:23.042719 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=6 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:52:30.330149 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981bf301-605b-47bd-94ac-de0c58613d4d None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:30.330619 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981bf301-605b-47bd-94ac-de0c58613d4d None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:30.330730 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981bf301-605b-47bd-94ac-de0c58613d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:30.349404 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-981bf301-605b-47bd-94ac-de0c58613d4d None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:52:30.350654 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-981bf301-605b-47bd-94ac-de0c58613d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:52:30.355592 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb70b7-1562-45fb-b5bb-302c3fb8c78a service swift] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:52:30.357189 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-ecfb70b7-1562-45fb-b5bb-302c3fb8c78a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:52:30.370159 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb70b7-1562-45fb-b5bb-302c3fb8c78a service swift] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:52:30.374425 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2c577-01f3-4357-bbb6-d85ddfcb480a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:52:30.375184 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2c577-01f3-4357-bbb6-d85ddfcb480a service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:30.375725 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2c577-01f3-4357-bbb6-d85ddfcb480a service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:30.376264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2c577-01f3-4357-bbb6-d85ddfcb480a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:30.387625 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2c577-01f3-4357-bbb6-d85ddfcb480a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:52:30.389196 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2c577-01f3-4357-bbb6-d85ddfcb480a service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:52:30.399737 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1180/2366] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:52:30 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:52:30.422992 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1187/2367] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Jul 5 20:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:52:30.450319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2c577-01f3-4357-bbb6-d85ddfcb480a service neutron] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:52:30.468599 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2c577-01f3-4357-bbb6-d85ddfcb480a service neutron] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:52:30.476504 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb6495-0bce-494e-9303-d853c97fb113 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:52:30.477202 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb6495-0bce-494e-9303-d853c97fb113 service nova] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:30.477481 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb6495-0bce-494e-9303-d853c97fb113 service nova] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:30.477785 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb6495-0bce-494e-9303-d853c97fb113 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:30.489966 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb6495-0bce-494e-9303-d853c97fb113 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:52:30.494148 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb6495-0bce-494e-9303-d853c97fb113 service nova] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:52:30.520605 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1181/2368] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:52:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:52:34.726581 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cef5ea-9a38-4c82-a7be-c7cb88a3d2d2 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:34.727151 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cef5ea-9a38-4c82-a7be-c7cb88a3d2d2 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:34.727151 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cef5ea-9a38-4c82-a7be-c7cb88a3d2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:34.751125 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-b2cef5ea-9a38-4c82-a7be-c7cb88a3d2d2 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:52:34.752488 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-b2cef5ea-9a38-4c82-a7be-c7cb88a3d2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:52:34.762224 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1188/2369] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Jul 5 20:52:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:52:34.788223 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb6495-0bce-494e-9303-d853c97fb113 service nova] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:52:34.800704 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb6495-0bce-494e-9303-d853c97fb113 service nova] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:52:34.807745 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedfd164-1faf-4bc7-9fe7-a0603b350011 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:52:34.808591 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfd164-1faf-4bc7-9fe7-a0603b350011 service nova] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:34.808940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfd164-1faf-4bc7-9fe7-a0603b350011 service nova] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:34.809426 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfd164-1faf-4bc7-9fe7-a0603b350011 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:34.819978 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedfd164-1faf-4bc7-9fe7-a0603b350011 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:52:34.821920 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedfd164-1faf-4bc7-9fe7-a0603b350011 service nova] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:52:34.833565 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1182/2370] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:52:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:52:35.319948 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49209d-e889-4ee7-bceb-eb29777bc021 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:35.320243 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49209d-e889-4ee7-bceb-eb29777bc021 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:35.320516 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49209d-e889-4ee7-bceb-eb29777bc021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:35.339320 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-aa49209d-e889-4ee7-bceb-eb29777bc021 None None] MFA Rules not processed for user `bc1c30d3677845c5b9185f4a4ad5ea03`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:52:35.340515 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-aa49209d-e889-4ee7-bceb-eb29777bc021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:52:35.396833 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1189/2371] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:52:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:52:38.819592 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7aa04f-3317-4aa5-a0ae-94c4ca20a37c None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:38.820482 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7aa04f-3317-4aa5-a0ae-94c4ca20a37c None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:38.820482 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7aa04f-3317-4aa5-a0ae-94c4ca20a37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:38.848479 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-4e7aa04f-3317-4aa5-a0ae-94c4ca20a37c None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:52:38.849703 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-4e7aa04f-3317-4aa5-a0ae-94c4ca20a37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:52:38.859116 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1183/2372] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Jul 5 20:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:52:38.905370 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49209d-e889-4ee7-bceb-eb29777bc021 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:52:38.906756 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-aa49209d-e889-4ee7-bceb-eb29777bc021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:52:38.924030 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49209d-e889-4ee7-bceb-eb29777bc021 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:52:38.931163 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c9785-0b85-4dfa-b0eb-0397badcf87d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:52:38.931804 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c9785-0b85-4dfa-b0eb-0397badcf87d service nova] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:38.932082 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c9785-0b85-4dfa-b0eb-0397badcf87d service nova] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:38.932349 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c9785-0b85-4dfa-b0eb-0397badcf87d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:38.940873 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c9785-0b85-4dfa-b0eb-0397badcf87d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:52:38.942500 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c9785-0b85-4dfa-b0eb-0397badcf87d service nova] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:52:38.952326 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1190/2373] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:52:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:52:44.059325 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f199d6-71a2-4d72-94bd-0624a6bd72ea None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:44.059860 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f199d6-71a2-4d72-94bd-0624a6bd72ea None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:44.059860 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f199d6-71a2-4d72-94bd-0624a6bd72ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:44.078259 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-10f199d6-71a2-4d72-94bd-0624a6bd72ea None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:52:44.079399 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-10f199d6-71a2-4d72-94bd-0624a6bd72ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:52:44.088336 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1184/2374] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Jul 5 20:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:52:44.110794 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c9785-0b85-4dfa-b0eb-0397badcf87d service nova] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:52:44.124220 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c9785-0b85-4dfa-b0eb-0397badcf87d service nova] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:52:44.129986 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af743e-2a48-4b8e-b171-1df697f315c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:52:44.130645 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af743e-2a48-4b8e-b171-1df697f315c6 service nova] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:44.130918 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af743e-2a48-4b8e-b171-1df697f315c6 service nova] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:44.131184 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af743e-2a48-4b8e-b171-1df697f315c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:44.139883 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af743e-2a48-4b8e-b171-1df697f315c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:52:44.141476 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af743e-2a48-4b8e-b171-1df697f315c6 service nova] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:52:44.152071 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1191/2375] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:52:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:52:48.282287 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75dabe-575c-403d-a766-d7a0f0fd4834 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:48.283124 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75dabe-575c-403d-a766-d7a0f0fd4834 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:48.283287 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75dabe-575c-403d-a766-d7a0f0fd4834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:48.313531 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-eb75dabe-575c-403d-a766-d7a0f0fd4834 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:52:48.314797 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-eb75dabe-575c-403d-a766-d7a0f0fd4834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:52:48.324817 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1185/2376] 10.222.0.25 () {58 vars in 1016 bytes} [Tue Jul 5 20:52:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:52:48.355891 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af743e-2a48-4b8e-b171-1df697f315c6 service nova] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:52:48.367899 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af743e-2a48-4b8e-b171-1df697f315c6 service nova] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:52:48.373514 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ab286-ab99-4618-a32c-62910fd7a6bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:52:48.374212 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ab286-ab99-4618-a32c-62910fd7a6bd service nova] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:52:48.374490 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ab286-ab99-4618-a32c-62910fd7a6bd service nova] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:52:48.374747 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ab286-ab99-4618-a32c-62910fd7a6bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:52:48.383316 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ab286-ab99-4618-a32c-62910fd7a6bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:52:48.384924 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ab286-ab99-4618-a32c-62910fd7a6bd service nova] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:52:48.394516 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1192/2377] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:52:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:52:58.305610 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=27 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:52:58.390281 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=73 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:53:08.810317 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6c1cf-39a7-488b-8d75-3d03e9117877 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:08.810947 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6c1cf-39a7-488b-8d75-3d03e9117877 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:08.811089 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6c1cf-39a7-488b-8d75-3d03e9117877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:08.829087 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-aef6c1cf-39a7-488b-8d75-3d03e9117877 None None] MFA Rules not processed for user `1f6d6f1250b14637bb24345550161cda`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:53:08.830351 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-aef6c1cf-39a7-488b-8d75-3d03e9117877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:08.893962 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1186/2378] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:53:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:53:18.885022 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=25 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:53:19.981074 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ab286-ab99-4618-a32c-62910fd7a6bd service nova] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:19.982965 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-ca7ab286-ab99-4618-a32c-62910fd7a6bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:19.997088 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ab286-ab99-4618-a32c-62910fd7a6bd service nova] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:20.002415 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb52a1b-f8a7-4cad-8452-c79f4b78728f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:20.003298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb52a1b-f8a7-4cad-8452-c79f4b78728f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:20.003576 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb52a1b-f8a7-4cad-8452-c79f4b78728f admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:20.003901 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb52a1b-f8a7-4cad-8452-c79f4b78728f admin admin] PATH_INFO: `/v3/users/148f32f6cd4e4af89681bcd5f4ba87b7` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:20.005119 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb52a1b-f8a7-4cad-8452-c79f4b78728f admin admin] RBAC: Authorizing `identity:delete_user(user_id=148f32f6cd4e4af89681bcd5f4ba87b7)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:20.007232 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb52a1b-f8a7-4cad-8452-c79f4b78728f admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:20.062727 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-0fb52a1b-f8a7-4cad-8452-c79f4b78728f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '148f32f6cd4e4af89681bcd5f4ba87b7'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:20.083754 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-0fb52a1b-f8a7-4cad-8452-c79f4b78728f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '148f32f6cd4e4af89681bcd5f4ba87b7'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:20.091700 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-0fb52a1b-f8a7-4cad-8452-c79f4b78728f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '148f32f6cd4e4af89681bcd5f4ba87b7'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:20.092644 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-0fb52a1b-f8a7-4cad-8452-c79f4b78728f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '148f32f6cd4e4af89681bcd5f4ba87b7'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:20.093318 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-0fb52a1b-f8a7-4cad-8452-c79f4b78728f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '148f32f6cd4e4af89681bcd5f4ba87b7'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:20.116750 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1193/2379] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:53:19 2022] DELETE /identity/v3/users/148f32f6cd4e4af89681bcd5f4ba87b7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:53:20.311452 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6c1cf-39a7-488b-8d75-3d03e9117877 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:20.330815 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6c1cf-39a7-488b-8d75-3d03e9117877 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:20.397697 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8018b-df12-47de-b5da-f932d5a946f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:20.398677 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8018b-df12-47de-b5da-f932d5a946f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:20.398915 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8018b-df12-47de-b5da-f932d5a946f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:20.399168 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8018b-df12-47de-b5da-f932d5a946f3 admin admin] PATH_INFO: `/v3/projects/f194bb2b7949480ead35d8e83cb9535f` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:20.400350 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8018b-df12-47de-b5da-f932d5a946f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f194bb2b7949480ead35d8e83cb9535f)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:20.402364 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8018b-df12-47de-b5da-f932d5a946f3 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:20.450892 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-6cb8018b-df12-47de-b5da-f932d5a946f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f194bb2b7949480ead35d8e83cb9535f', 'request_id': 'req-6cb8018b-df12-47de-b5da-f932d5a946f3'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:20.459918 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-6cb8018b-df12-47de-b5da-f932d5a946f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f194bb2b7949480ead35d8e83cb9535f', 'request_id': 'req-6cb8018b-df12-47de-b5da-f932d5a946f3'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:20.467886 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-6cb8018b-df12-47de-b5da-f932d5a946f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f194bb2b7949480ead35d8e83cb9535f', 'request_id': 'req-6cb8018b-df12-47de-b5da-f932d5a946f3'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:20.479251 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-6cb8018b-df12-47de-b5da-f932d5a946f3 admin admin] The token cache is being invalidate because project f194bb2b7949480ead35d8e83cb9535f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:53:20.479540 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-6cb8018b-df12-47de-b5da-f932d5a946f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:20.480165 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-6cb8018b-df12-47de-b5da-f932d5a946f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:20.481719 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1187/2380] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:53:20 2022] DELETE /identity/v3/projects/f194bb2b7949480ead35d8e83cb9535f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:53:20.486730 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060babe6-d3b7-42f3-82e7-62df896f04d2 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:20.486993 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060babe6-d3b7-42f3-82e7-62df896f04d2 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:20.487267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060babe6-d3b7-42f3-82e7-62df896f04d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:20.505486 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-060babe6-d3b7-42f3-82e7-62df896f04d2 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:53:20.506712 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-060babe6-d3b7-42f3-82e7-62df896f04d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:20.569266 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1194/2381] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:53:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:53:20.577122 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5b4d1-d8db-4b87-89bc-d58bfc00a720 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:20.577434 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5b4d1-d8db-4b87-89bc-d58bfc00a720 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:20.577711 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5b4d1-d8db-4b87-89bc-d58bfc00a720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:20.597466 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-d7f5b4d1-d8db-4b87-89bc-d58bfc00a720 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:53:20.598722 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-d7f5b4d1-d8db-4b87-89bc-d58bfc00a720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:20.607918 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1188/2382] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:53:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:53:20.612125 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060babe6-d3b7-42f3-82e7-62df896f04d2 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:20.622156 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060babe6-d3b7-42f3-82e7-62df896f04d2 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:20.627232 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477935d-8207-4c0b-8638-642943b1d1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:20.627872 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477935d-8207-4c0b-8638-642943b1d1ce admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:20.628183 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477935d-8207-4c0b-8638-642943b1d1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:20.628432 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477935d-8207-4c0b-8638-642943b1d1ce admin admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:20.629155 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9477935d-8207-4c0b-8638-642943b1d1ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:53:20.629460 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9477935d-8207-4c0b-8638-642943b1d1ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:20.631108 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9477935d-8207-4c0b-8638-642943b1d1ce admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:20.642780 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1195/2383] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:53:20.646933 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5b4d1-d8db-4b87-89bc-d58bfc00a720 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:20.656659 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5b4d1-d8db-4b87-89bc-d58bfc00a720 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:20.662701 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f27d36-e07e-437a-bb99-78c8030e6204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:20.663366 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f27d36-e07e-437a-bb99-78c8030e6204 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:20.663647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f27d36-e07e-437a-bb99-78c8030e6204 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:20.663923 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f27d36-e07e-437a-bb99-78c8030e6204 admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:20.664625 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f27d36-e07e-437a-bb99-78c8030e6204 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:20.666599 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f27d36-e07e-437a-bb99-78c8030e6204 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:20.694809 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1189/2384] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:53:20 2022] POST /identity/v3/projects => generated 393 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:53:20.701017 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477935d-8207-4c0b-8638-642943b1d1ce admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:20.716492 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477935d-8207-4c0b-8638-642943b1d1ce admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:20.774367 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4f0d9-7e84-464d-ace8-882951c66dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:20.775034 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4f0d9-7e84-464d-ace8-882951c66dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:20.775329 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4f0d9-7e84-464d-ace8-882951c66dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:20.775588 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4f0d9-7e84-464d-ace8-882951c66dd3 admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:20.776268 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd4f0d9-7e84-464d-ace8-882951c66dd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:20.778225 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd4f0d9-7e84-464d-ace8-882951c66dd3 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:20.786454 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:53:20.802825 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1196/2385] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:53:20 2022] POST /identity/v3/users => generated 297 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:53:20.806990 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f27d36-e07e-437a-bb99-78c8030e6204 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:20.817649 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f27d36-e07e-437a-bb99-78c8030e6204 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:20.822670 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c388154-f30b-40e2-bb61-84c2ead19ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:20.823336 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c388154-f30b-40e2-bb61-84c2ead19ffd admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:20.823616 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c388154-f30b-40e2-bb61-84c2ead19ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:20.823890 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c388154-f30b-40e2-bb61-84c2ead19ffd admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:20.824627 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c388154-f30b-40e2-bb61-84c2ead19ffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:20.826365 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c388154-f30b-40e2-bb61-84c2ead19ffd admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:20.837332 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1190/2386] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:53:20.841909 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4f0d9-7e84-464d-ace8-882951c66dd3 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:20.852635 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4f0d9-7e84-464d-ace8-882951c66dd3 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:20.857626 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32e5f5-2f73-4731-bd66-820f30e22b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:20.858290 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32e5f5-2f73-4731-bd66-820f30e22b6f admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:20.858572 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32e5f5-2f73-4731-bd66-820f30e22b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:20.858847 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32e5f5-2f73-4731-bd66-820f30e22b6f admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:20.859571 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32e5f5-2f73-4731-bd66-820f30e22b6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:20.861215 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32e5f5-2f73-4731-bd66-820f30e22b6f admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:20.871790 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1197/2387] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:53:20.876281 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c388154-f30b-40e2-bb61-84c2ead19ffd admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:20.886569 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c388154-f30b-40e2-bb61-84c2ead19ffd admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:20.891244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8073d-b430-495d-9dd6-5248d4cbbd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:20.892129 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8073d-b430-495d-9dd6-5248d4cbbd60 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:20.892408 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8073d-b430-495d-9dd6-5248d4cbbd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:20.892679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8073d-b430-495d-9dd6-5248d4cbbd60 admin admin] PATH_INFO: `/v3/projects/30d9199de03049269316d1c46445b099/users/14747252bc4e43fb972eecb386b76c90/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:20.907921 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a8073d-b430-495d-9dd6-5248d4cbbd60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30d9199de03049269316d1c46445b099, user_id=14747252bc4e43fb972eecb386b76c90, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:20.911041 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a8073d-b430-495d-9dd6-5248d4cbbd60 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:20.927099 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1191/2388] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:53:20 2022] PUT /identity/v3/projects/30d9199de03049269316d1c46445b099/users/14747252bc4e43fb972eecb386b76c90/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:53:20.940710 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318e06e-e01f-41f5-8b4b-5ab90fabf22d None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:20.941035 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318e06e-e01f-41f5-8b4b-5ab90fabf22d None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:20.941307 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318e06e-e01f-41f5-8b4b-5ab90fabf22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:20.970508 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-a318e06e-e01f-41f5-8b4b-5ab90fabf22d None None] MFA Rules not processed for user `14747252bc4e43fb972eecb386b76c90`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:53:20.971700 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-a318e06e-e01f-41f5-8b4b-5ab90fabf22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:21.050606 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1198/2389] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:53:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:53:21.062405 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8073d-b430-495d-9dd6-5248d4cbbd60 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:21.064559 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-22a8073d-b430-495d-9dd6-5248d4cbbd60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:21.096732 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:53:21.148523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8073d-b430-495d-9dd6-5248d4cbbd60 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:21.152340 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ea098-c5a2-4e19-9c79-3021fc6bc93e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:21.152979 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ea098-c5a2-4e19-9c79-3021fc6bc93e service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:21.153258 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ea098-c5a2-4e19-9c79-3021fc6bc93e service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:21.153583 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ea098-c5a2-4e19-9c79-3021fc6bc93e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:21.162740 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ea098-c5a2-4e19-9c79-3021fc6bc93e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:21.164180 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ea098-c5a2-4e19-9c79-3021fc6bc93e service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:21.173193 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1192/2390] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:53:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:53:26.420762 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318e06e-e01f-41f5-8b4b-5ab90fabf22d None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:26.502538 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318e06e-e01f-41f5-8b4b-5ab90fabf22d None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:26.507763 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc20d0-e146-4555-bd0a-a5818e9c3477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:26.508684 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc20d0-e146-4555-bd0a-a5818e9c3477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:26.509004 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc20d0-e146-4555-bd0a-a5818e9c3477 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:26.509236 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc20d0-e146-4555-bd0a-a5818e9c3477 admin admin] PATH_INFO: `/v3/users/14747252bc4e43fb972eecb386b76c90` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:26.519595 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc20d0-e146-4555-bd0a-a5818e9c3477 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14747252bc4e43fb972eecb386b76c90)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:26.521871 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc20d0-e146-4555-bd0a-a5818e9c3477 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:26.581281 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-eddc20d0-e146-4555-bd0a-a5818e9c3477 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14747252bc4e43fb972eecb386b76c90'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:26.593783 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-eddc20d0-e146-4555-bd0a-a5818e9c3477 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14747252bc4e43fb972eecb386b76c90'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:26.598949 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:53:26.603000 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-eddc20d0-e146-4555-bd0a-a5818e9c3477 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14747252bc4e43fb972eecb386b76c90'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:26.603825 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-eddc20d0-e146-4555-bd0a-a5818e9c3477 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14747252bc4e43fb972eecb386b76c90'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:26.604753 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-eddc20d0-e146-4555-bd0a-a5818e9c3477 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14747252bc4e43fb972eecb386b76c90'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:26.620943 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1199/2391] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:53:26 2022] DELETE /identity/v3/users/14747252bc4e43fb972eecb386b76c90 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:53:26.625636 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7e609-bfc6-4193-90a5-ccccf62dbae9 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:26.626151 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7e609-bfc6-4193-90a5-ccccf62dbae9 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:26.626244 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7e609-bfc6-4193-90a5-ccccf62dbae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:26.643734 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-aac7e609-bfc6-4193-90a5-ccccf62dbae9 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:53:26.644946 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-aac7e609-bfc6-4193-90a5-ccccf62dbae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:26.710393 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1193/2392] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:53:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:53:26.720226 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc20d0-e146-4555-bd0a-a5818e9c3477 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:26.721699 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-eddc20d0-e146-4555-bd0a-a5818e9c3477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:26.785893 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc20d0-e146-4555-bd0a-a5818e9c3477 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:26.789644 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47d972-60db-4ad9-96cb-65671a686310 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:26.790320 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47d972-60db-4ad9-96cb-65671a686310 service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:26.790601 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47d972-60db-4ad9-96cb-65671a686310 service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:26.790876 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47d972-60db-4ad9-96cb-65671a686310 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:26.800748 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e47d972-60db-4ad9-96cb-65671a686310 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:26.802131 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e47d972-60db-4ad9-96cb-65671a686310 service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:26.812223 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1200/2393] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:53:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:53:27.090899 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7e609-bfc6-4193-90a5-ccccf62dbae9 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:27.092532 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-aac7e609-bfc6-4193-90a5-ccccf62dbae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:27.104825 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7e609-bfc6-4193-90a5-ccccf62dbae9 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:27.110273 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8483e-e435-4003-a451-7ebc08688d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:27.111410 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8483e-e435-4003-a451-7ebc08688d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:27.111410 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8483e-e435-4003-a451-7ebc08688d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:27.111675 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8483e-e435-4003-a451-7ebc08688d53 admin admin] PATH_INFO: `/v3/projects/30d9199de03049269316d1c46445b099` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:27.112958 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a8483e-e435-4003-a451-7ebc08688d53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30d9199de03049269316d1c46445b099)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:27.114985 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a8483e-e435-4003-a451-7ebc08688d53 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:27.165787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-56a8483e-e435-4003-a451-7ebc08688d53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30d9199de03049269316d1c46445b099', 'request_id': 'req-56a8483e-e435-4003-a451-7ebc08688d53'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:27.171678 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-56a8483e-e435-4003-a451-7ebc08688d53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30d9199de03049269316d1c46445b099', 'request_id': 'req-56a8483e-e435-4003-a451-7ebc08688d53'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:27.181368 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-56a8483e-e435-4003-a451-7ebc08688d53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30d9199de03049269316d1c46445b099', 'request_id': 'req-56a8483e-e435-4003-a451-7ebc08688d53'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:27.192508 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-56a8483e-e435-4003-a451-7ebc08688d53 admin admin] The token cache is being invalidate because project 30d9199de03049269316d1c46445b099 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:53:27.192791 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-56a8483e-e435-4003-a451-7ebc08688d53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:27.193402 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-56a8483e-e435-4003-a451-7ebc08688d53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:27.194991 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1194/2394] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:53:27 2022] DELETE /identity/v3/projects/30d9199de03049269316d1c46445b099 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:53:32.392852 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e473b8-8e80-41c3-9f45-13b906da9264 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:32.393330 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e473b8-8e80-41c3-9f45-13b906da9264 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:32.393448 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e473b8-8e80-41c3-9f45-13b906da9264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:32.411052 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-a5e473b8-8e80-41c3-9f45-13b906da9264 None None] MFA Rules not processed for user `96c018ba46da45b3a079189aafdcdecd`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:53:32.412253 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-a5e473b8-8e80-41c3-9f45-13b906da9264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:32.467876 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1201/2395] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:53:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:53:37.189559 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:53:38.113378 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8483e-e435-4003-a451-7ebc08688d53 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:38.115056 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-56a8483e-e435-4003-a451-7ebc08688d53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:38.188696 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8483e-e435-4003-a451-7ebc08688d53 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:38.193044 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914216f-2d1a-4f51-97a9-220478433669 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:38.193661 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914216f-2d1a-4f51-97a9-220478433669 service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:38.193959 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914216f-2d1a-4f51-97a9-220478433669 service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:38.194234 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914216f-2d1a-4f51-97a9-220478433669 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:38.196370 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-b914216f-2d1a-4f51-97a9-220478433669 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:38.278213 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b914216f-2d1a-4f51-97a9-220478433669 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:38.279671 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b914216f-2d1a-4f51-97a9-220478433669 service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:38.291226 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1195/2396] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:53:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:53:40.078798 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e473b8-8e80-41c3-9f45-13b906da9264 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:40.080419 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-a5e473b8-8e80-41c3-9f45-13b906da9264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:40.093907 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e473b8-8e80-41c3-9f45-13b906da9264 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:40.097832 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e15a8-f081-421a-9630-2df395d6136e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:40.098453 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e15a8-f081-421a-9630-2df395d6136e service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:40.098724 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e15a8-f081-421a-9630-2df395d6136e service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:40.098992 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e15a8-f081-421a-9630-2df395d6136e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:40.100796 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-c44e15a8-f081-421a-9630-2df395d6136e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:40.113938 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e15a8-f081-421a-9630-2df395d6136e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:40.115374 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e15a8-f081-421a-9630-2df395d6136e service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:40.126556 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1202/2397] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:53:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:53:46.710314 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914216f-2d1a-4f51-97a9-220478433669 service neutron] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:46.719658 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914216f-2d1a-4f51-97a9-220478433669 service neutron] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:46.724284 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82846efb-2a1c-4681-bea4-fecfd436cf95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:46.724939 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82846efb-2a1c-4681-bea4-fecfd436cf95 service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:46.725213 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82846efb-2a1c-4681-bea4-fecfd436cf95 service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:46.725486 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82846efb-2a1c-4681-bea4-fecfd436cf95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:46.727669 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-82846efb-2a1c-4681-bea4-fecfd436cf95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:46.796757 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82846efb-2a1c-4681-bea4-fecfd436cf95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:46.798348 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82846efb-2a1c-4681-bea4-fecfd436cf95 service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:46.809560 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1196/2398] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:53:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:53:50.122548 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=61,keystone:INSERT=1,keystone:DELETE=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:53:50.151339 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e15a8-f081-421a-9630-2df395d6136e service neutron] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:50.152879 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-c44e15a8-f081-421a-9630-2df395d6136e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:50.166971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e15a8-f081-421a-9630-2df395d6136e service neutron] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:50.171796 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42918f4-a769-45a7-9379-c25e955c6829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:50.172677 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42918f4-a769-45a7-9379-c25e955c6829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:50.172984 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42918f4-a769-45a7-9379-c25e955c6829 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:50.173252 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42918f4-a769-45a7-9379-c25e955c6829 admin admin] PATH_INFO: `/v3/users/bc1c30d3677845c5b9185f4a4ad5ea03` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:50.174462 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42918f4-a769-45a7-9379-c25e955c6829 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc1c30d3677845c5b9185f4a4ad5ea03)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:50.176400 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42918f4-a769-45a7-9379-c25e955c6829 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:50.229221 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-b42918f4-a769-45a7-9379-c25e955c6829 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc1c30d3677845c5b9185f4a4ad5ea03'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:50.244640 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-b42918f4-a769-45a7-9379-c25e955c6829 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc1c30d3677845c5b9185f4a4ad5ea03'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:50.251583 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-b42918f4-a769-45a7-9379-c25e955c6829 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc1c30d3677845c5b9185f4a4ad5ea03'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:50.252310 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-b42918f4-a769-45a7-9379-c25e955c6829 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc1c30d3677845c5b9185f4a4ad5ea03'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:50.252929 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-b42918f4-a769-45a7-9379-c25e955c6829 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc1c30d3677845c5b9185f4a4ad5ea03'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:50.267455 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1203/2399] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:53:50 2022] DELETE /identity/v3/users/bc1c30d3677845c5b9185f4a4ad5ea03 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:53:50.447344 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82846efb-2a1c-4681-bea4-fecfd436cf95 service neutron] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:50.459895 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82846efb-2a1c-4681-bea4-fecfd436cf95 service neutron] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:50.497616 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:53:50.524039 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84554d8c-8419-4c28-82a1-2e95b5a6b50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:50.524922 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84554d8c-8419-4c28-82a1-2e95b5a6b50e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:50.525195 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84554d8c-8419-4c28-82a1-2e95b5a6b50e admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:50.525444 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84554d8c-8419-4c28-82a1-2e95b5a6b50e admin admin] PATH_INFO: `/v3/projects/0b1eced4c4c648b484991197f77e8630` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:50.526726 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84554d8c-8419-4c28-82a1-2e95b5a6b50e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b1eced4c4c648b484991197f77e8630)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:50.528756 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84554d8c-8419-4c28-82a1-2e95b5a6b50e admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:50.578110 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-84554d8c-8419-4c28-82a1-2e95b5a6b50e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b1eced4c4c648b484991197f77e8630', 'request_id': 'req-84554d8c-8419-4c28-82a1-2e95b5a6b50e'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:50.583320 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-84554d8c-8419-4c28-82a1-2e95b5a6b50e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b1eced4c4c648b484991197f77e8630', 'request_id': 'req-84554d8c-8419-4c28-82a1-2e95b5a6b50e'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:50.590942 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-84554d8c-8419-4c28-82a1-2e95b5a6b50e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b1eced4c4c648b484991197f77e8630', 'request_id': 'req-84554d8c-8419-4c28-82a1-2e95b5a6b50e'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:50.601773 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-84554d8c-8419-4c28-82a1-2e95b5a6b50e admin admin] The token cache is being invalidate because project 0b1eced4c4c648b484991197f77e8630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:53:50.602084 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-84554d8c-8419-4c28-82a1-2e95b5a6b50e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:50.602692 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-84554d8c-8419-4c28-82a1-2e95b5a6b50e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:50.604249 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1197/2400] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:53:50 2022] DELETE /identity/v3/projects/0b1eced4c4c648b484991197f77e8630 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:53:50.609290 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a09d59-41d3-40ce-bdff-ac65ade4dc81 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:50.609564 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a09d59-41d3-40ce-bdff-ac65ade4dc81 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:50.609834 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a09d59-41d3-40ce-bdff-ac65ade4dc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:50.627312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-70a09d59-41d3-40ce-bdff-ac65ade4dc81 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:53:50.628518 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-70a09d59-41d3-40ce-bdff-ac65ade4dc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:50.691022 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1204/2401] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:53:50.698847 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c04652-96a9-46fc-bb4c-d9d2706cd1fd None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:50.699127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c04652-96a9-46fc-bb4c-d9d2706cd1fd None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:50.699394 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c04652-96a9-46fc-bb4c-d9d2706cd1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:50.719229 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-96c04652-96a9-46fc-bb4c-d9d2706cd1fd None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:53:50.720431 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-96c04652-96a9-46fc-bb4c-d9d2706cd1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:50.730159 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1198/2402] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:53:50.734132 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a09d59-41d3-40ce-bdff-ac65ade4dc81 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:50.744075 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a09d59-41d3-40ce-bdff-ac65ade4dc81 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:50.748964 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbd758-872a-4a95-baae-6a835c5cbec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:50.749665 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbd758-872a-4a95-baae-6a835c5cbec7 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:50.749967 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbd758-872a-4a95-baae-6a835c5cbec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:50.750237 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbd758-872a-4a95-baae-6a835c5cbec7 admin admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:50.750957 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fbd758-872a-4a95-baae-6a835c5cbec7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:53:50.751254 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fbd758-872a-4a95-baae-6a835c5cbec7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:50.752846 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fbd758-872a-4a95-baae-6a835c5cbec7 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:50.764609 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1205/2403] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:53:50.768922 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c04652-96a9-46fc-bb4c-d9d2706cd1fd None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:50.778392 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c04652-96a9-46fc-bb4c-d9d2706cd1fd None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:50.784698 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363b373-4b8d-44cc-a3a6-992aba14768e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:50.785353 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363b373-4b8d-44cc-a3a6-992aba14768e admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:50.785630 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363b373-4b8d-44cc-a3a6-992aba14768e admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:50.785932 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363b373-4b8d-44cc-a3a6-992aba14768e admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:50.786611 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363b373-4b8d-44cc-a3a6-992aba14768e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:50.788527 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363b373-4b8d-44cc-a3a6-992aba14768e admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:50.815942 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1199/2404] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:53:50 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:53:50.820011 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbd758-872a-4a95-baae-6a835c5cbec7 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:50.830319 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbd758-872a-4a95-baae-6a835c5cbec7 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:50.890404 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ff28e-8b56-4aca-9249-c209b1f78ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:50.891061 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ff28e-8b56-4aca-9249-c209b1f78ecb admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:50.891341 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ff28e-8b56-4aca-9249-c209b1f78ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:50.891615 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ff28e-8b56-4aca-9249-c209b1f78ecb admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:50.892308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ff28e-8b56-4aca-9249-c209b1f78ecb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:50.894280 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ff28e-8b56-4aca-9249-c209b1f78ecb admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:50.900811 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:53:50.916760 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1206/2405] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:53:50 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:53:50.920944 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363b373-4b8d-44cc-a3a6-992aba14768e admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:50.931644 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363b373-4b8d-44cc-a3a6-992aba14768e admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:50.936597 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f3772-048e-4d48-b7ca-b1caa981b0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:50.937257 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f3772-048e-4d48-b7ca-b1caa981b0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:50.937533 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f3772-048e-4d48-b7ca-b1caa981b0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:50.937808 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f3772-048e-4d48-b7ca-b1caa981b0c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:50.938568 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f3772-048e-4d48-b7ca-b1caa981b0c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:50.940247 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f3772-048e-4d48-b7ca-b1caa981b0c2 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:50.950726 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1200/2406] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:53:50.956223 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ff28e-8b56-4aca-9249-c209b1f78ecb admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:50.966686 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ff28e-8b56-4aca-9249-c209b1f78ecb admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:50.972051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352654e-2800-4dd2-81ec-18f0fbed6939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:50.972696 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352654e-2800-4dd2-81ec-18f0fbed6939 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:50.972974 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352654e-2800-4dd2-81ec-18f0fbed6939 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:50.973243 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352654e-2800-4dd2-81ec-18f0fbed6939 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:50.973998 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352654e-2800-4dd2-81ec-18f0fbed6939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:50.975594 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352654e-2800-4dd2-81ec-18f0fbed6939 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:50.986240 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1207/2407] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:53:50.990300 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f3772-048e-4d48-b7ca-b1caa981b0c2 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:51.000439 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f3772-048e-4d48-b7ca-b1caa981b0c2 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:51.005545 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781947e-1067-4bc4-9010-6c9f14b15814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:51.006435 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781947e-1067-4bc4-9010-6c9f14b15814 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:51.006710 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781947e-1067-4bc4-9010-6c9f14b15814 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:51.006954 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781947e-1067-4bc4-9010-6c9f14b15814 admin admin] PATH_INFO: `/v3/projects/d9ddbadd6afa4c6fb84f7b3f81c85ee2/users/c1abecda0da24d64909f6dbe9138e10a/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:51.021747 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781947e-1067-4bc4-9010-6c9f14b15814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9ddbadd6afa4c6fb84f7b3f81c85ee2, user_id=c1abecda0da24d64909f6dbe9138e10a, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:51.024440 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781947e-1067-4bc4-9010-6c9f14b15814 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:51.043912 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1201/2408] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:53:50 2022] PUT /identity/v3/projects/d9ddbadd6afa4c6fb84f7b3f81c85ee2/users/c1abecda0da24d64909f6dbe9138e10a/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:53:51.054904 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26fcde-eeb8-4d23-b94b-7cb13ea10b39 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:51.055259 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26fcde-eeb8-4d23-b94b-7cb13ea10b39 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:51.055576 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26fcde-eeb8-4d23-b94b-7cb13ea10b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:51.086637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-0a26fcde-eeb8-4d23-b94b-7cb13ea10b39 None None] MFA Rules not processed for user `c1abecda0da24d64909f6dbe9138e10a`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:53:51.087837 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-0a26fcde-eeb8-4d23-b94b-7cb13ea10b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:51.159994 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1208/2409] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:53:51 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:53:51.164757 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781947e-1067-4bc4-9010-6c9f14b15814 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:51.229753 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781947e-1067-4bc4-9010-6c9f14b15814 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:51.235676 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e1606-fdde-46e8-882e-2864abd0dbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:51.236336 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e1606-fdde-46e8-882e-2864abd0dbc1 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:51.236611 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e1606-fdde-46e8-882e-2864abd0dbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:51.236876 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e1606-fdde-46e8-882e-2864abd0dbc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:51.237560 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74e1606-fdde-46e8-882e-2864abd0dbc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:51.239532 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74e1606-fdde-46e8-882e-2864abd0dbc1 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:51.244162 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:53:51.277417 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1202/2410] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:53:51 2022] POST /identity/v3/projects => generated 367 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:53:51.281832 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a26fcde-eeb8-4d23-b94b-7cb13ea10b39 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:51.292961 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a26fcde-eeb8-4d23-b94b-7cb13ea10b39 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:51.350473 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7aaa7a-cf7f-4c5f-838a-0ed05bb985c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:51.351062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7aaa7a-cf7f-4c5f-838a-0ed05bb985c0 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:51.351340 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7aaa7a-cf7f-4c5f-838a-0ed05bb985c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:51.351608 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7aaa7a-cf7f-4c5f-838a-0ed05bb985c0 admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:51.352290 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7aaa7a-cf7f-4c5f-838a-0ed05bb985c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:51.354250 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7aaa7a-cf7f-4c5f-838a-0ed05bb985c0 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:51.378035 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1209/2411] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:53:51 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:53:51.382195 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e1606-fdde-46e8-882e-2864abd0dbc1 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:51.393033 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e1606-fdde-46e8-882e-2864abd0dbc1 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:51.398196 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d7277-e4e8-471d-90f0-c3d8ee15cea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:51.398866 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d7277-e4e8-471d-90f0-c3d8ee15cea5 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:51.399155 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d7277-e4e8-471d-90f0-c3d8ee15cea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:51.399434 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d7277-e4e8-471d-90f0-c3d8ee15cea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:51.400165 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660d7277-e4e8-471d-90f0-c3d8ee15cea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:51.401802 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660d7277-e4e8-471d-90f0-c3d8ee15cea5 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:51.413406 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1203/2412] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:53:51.417580 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7aaa7a-cf7f-4c5f-838a-0ed05bb985c0 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:51.427587 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7aaa7a-cf7f-4c5f-838a-0ed05bb985c0 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:51.432562 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ebfa4b-3d7d-4700-aa1f-00353c6417e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:51.433446 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebfa4b-3d7d-4700-aa1f-00353c6417e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:51.433720 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebfa4b-3d7d-4700-aa1f-00353c6417e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:51.434028 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebfa4b-3d7d-4700-aa1f-00353c6417e8 admin admin] PATH_INFO: `/v3/projects/e3843cd7005a4f6cbf33f4e33092b24a/users/1db643a96b1c4d6e86338ee4d76db73b/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:51.449601 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ebfa4b-3d7d-4700-aa1f-00353c6417e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3843cd7005a4f6cbf33f4e33092b24a, user_id=1db643a96b1c4d6e86338ee4d76db73b, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:51.452357 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ebfa4b-3d7d-4700-aa1f-00353c6417e8 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:51.467630 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1210/2413] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:53:51 2022] PUT /identity/v3/projects/e3843cd7005a4f6cbf33f4e33092b24a/users/1db643a96b1c4d6e86338ee4d76db73b/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:53:51.471678 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d7277-e4e8-471d-90f0-c3d8ee15cea5 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:51.481993 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d7277-e4e8-471d-90f0-c3d8ee15cea5 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:51.540552 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b317cfd-fa24-4dd6-8572-7f3b17e60539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:51.541213 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b317cfd-fa24-4dd6-8572-7f3b17e60539 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:51.541522 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b317cfd-fa24-4dd6-8572-7f3b17e60539 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:51.541795 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b317cfd-fa24-4dd6-8572-7f3b17e60539 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:51.542580 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b317cfd-fa24-4dd6-8572-7f3b17e60539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:51.544194 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b317cfd-fa24-4dd6-8572-7f3b17e60539 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:51.554453 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1204/2414] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:53:51.558665 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ebfa4b-3d7d-4700-aa1f-00353c6417e8 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:51.569265 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ebfa4b-3d7d-4700-aa1f-00353c6417e8 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:51.575171 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07a905-ac2e-45d6-931a-027774fce32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:51.576065 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07a905-ac2e-45d6-931a-027774fce32f admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:51.576345 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07a905-ac2e-45d6-931a-027774fce32f admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:51.576618 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07a905-ac2e-45d6-931a-027774fce32f admin admin] PATH_INFO: `/v3/projects/e3843cd7005a4f6cbf33f4e33092b24a/users/1db643a96b1c4d6e86338ee4d76db73b/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:51.579027 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea07a905-ac2e-45d6-931a-027774fce32f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3843cd7005a4f6cbf33f4e33092b24a, user_id=1db643a96b1c4d6e86338ee4d76db73b, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:51.581709 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea07a905-ac2e-45d6-931a-027774fce32f admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:51.593606 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1211/2415] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:53:51 2022] PUT /identity/v3/projects/e3843cd7005a4f6cbf33f4e33092b24a/users/1db643a96b1c4d6e86338ee4d76db73b/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:53:51.604457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbde5c-2ef9-45b7-8bd3-71516a5689a1 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:51.604679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbde5c-2ef9-45b7-8bd3-71516a5689a1 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:51.604959 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbde5c-2ef9-45b7-8bd3-71516a5689a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:51.633261 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-73fbde5c-2ef9-45b7-8bd3-71516a5689a1 None None] MFA Rules not processed for user `1db643a96b1c4d6e86338ee4d76db73b`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:53:51.634514 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-73fbde5c-2ef9-45b7-8bd3-71516a5689a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:51.703562 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1205/2416] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:53:51 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:53:51.714656 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07a905-ac2e-45d6-931a-027774fce32f admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:51.716471 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-ea07a905-ac2e-45d6-931a-027774fce32f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:51.739919 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:53:51.775611 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07a905-ac2e-45d6-931a-027774fce32f admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:51.779701 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005b389-bb2e-44ea-887d-728e281b944e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:51.780337 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005b389-bb2e-44ea-887d-728e281b944e service cinder] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:51.780619 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005b389-bb2e-44ea-887d-728e281b944e service cinder] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:51.780894 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005b389-bb2e-44ea-887d-728e281b944e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:51.790740 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005b389-bb2e-44ea-887d-728e281b944e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:51.792186 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005b389-bb2e-44ea-887d-728e281b944e service cinder] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:51.801894 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1212/2417] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:53:51 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:53:53.200993 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbde5c-2ef9-45b7-8bd3-71516a5689a1 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:53.262483 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:53:53.267203 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbde5c-2ef9-45b7-8bd3-71516a5689a1 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:53.272539 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c395d84-4dc9-4776-80ac-caa29c0f1bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:53.273538 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c395d84-4dc9-4776-80ac-caa29c0f1bc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:53.273819 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c395d84-4dc9-4776-80ac-caa29c0f1bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:53.274110 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c395d84-4dc9-4776-80ac-caa29c0f1bc8 admin admin] PATH_INFO: `/v3/users/c1abecda0da24d64909f6dbe9138e10a` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:53.275284 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c395d84-4dc9-4776-80ac-caa29c0f1bc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1abecda0da24d64909f6dbe9138e10a)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:53.277212 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c395d84-4dc9-4776-80ac-caa29c0f1bc8 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:53.330124 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-3c395d84-4dc9-4776-80ac-caa29c0f1bc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1abecda0da24d64909f6dbe9138e10a'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:53.338572 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-3c395d84-4dc9-4776-80ac-caa29c0f1bc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1abecda0da24d64909f6dbe9138e10a'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:53.351758 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-3c395d84-4dc9-4776-80ac-caa29c0f1bc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1abecda0da24d64909f6dbe9138e10a'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:53.352466 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-3c395d84-4dc9-4776-80ac-caa29c0f1bc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1abecda0da24d64909f6dbe9138e10a'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:53.353088 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-3c395d84-4dc9-4776-80ac-caa29c0f1bc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1abecda0da24d64909f6dbe9138e10a'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:53.367749 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1206/2418] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:53:53 2022] DELETE /identity/v3/users/c1abecda0da24d64909f6dbe9138e10a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:53:53.372552 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6f753-71aa-492a-ac18-e461323ccac8 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:53.373043 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6f753-71aa-492a-ac18-e461323ccac8 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:53.373156 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6f753-71aa-492a-ac18-e461323ccac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:53.391295 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-9fc6f753-71aa-492a-ac18-e461323ccac8 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:53:53.392441 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-9fc6f753-71aa-492a-ac18-e461323ccac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:53.452902 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1213/2419] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:53:53.463330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c395d84-4dc9-4776-80ac-caa29c0f1bc8 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:53.464835 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-3c395d84-4dc9-4776-80ac-caa29c0f1bc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:53.525750 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c395d84-4dc9-4776-80ac-caa29c0f1bc8 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:53.530191 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe545f3-0c26-4b39-9f8b-5fd7564d7666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:53.530829 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe545f3-0c26-4b39-9f8b-5fd7564d7666 service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:53.531107 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe545f3-0c26-4b39-9f8b-5fd7564d7666 service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:53.531375 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe545f3-0c26-4b39-9f8b-5fd7564d7666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:53.541554 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe545f3-0c26-4b39-9f8b-5fd7564d7666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:53.543081 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe545f3-0c26-4b39-9f8b-5fd7564d7666 service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:53.553373 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1207/2420] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:53:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:53:53.825003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6f753-71aa-492a-ac18-e461323ccac8 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:53.826670 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-9fc6f753-71aa-492a-ac18-e461323ccac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:53.839382 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6f753-71aa-492a-ac18-e461323ccac8 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:53.843912 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f28c5-2acc-467a-8597-bd147931dc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:53.844784 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f28c5-2acc-467a-8597-bd147931dc1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:53.845185 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f28c5-2acc-467a-8597-bd147931dc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:53.845506 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f28c5-2acc-467a-8597-bd147931dc1e admin admin] PATH_INFO: `/v3/projects/d9ddbadd6afa4c6fb84f7b3f81c85ee2` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:53.846775 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f28c5-2acc-467a-8597-bd147931dc1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9ddbadd6afa4c6fb84f7b3f81c85ee2)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:53.848675 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f28c5-2acc-467a-8597-bd147931dc1e admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:53.896383 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-4b0f28c5-2acc-467a-8597-bd147931dc1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9ddbadd6afa4c6fb84f7b3f81c85ee2', 'request_id': 'req-4b0f28c5-2acc-467a-8597-bd147931dc1e'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:53.902125 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-4b0f28c5-2acc-467a-8597-bd147931dc1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9ddbadd6afa4c6fb84f7b3f81c85ee2', 'request_id': 'req-4b0f28c5-2acc-467a-8597-bd147931dc1e'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:53.910851 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-4b0f28c5-2acc-467a-8597-bd147931dc1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9ddbadd6afa4c6fb84f7b3f81c85ee2', 'request_id': 'req-4b0f28c5-2acc-467a-8597-bd147931dc1e'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:53.922462 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-4b0f28c5-2acc-467a-8597-bd147931dc1e admin admin] The token cache is being invalidate because project d9ddbadd6afa4c6fb84f7b3f81c85ee2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:53:53.922749 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-4b0f28c5-2acc-467a-8597-bd147931dc1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:53.923381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-4b0f28c5-2acc-467a-8597-bd147931dc1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:53.925013 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1214/2421] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:53:53 2022] DELETE /identity/v3/projects/d9ddbadd6afa4c6fb84f7b3f81c85ee2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:53:53.929075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe545f3-0c26-4b39-9f8b-5fd7564d7666 service neutron] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:53.939294 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe545f3-0c26-4b39-9f8b-5fd7564d7666 service neutron] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:53.999210 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd83a8-9742-4962-aab1-c1d4fa4415de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:54.000082 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd83a8-9742-4962-aab1-c1d4fa4415de admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:54.000362 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd83a8-9742-4962-aab1-c1d4fa4415de admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:54.000620 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd83a8-9742-4962-aab1-c1d4fa4415de admin admin] PATH_INFO: `/v3/users/1db643a96b1c4d6e86338ee4d76db73b` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:54.001901 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd83a8-9742-4962-aab1-c1d4fa4415de admin admin] RBAC: Authorizing `identity:delete_user(user_id=1db643a96b1c4d6e86338ee4d76db73b)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:54.003873 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd83a8-9742-4962-aab1-c1d4fa4415de admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:54.026594 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:53:54.057423 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-2edd83a8-9742-4962-aab1-c1d4fa4415de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1db643a96b1c4d6e86338ee4d76db73b'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:54.065094 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-2edd83a8-9742-4962-aab1-c1d4fa4415de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1db643a96b1c4d6e86338ee4d76db73b'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:54.077241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-2edd83a8-9742-4962-aab1-c1d4fa4415de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1db643a96b1c4d6e86338ee4d76db73b'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:54.078016 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-2edd83a8-9742-4962-aab1-c1d4fa4415de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1db643a96b1c4d6e86338ee4d76db73b'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:54.078690 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-2edd83a8-9742-4962-aab1-c1d4fa4415de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1db643a96b1c4d6e86338ee4d76db73b'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:54.093150 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1208/2422] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:53:53 2022] DELETE /identity/v3/users/1db643a96b1c4d6e86338ee4d76db73b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:53:54.375424 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f28c5-2acc-467a-8597-bd147931dc1e admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:54.376962 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-4b0f28c5-2acc-467a-8597-bd147931dc1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:54.390921 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f28c5-2acc-467a-8597-bd147931dc1e admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:54.440531 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:53:54.455632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1130a4-b812-4e18-943f-c646fd12fc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:54.456432 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1130a4-b812-4e18-943f-c646fd12fc35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:54.456712 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1130a4-b812-4e18-943f-c646fd12fc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:54.456983 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1130a4-b812-4e18-943f-c646fd12fc35 admin admin] PATH_INFO: `/v3/projects/e3843cd7005a4f6cbf33f4e33092b24a` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:54.458241 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1130a4-b812-4e18-943f-c646fd12fc35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3843cd7005a4f6cbf33f4e33092b24a)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:54.460145 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1130a4-b812-4e18-943f-c646fd12fc35 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:54.516267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-9b1130a4-b812-4e18-943f-c646fd12fc35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3843cd7005a4f6cbf33f4e33092b24a', 'request_id': 'req-9b1130a4-b812-4e18-943f-c646fd12fc35'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:54.522789 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-9b1130a4-b812-4e18-943f-c646fd12fc35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3843cd7005a4f6cbf33f4e33092b24a', 'request_id': 'req-9b1130a4-b812-4e18-943f-c646fd12fc35'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:54.531405 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-9b1130a4-b812-4e18-943f-c646fd12fc35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3843cd7005a4f6cbf33f4e33092b24a', 'request_id': 'req-9b1130a4-b812-4e18-943f-c646fd12fc35'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:54.542864 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-9b1130a4-b812-4e18-943f-c646fd12fc35 admin admin] The token cache is being invalidate because project e3843cd7005a4f6cbf33f4e33092b24a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:53:54.543146 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-9b1130a4-b812-4e18-943f-c646fd12fc35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:54.543783 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-9b1130a4-b812-4e18-943f-c646fd12fc35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:54.545338 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1215/2423] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:53:54 2022] DELETE /identity/v3/projects/e3843cd7005a4f6cbf33f4e33092b24a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:53:54.550731 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414667d-2e4b-4191-8211-b8501de251a3 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:54.551268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414667d-2e4b-4191-8211-b8501de251a3 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:54.551379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414667d-2e4b-4191-8211-b8501de251a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:54.570824 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-5414667d-2e4b-4191-8211-b8501de251a3 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:53:54.572140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-5414667d-2e4b-4191-8211-b8501de251a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:54.636023 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1209/2424] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:53:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:53:54.645131 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df4d27-b24e-4ab2-a560-65cc86e4d46b None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:54.645420 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df4d27-b24e-4ab2-a560-65cc86e4d46b None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:54.645697 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df4d27-b24e-4ab2-a560-65cc86e4d46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:54.664739 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-01df4d27-b24e-4ab2-a560-65cc86e4d46b None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:53:54.665979 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-01df4d27-b24e-4ab2-a560-65cc86e4d46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:54.674090 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1216/2425] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:53:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:53:54.678429 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414667d-2e4b-4191-8211-b8501de251a3 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:54.688887 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414667d-2e4b-4191-8211-b8501de251a3 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:54.693817 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05afe8-0a2c-4262-8032-9ac053dbce15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:54.694495 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05afe8-0a2c-4262-8032-9ac053dbce15 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:54.694771 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05afe8-0a2c-4262-8032-9ac053dbce15 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:54.695043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05afe8-0a2c-4262-8032-9ac053dbce15 admin admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:54.695771 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05afe8-0a2c-4262-8032-9ac053dbce15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:53:54.696089 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05afe8-0a2c-4262-8032-9ac053dbce15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:54.697692 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05afe8-0a2c-4262-8032-9ac053dbce15 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:54.710282 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1210/2426] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:53:54.716780 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df4d27-b24e-4ab2-a560-65cc86e4d46b None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:54.731305 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df4d27-b24e-4ab2-a560-65cc86e4d46b None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:54.738031 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb3432-932b-4822-acb9-9d7b20755259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:54.738678 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb3432-932b-4822-acb9-9d7b20755259 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:54.738922 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb3432-932b-4822-acb9-9d7b20755259 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:54.739226 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb3432-932b-4822-acb9-9d7b20755259 admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:54.739909 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb3432-932b-4822-acb9-9d7b20755259 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:54.741812 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb3432-932b-4822-acb9-9d7b20755259 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:54.769296 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1217/2427] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:53:54 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:53:54.773413 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05afe8-0a2c-4262-8032-9ac053dbce15 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:54.783947 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05afe8-0a2c-4262-8032-9ac053dbce15 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:54.843923 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1ff0e-8620-49d8-ae13-43be1ae112ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:54.844589 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1ff0e-8620-49d8-ae13-43be1ae112ce admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:54.844868 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1ff0e-8620-49d8-ae13-43be1ae112ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:54.845138 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1ff0e-8620-49d8-ae13-43be1ae112ce admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:54.845944 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1ff0e-8620-49d8-ae13-43be1ae112ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:54.848017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1ff0e-8620-49d8-ae13-43be1ae112ce admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:54.870095 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1211/2428] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:53:54 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:53:54.874339 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb3432-932b-4822-acb9-9d7b20755259 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:54.885204 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb3432-932b-4822-acb9-9d7b20755259 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:54.890110 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c93d3a-f588-488e-b30c-3f85ad56f260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:54.890768 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c93d3a-f588-488e-b30c-3f85ad56f260 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:54.891044 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c93d3a-f588-488e-b30c-3f85ad56f260 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:54.891311 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c93d3a-f588-488e-b30c-3f85ad56f260 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:54.892060 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c93d3a-f588-488e-b30c-3f85ad56f260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:54.893656 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c93d3a-f588-488e-b30c-3f85ad56f260 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:54.904525 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1218/2429] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:53:54.908833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1ff0e-8620-49d8-ae13-43be1ae112ce admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:54.919688 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1ff0e-8620-49d8-ae13-43be1ae112ce admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:54.925559 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab7259-259c-4bc5-9fcb-077344be1f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:54.926253 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab7259-259c-4bc5-9fcb-077344be1f12 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:54.926532 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab7259-259c-4bc5-9fcb-077344be1f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:54.926804 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab7259-259c-4bc5-9fcb-077344be1f12 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:54.927539 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab7259-259c-4bc5-9fcb-077344be1f12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:54.929157 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab7259-259c-4bc5-9fcb-077344be1f12 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:54.939727 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1212/2430] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:53:54.943912 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c93d3a-f588-488e-b30c-3f85ad56f260 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:54.954032 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c93d3a-f588-488e-b30c-3f85ad56f260 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:54.958887 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ccb31-bf6d-4cff-a213-995dd58811f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:54.959759 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ccb31-bf6d-4cff-a213-995dd58811f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:54.960036 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ccb31-bf6d-4cff-a213-995dd58811f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:54.960356 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ccb31-bf6d-4cff-a213-995dd58811f1 admin admin] PATH_INFO: `/v3/projects/0c4ceb329f2c49458d29ef76e4c53e72/users/5ccde3e5a97543b495a826c9dee4babe/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:54.975517 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ccb31-bf6d-4cff-a213-995dd58811f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c4ceb329f2c49458d29ef76e4c53e72, user_id=5ccde3e5a97543b495a826c9dee4babe, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:54.978224 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ccb31-bf6d-4cff-a213-995dd58811f1 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:54.993764 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1219/2431] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:53:54 2022] PUT /identity/v3/projects/0c4ceb329f2c49458d29ef76e4c53e72/users/5ccde3e5a97543b495a826c9dee4babe/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:53:55.004274 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f7056-33d5-4e86-977d-53756f85365c None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:55.004560 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f7056-33d5-4e86-977d-53756f85365c None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:55.004836 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f7056-33d5-4e86-977d-53756f85365c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:55.011979 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:53:55.034663 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-073f7056-33d5-4e86-977d-53756f85365c None None] MFA Rules not processed for user `5ccde3e5a97543b495a826c9dee4babe`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:53:55.035867 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-073f7056-33d5-4e86-977d-53756f85365c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:55.102551 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1213/2432] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:53:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:53:55.107426 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ccb31-bf6d-4cff-a213-995dd58811f1 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:55.171496 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ccb31-bf6d-4cff-a213-995dd58811f1 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:55.176493 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae3a09-61f3-4f46-acbc-ed51bec66236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:55.177198 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae3a09-61f3-4f46-acbc-ed51bec66236 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:55.177479 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae3a09-61f3-4f46-acbc-ed51bec66236 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:55.177754 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae3a09-61f3-4f46-acbc-ed51bec66236 admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:55.178546 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae3a09-61f3-4f46-acbc-ed51bec66236 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:55.180450 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae3a09-61f3-4f46-acbc-ed51bec66236 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:55.201681 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:53:55.209919 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1220/2433] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:53:55 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:53:55.214531 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f7056-33d5-4e86-977d-53756f85365c None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:55.226222 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f7056-33d5-4e86-977d-53756f85365c None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:55.291821 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9396c52-b39a-4ea5-815f-66f3c00c6577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:55.292462 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9396c52-b39a-4ea5-815f-66f3c00c6577 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:55.292738 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9396c52-b39a-4ea5-815f-66f3c00c6577 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:55.293009 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9396c52-b39a-4ea5-815f-66f3c00c6577 admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:55.293721 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9396c52-b39a-4ea5-815f-66f3c00c6577 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:55.295716 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9396c52-b39a-4ea5-815f-66f3c00c6577 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:55.318806 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1214/2434] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:53:55 2022] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:53:55.323074 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae3a09-61f3-4f46-acbc-ed51bec66236 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:55.334221 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae3a09-61f3-4f46-acbc-ed51bec66236 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:55.339647 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca241196-7a28-4654-be0b-81b8f4901a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:55.340311 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca241196-7a28-4654-be0b-81b8f4901a7b admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:55.340587 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca241196-7a28-4654-be0b-81b8f4901a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:55.340855 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca241196-7a28-4654-be0b-81b8f4901a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:55.341572 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca241196-7a28-4654-be0b-81b8f4901a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:55.343390 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca241196-7a28-4654-be0b-81b8f4901a7b admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:55.354202 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1221/2435] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:53:55.358379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9396c52-b39a-4ea5-815f-66f3c00c6577 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:55.369067 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9396c52-b39a-4ea5-815f-66f3c00c6577 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:55.374753 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b20b1-ad0f-4aa3-8159-bec9d96ed129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:55.375648 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b20b1-ad0f-4aa3-8159-bec9d96ed129 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:55.375925 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b20b1-ad0f-4aa3-8159-bec9d96ed129 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:55.376199 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b20b1-ad0f-4aa3-8159-bec9d96ed129 admin admin] PATH_INFO: `/v3/projects/f9f6507784374ac5944a35761151ed84/users/a906658d7f6247d7a199f81e71a0cc64/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:55.391779 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b20b1-ad0f-4aa3-8159-bec9d96ed129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9f6507784374ac5944a35761151ed84, user_id=a906658d7f6247d7a199f81e71a0cc64, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:55.394602 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b20b1-ad0f-4aa3-8159-bec9d96ed129 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:55.410713 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1215/2436] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:53:55 2022] PUT /identity/v3/projects/f9f6507784374ac5944a35761151ed84/users/a906658d7f6247d7a199f81e71a0cc64/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:53:55.415202 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca241196-7a28-4654-be0b-81b8f4901a7b admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:55.428124 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca241196-7a28-4654-be0b-81b8f4901a7b admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:55.487033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1efc1c-7c48-4b24-b6a1-3ae3a4209784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:55.487619 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1efc1c-7c48-4b24-b6a1-3ae3a4209784 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:55.487898 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1efc1c-7c48-4b24-b6a1-3ae3a4209784 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:55.488168 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1efc1c-7c48-4b24-b6a1-3ae3a4209784 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:55.488879 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1efc1c-7c48-4b24-b6a1-3ae3a4209784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:55.490509 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1efc1c-7c48-4b24-b6a1-3ae3a4209784 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:55.500333 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1222/2437] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:53:55.504678 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b20b1-ad0f-4aa3-8159-bec9d96ed129 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:55.515501 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b20b1-ad0f-4aa3-8159-bec9d96ed129 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:55.520868 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d9514-d37b-4f5e-8a0e-5bc2fff9d4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:55.521759 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d9514-d37b-4f5e-8a0e-5bc2fff9d4e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:55.522069 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d9514-d37b-4f5e-8a0e-5bc2fff9d4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:55.522365 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d9514-d37b-4f5e-8a0e-5bc2fff9d4e3 admin admin] PATH_INFO: `/v3/projects/f9f6507784374ac5944a35761151ed84/users/a906658d7f6247d7a199f81e71a0cc64/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:55.524460 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1d9514-d37b-4f5e-8a0e-5bc2fff9d4e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9f6507784374ac5944a35761151ed84, user_id=a906658d7f6247d7a199f81e71a0cc64, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:55.527190 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1d9514-d37b-4f5e-8a0e-5bc2fff9d4e3 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:55.538909 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1216/2438] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:53:55 2022] PUT /identity/v3/projects/f9f6507784374ac5944a35761151ed84/users/a906658d7f6247d7a199f81e71a0cc64/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:53:55.550233 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8e008-674e-4df7-9dc4-8f6b08fb019c None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:55.550584 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8e008-674e-4df7-9dc4-8f6b08fb019c None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:55.550959 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8e008-674e-4df7-9dc4-8f6b08fb019c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:55.583622 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-17c8e008-674e-4df7-9dc4-8f6b08fb019c None None] MFA Rules not processed for user `a906658d7f6247d7a199f81e71a0cc64`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:53:55.584861 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-17c8e008-674e-4df7-9dc4-8f6b08fb019c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:55.660000 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1223/2439] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:53:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:53:55.671593 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d9514-d37b-4f5e-8a0e-5bc2fff9d4e3 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:55.673448 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-5e1d9514-d37b-4f5e-8a0e-5bc2fff9d4e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:55.731460 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:53:55.737703 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d9514-d37b-4f5e-8a0e-5bc2fff9d4e3 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:55.741804 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0a230-40a8-4d7e-bcc5-a6f7d1c03065 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:55.742473 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0a230-40a8-4d7e-bcc5-a6f7d1c03065 service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:55.742756 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0a230-40a8-4d7e-bcc5-a6f7d1c03065 service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:55.743029 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0a230-40a8-4d7e-bcc5-a6f7d1c03065 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:55.752298 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0a230-40a8-4d7e-bcc5-a6f7d1c03065 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:55.753757 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0a230-40a8-4d7e-bcc5-a6f7d1c03065 service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:55.763201 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1217/2440] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:53:55 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:53:55.792123 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8e008-674e-4df7-9dc4-8f6b08fb019c None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:55.862177 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8e008-674e-4df7-9dc4-8f6b08fb019c None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:55.867465 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4d3ae-0679-4ff1-8dcb-6c453e21a970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:55.868328 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4d3ae-0679-4ff1-8dcb-6c453e21a970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:55.868603 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4d3ae-0679-4ff1-8dcb-6c453e21a970 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:55.868869 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4d3ae-0679-4ff1-8dcb-6c453e21a970 admin admin] PATH_INFO: `/v3/users/5ccde3e5a97543b495a826c9dee4babe` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:55.870124 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4d3ae-0679-4ff1-8dcb-6c453e21a970 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ccde3e5a97543b495a826c9dee4babe)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:55.872066 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4d3ae-0679-4ff1-8dcb-6c453e21a970 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:55.882604 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:53:55.929435 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-d9b4d3ae-0679-4ff1-8dcb-6c453e21a970 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ccde3e5a97543b495a826c9dee4babe'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:55.945217 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-d9b4d3ae-0679-4ff1-8dcb-6c453e21a970 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ccde3e5a97543b495a826c9dee4babe'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:55.953103 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-d9b4d3ae-0679-4ff1-8dcb-6c453e21a970 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ccde3e5a97543b495a826c9dee4babe'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:55.953920 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-d9b4d3ae-0679-4ff1-8dcb-6c453e21a970 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ccde3e5a97543b495a826c9dee4babe'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:55.954752 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-d9b4d3ae-0679-4ff1-8dcb-6c453e21a970 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ccde3e5a97543b495a826c9dee4babe'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:55.970748 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1224/2441] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:53:55 2022] DELETE /identity/v3/users/5ccde3e5a97543b495a826c9dee4babe => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:53:55.976030 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ec3d9-07de-4fdf-ade8-5620452b5d58 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:55.976379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ec3d9-07de-4fdf-ade8-5620452b5d58 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:55.976795 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ec3d9-07de-4fdf-ade8-5620452b5d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:55.999697 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-545ec3d9-07de-4fdf-ade8-5620452b5d58 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:53:56.000845 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-545ec3d9-07de-4fdf-ade8-5620452b5d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:56.066304 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1218/2442] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:53:56.079226 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4d3ae-0679-4ff1-8dcb-6c453e21a970 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:56.081061 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-d9b4d3ae-0679-4ff1-8dcb-6c453e21a970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:56.139333 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4d3ae-0679-4ff1-8dcb-6c453e21a970 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:56.143476 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7787be16-69f9-4705-b7f7-28cc72f51c9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:56.144115 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787be16-69f9-4705-b7f7-28cc72f51c9d service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:56.144407 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787be16-69f9-4705-b7f7-28cc72f51c9d service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:56.144677 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787be16-69f9-4705-b7f7-28cc72f51c9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:56.154885 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7787be16-69f9-4705-b7f7-28cc72f51c9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:56.156331 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7787be16-69f9-4705-b7f7-28cc72f51c9d service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:56.166467 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1225/2443] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:53:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:53:56.447963 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ec3d9-07de-4fdf-ade8-5620452b5d58 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:56.449622 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-545ec3d9-07de-4fdf-ade8-5620452b5d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:56.462686 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ec3d9-07de-4fdf-ade8-5620452b5d58 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:56.469126 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9508c21-6c97-4cdb-b1b0-e0b8b1628a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:56.470048 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9508c21-6c97-4cdb-b1b0-e0b8b1628a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:56.470325 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9508c21-6c97-4cdb-b1b0-e0b8b1628a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:56.470640 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9508c21-6c97-4cdb-b1b0-e0b8b1628a88 admin admin] PATH_INFO: `/v3/projects/0c4ceb329f2c49458d29ef76e4c53e72` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:56.471926 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9508c21-6c97-4cdb-b1b0-e0b8b1628a88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c4ceb329f2c49458d29ef76e4c53e72)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:56.473968 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9508c21-6c97-4cdb-b1b0-e0b8b1628a88 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:56.521970 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-b9508c21-6c97-4cdb-b1b0-e0b8b1628a88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c4ceb329f2c49458d29ef76e4c53e72', 'request_id': 'req-b9508c21-6c97-4cdb-b1b0-e0b8b1628a88'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:56.527445 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-b9508c21-6c97-4cdb-b1b0-e0b8b1628a88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c4ceb329f2c49458d29ef76e4c53e72', 'request_id': 'req-b9508c21-6c97-4cdb-b1b0-e0b8b1628a88'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:56.537310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-b9508c21-6c97-4cdb-b1b0-e0b8b1628a88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c4ceb329f2c49458d29ef76e4c53e72', 'request_id': 'req-b9508c21-6c97-4cdb-b1b0-e0b8b1628a88'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:56.548566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-b9508c21-6c97-4cdb-b1b0-e0b8b1628a88 admin admin] The token cache is being invalidate because project 0c4ceb329f2c49458d29ef76e4c53e72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:53:56.548845 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-b9508c21-6c97-4cdb-b1b0-e0b8b1628a88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:56.549458 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-b9508c21-6c97-4cdb-b1b0-e0b8b1628a88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:56.551015 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1219/2444] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:53:56 2022] DELETE /identity/v3/projects/0c4ceb329f2c49458d29ef76e4c53e72 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:53:56.555231 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7787be16-69f9-4705-b7f7-28cc72f51c9d service neutron] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:56.565065 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7787be16-69f9-4705-b7f7-28cc72f51c9d service neutron] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:56.626865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22b8ef-f81f-418e-b475-18683692de60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:56.627748 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22b8ef-f81f-418e-b475-18683692de60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:56.628018 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22b8ef-f81f-418e-b475-18683692de60 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:56.628295 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22b8ef-f81f-418e-b475-18683692de60 admin admin] PATH_INFO: `/v3/users/a906658d7f6247d7a199f81e71a0cc64` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:56.629504 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22b8ef-f81f-418e-b475-18683692de60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a906658d7f6247d7a199f81e71a0cc64)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:56.631515 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22b8ef-f81f-418e-b475-18683692de60 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:56.670737 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:53:56.684346 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-1b22b8ef-f81f-418e-b475-18683692de60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a906658d7f6247d7a199f81e71a0cc64'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:56.696228 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-1b22b8ef-f81f-418e-b475-18683692de60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a906658d7f6247d7a199f81e71a0cc64'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:56.703093 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-1b22b8ef-f81f-418e-b475-18683692de60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a906658d7f6247d7a199f81e71a0cc64'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:56.703750 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-1b22b8ef-f81f-418e-b475-18683692de60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a906658d7f6247d7a199f81e71a0cc64'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:56.704358 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-1b22b8ef-f81f-418e-b475-18683692de60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a906658d7f6247d7a199f81e71a0cc64'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:56.720706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1226/2445] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:53:56 2022] DELETE /identity/v3/users/a906658d7f6247d7a199f81e71a0cc64 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:53:57.003930 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9508c21-6c97-4cdb-b1b0-e0b8b1628a88 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:57.005423 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-b9508c21-6c97-4cdb-b1b0-e0b8b1628a88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:57.019002 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9508c21-6c97-4cdb-b1b0-e0b8b1628a88 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:57.078687 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db2009-94df-43ef-b85c-d6c8d5627440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:57.079572 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db2009-94df-43ef-b85c-d6c8d5627440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:57.079850 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db2009-94df-43ef-b85c-d6c8d5627440 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:57.080122 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db2009-94df-43ef-b85c-d6c8d5627440 admin admin] PATH_INFO: `/v3/projects/f9f6507784374ac5944a35761151ed84` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:57.081404 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db2009-94df-43ef-b85c-d6c8d5627440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9f6507784374ac5944a35761151ed84)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:57.083393 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db2009-94df-43ef-b85c-d6c8d5627440 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:57.099659 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:53:57.133016 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c5db2009-94df-43ef-b85c-d6c8d5627440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9f6507784374ac5944a35761151ed84', 'request_id': 'req-c5db2009-94df-43ef-b85c-d6c8d5627440'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:57.138582 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c5db2009-94df-43ef-b85c-d6c8d5627440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9f6507784374ac5944a35761151ed84', 'request_id': 'req-c5db2009-94df-43ef-b85c-d6c8d5627440'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:57.148043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c5db2009-94df-43ef-b85c-d6c8d5627440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9f6507784374ac5944a35761151ed84', 'request_id': 'req-c5db2009-94df-43ef-b85c-d6c8d5627440'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:57.160286 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c5db2009-94df-43ef-b85c-d6c8d5627440 admin admin] The token cache is being invalidate because project f9f6507784374ac5944a35761151ed84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:53:57.160571 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c5db2009-94df-43ef-b85c-d6c8d5627440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:57.161202 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c5db2009-94df-43ef-b85c-d6c8d5627440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:53:57.162813 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1220/2446] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:53:57 2022] DELETE /identity/v3/projects/f9f6507784374ac5944a35761151ed84 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:53:57.167883 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc73c3d-1ff1-49f5-b156-af39e896601c None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:57.168174 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc73c3d-1ff1-49f5-b156-af39e896601c None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:57.168448 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc73c3d-1ff1-49f5-b156-af39e896601c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:57.186894 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-1fc73c3d-1ff1-49f5-b156-af39e896601c None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:53:57.188125 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-1fc73c3d-1ff1-49f5-b156-af39e896601c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:57.248938 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1227/2447] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:53:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:53:57.258142 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f61f8-a0e2-4247-94bf-000837212323 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:57.258432 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f61f8-a0e2-4247-94bf-000837212323 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:57.258740 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f61f8-a0e2-4247-94bf-000837212323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:57.279394 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-9c7f61f8-a0e2-4247-94bf-000837212323 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:53:57.280638 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-9c7f61f8-a0e2-4247-94bf-000837212323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:57.290583 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1221/2448] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:53:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:53:57.295143 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc73c3d-1ff1-49f5-b156-af39e896601c None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:57.305573 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc73c3d-1ff1-49f5-b156-af39e896601c None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:57.310732 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a40f73-20c5-4d42-8827-04ef275898f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:57.311389 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a40f73-20c5-4d42-8827-04ef275898f9 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:57.311674 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a40f73-20c5-4d42-8827-04ef275898f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:57.311947 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a40f73-20c5-4d42-8827-04ef275898f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:57.312710 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a40f73-20c5-4d42-8827-04ef275898f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:53:57.313020 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a40f73-20c5-4d42-8827-04ef275898f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:57.314694 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a40f73-20c5-4d42-8827-04ef275898f9 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:57.327680 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1228/2449] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:53:57.332200 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f61f8-a0e2-4247-94bf-000837212323 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:57.341616 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f61f8-a0e2-4247-94bf-000837212323 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:57.347064 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128febc9-dd85-4da0-8c9e-85ca220a1556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:57.347721 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128febc9-dd85-4da0-8c9e-85ca220a1556 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:57.347982 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128febc9-dd85-4da0-8c9e-85ca220a1556 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:57.348250 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128febc9-dd85-4da0-8c9e-85ca220a1556 admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:57.348928 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128febc9-dd85-4da0-8c9e-85ca220a1556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:57.350872 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128febc9-dd85-4da0-8c9e-85ca220a1556 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:57.379299 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1222/2450] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:53:57 2022] POST /identity/v3/projects => generated 393 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:53:57.383647 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a40f73-20c5-4d42-8827-04ef275898f9 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:57.393706 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a40f73-20c5-4d42-8827-04ef275898f9 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:57.452052 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f216a60-110c-48a3-bc22-dff3733139cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:57.452711 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f216a60-110c-48a3-bc22-dff3733139cc admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:57.452988 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f216a60-110c-48a3-bc22-dff3733139cc admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:57.453256 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f216a60-110c-48a3-bc22-dff3733139cc admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:57.453978 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f216a60-110c-48a3-bc22-dff3733139cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:57.456014 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f216a60-110c-48a3-bc22-dff3733139cc admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:57.477862 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1229/2451] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:53:57 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:53:57.482282 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128febc9-dd85-4da0-8c9e-85ca220a1556 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:57.494117 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128febc9-dd85-4da0-8c9e-85ca220a1556 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:57.499260 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff6daa-e8ef-47d1-a708-ce8f8626403c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:57.499915 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff6daa-e8ef-47d1-a708-ce8f8626403c admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:57.500192 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff6daa-e8ef-47d1-a708-ce8f8626403c admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:57.500461 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff6daa-e8ef-47d1-a708-ce8f8626403c admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:57.501184 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff6daa-e8ef-47d1-a708-ce8f8626403c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:57.502859 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff6daa-e8ef-47d1-a708-ce8f8626403c admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:57.513766 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1223/2452] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:53:57.518006 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f216a60-110c-48a3-bc22-dff3733139cc admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:57.528253 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f216a60-110c-48a3-bc22-dff3733139cc admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:57.533800 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b399f-d481-4b50-8264-36541e0bbfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:57.534514 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b399f-d481-4b50-8264-36541e0bbfc6 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:57.534795 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b399f-d481-4b50-8264-36541e0bbfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:57.535066 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b399f-d481-4b50-8264-36541e0bbfc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:57.535824 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b399f-d481-4b50-8264-36541e0bbfc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:57.537462 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b399f-d481-4b50-8264-36541e0bbfc6 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:57.547673 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1230/2453] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:53:57.551923 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff6daa-e8ef-47d1-a708-ce8f8626403c admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:57.562120 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff6daa-e8ef-47d1-a708-ce8f8626403c admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:57.567125 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c368e-edc7-44fd-8ffe-dbf755d912ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:57.567969 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c368e-edc7-44fd-8ffe-dbf755d912ba admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:57.568270 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c368e-edc7-44fd-8ffe-dbf755d912ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:57.568524 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c368e-edc7-44fd-8ffe-dbf755d912ba admin admin] PATH_INFO: `/v3/projects/41234810a3ee4038bb821e69934688dc/users/62c3e19820b94d0e9972ff461fd732e9/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:57.583475 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c368e-edc7-44fd-8ffe-dbf755d912ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=41234810a3ee4038bb821e69934688dc, user_id=62c3e19820b94d0e9972ff461fd732e9, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:57.586105 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c368e-edc7-44fd-8ffe-dbf755d912ba admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:57.603864 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1224/2454] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:53:57 2022] PUT /identity/v3/projects/41234810a3ee4038bb821e69934688dc/users/62c3e19820b94d0e9972ff461fd732e9/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:53:57.617361 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ef2aa-2cf1-4d4c-b725-6d6ebc491111 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:57.617892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ef2aa-2cf1-4d4c-b725-6d6ebc491111 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:57.617892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ef2aa-2cf1-4d4c-b725-6d6ebc491111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:57.647145 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-c51ef2aa-2cf1-4d4c-b725-6d6ebc491111 None None] MFA Rules not processed for user `62c3e19820b94d0e9972ff461fd732e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:53:57.648380 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-c51ef2aa-2cf1-4d4c-b725-6d6ebc491111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:57.652918 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:53:57.715793 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1231/2455] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:53:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:53:57.720399 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c368e-edc7-44fd-8ffe-dbf755d912ba admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:57.783732 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c368e-edc7-44fd-8ffe-dbf755d912ba admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:57.788877 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0cdd6-7428-4254-b7ae-37496420d973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:57.789524 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0cdd6-7428-4254-b7ae-37496420d973 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:57.789800 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0cdd6-7428-4254-b7ae-37496420d973 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:57.790102 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0cdd6-7428-4254-b7ae-37496420d973 admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:57.790779 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb0cdd6-7428-4254-b7ae-37496420d973 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:57.792694 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb0cdd6-7428-4254-b7ae-37496420d973 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:57.820777 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1225/2456] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:53:57 2022] POST /identity/v3/projects => generated 393 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:53:57.825621 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ef2aa-2cf1-4d4c-b725-6d6ebc491111 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:57.837910 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ef2aa-2cf1-4d4c-b725-6d6ebc491111 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:57.904954 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c413f-1ffa-4b76-967c-f705f1b55e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:57.905631 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c413f-1ffa-4b76-967c-f705f1b55e82 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:57.905902 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c413f-1ffa-4b76-967c-f705f1b55e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:57.906205 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c413f-1ffa-4b76-967c-f705f1b55e82 admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:57.907267 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0c413f-1ffa-4b76-967c-f705f1b55e82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:57.909273 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0c413f-1ffa-4b76-967c-f705f1b55e82 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:57.933472 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1232/2457] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:53:57 2022] POST /identity/v3/users => generated 303 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:53:57.939596 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0cdd6-7428-4254-b7ae-37496420d973 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:57.950375 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0cdd6-7428-4254-b7ae-37496420d973 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:57.960600 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fc39c-d9ba-4eae-9ec5-3db023bd6b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:57.961309 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fc39c-d9ba-4eae-9ec5-3db023bd6b03 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:57.961655 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fc39c-d9ba-4eae-9ec5-3db023bd6b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:57.961948 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fc39c-d9ba-4eae-9ec5-3db023bd6b03 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:57.962681 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672fc39c-d9ba-4eae-9ec5-3db023bd6b03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:57.964340 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672fc39c-d9ba-4eae-9ec5-3db023bd6b03 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:57.976101 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1226/2458] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:53:57.980594 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c413f-1ffa-4b76-967c-f705f1b55e82 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:57.991694 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c413f-1ffa-4b76-967c-f705f1b55e82 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:57.997246 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8993257-dd2f-4c2c-9526-b308f049a82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:57.998165 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8993257-dd2f-4c2c-9526-b308f049a82c admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:57.998448 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8993257-dd2f-4c2c-9526-b308f049a82c admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:57.998714 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8993257-dd2f-4c2c-9526-b308f049a82c admin admin] PATH_INFO: `/v3/projects/9f7488e438e942e28122977fa087cdf3/users/2277ab3576334493b72100a08a372a71/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:58.014395 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8993257-dd2f-4c2c-9526-b308f049a82c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f7488e438e942e28122977fa087cdf3, user_id=2277ab3576334493b72100a08a372a71, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:58.017089 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8993257-dd2f-4c2c-9526-b308f049a82c admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:58.032262 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1233/2459] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:53:57 2022] PUT /identity/v3/projects/9f7488e438e942e28122977fa087cdf3/users/2277ab3576334493b72100a08a372a71/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:53:58.036696 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fc39c-d9ba-4eae-9ec5-3db023bd6b03 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:58.047395 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fc39c-d9ba-4eae-9ec5-3db023bd6b03 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:58.056693 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:53:58.108612 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9900b-ad78-456a-a554-bdcdd94ed054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:58.109205 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9900b-ad78-456a-a554-bdcdd94ed054 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:58.109490 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9900b-ad78-456a-a554-bdcdd94ed054 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:58.109769 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9900b-ad78-456a-a554-bdcdd94ed054 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:58.110527 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9900b-ad78-456a-a554-bdcdd94ed054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:58.112149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9900b-ad78-456a-a554-bdcdd94ed054 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:58.122125 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1227/2460] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:53:58.128399 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8993257-dd2f-4c2c-9526-b308f049a82c admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:58.139569 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8993257-dd2f-4c2c-9526-b308f049a82c admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:58.144995 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85db75a-e9bb-43ec-a898-5801284c3393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:58.145948 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85db75a-e9bb-43ec-a898-5801284c3393 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:58.146226 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85db75a-e9bb-43ec-a898-5801284c3393 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:58.146497 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85db75a-e9bb-43ec-a898-5801284c3393 admin admin] PATH_INFO: `/v3/projects/9f7488e438e942e28122977fa087cdf3/users/2277ab3576334493b72100a08a372a71/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:58.148557 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85db75a-e9bb-43ec-a898-5801284c3393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f7488e438e942e28122977fa087cdf3, user_id=2277ab3576334493b72100a08a372a71, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:58.151365 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85db75a-e9bb-43ec-a898-5801284c3393 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:58.162905 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1234/2461] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:53:58 2022] PUT /identity/v3/projects/9f7488e438e942e28122977fa087cdf3/users/2277ab3576334493b72100a08a372a71/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:53:58.174384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f22e55-0ee0-4af0-b905-f04bc5acb308 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:58.174689 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f22e55-0ee0-4af0-b905-f04bc5acb308 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:58.174966 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f22e55-0ee0-4af0-b905-f04bc5acb308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:58.201457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-d6f22e55-0ee0-4af0-b905-f04bc5acb308 None None] MFA Rules not processed for user `2277ab3576334493b72100a08a372a71`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:53:58.202701 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-d6f22e55-0ee0-4af0-b905-f04bc5acb308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:58.272842 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1228/2462] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:53:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:53:58.284299 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85db75a-e9bb-43ec-a898-5801284c3393 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:58.287048 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-d85db75a-e9bb-43ec-a898-5801284c3393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:58.348867 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85db75a-e9bb-43ec-a898-5801284c3393 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:58.353630 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3e69c-fbc2-4879-8ba5-247828707abd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:58.354299 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3e69c-fbc2-4879-8ba5-247828707abd service cinder] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:58.354572 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3e69c-fbc2-4879-8ba5-247828707abd service cinder] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:58.354865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3e69c-fbc2-4879-8ba5-247828707abd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:58.364929 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3e69c-fbc2-4879-8ba5-247828707abd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:58.366354 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3e69c-fbc2-4879-8ba5-247828707abd service cinder] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:58.371347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:53:58.376795 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1235/2463] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:53:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:53:58.427443 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f22e55-0ee0-4af0-b905-f04bc5acb308 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:53:58.428987 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-d6f22e55-0ee0-4af0-b905-f04bc5acb308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:53:58.441981 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f22e55-0ee0-4af0-b905-f04bc5acb308 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:53:58.446120 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9145da-d1fe-4217-aa9f-e2cc91150cb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:53:58.446762 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9145da-d1fe-4217-aa9f-e2cc91150cb9 service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:53:58.447038 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9145da-d1fe-4217-aa9f-e2cc91150cb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:53:58.447306 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9145da-d1fe-4217-aa9f-e2cc91150cb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:53:58.510665 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9145da-d1fe-4217-aa9f-e2cc91150cb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:53:58.512107 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9145da-d1fe-4217-aa9f-e2cc91150cb9 service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:53:58.521255 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1229/2464] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:53:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:01.241599 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3e69c-fbc2-4879-8ba5-247828707abd service cinder] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:01.243234 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-84a3e69c-fbc2-4879-8ba5-247828707abd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:01.317536 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3e69c-fbc2-4879-8ba5-247828707abd service cinder] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:01.324459 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1136a-68b0-423a-9d5f-01d1e23494b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:01.325103 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1136a-68b0-423a-9d5f-01d1e23494b5 service nova] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:01.325404 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1136a-68b0-423a-9d5f-01d1e23494b5 service nova] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:01.325659 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1136a-68b0-423a-9d5f-01d1e23494b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:01.327593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-00c1136a-68b0-423a-9d5f-01d1e23494b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:01.388715 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1136a-68b0-423a-9d5f-01d1e23494b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:01.390379 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1136a-68b0-423a-9d5f-01d1e23494b5 service nova] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:01.400648 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1236/2465] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:01.826329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9145da-d1fe-4217-aa9f-e2cc91150cb9 service cinder] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:01.861420 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=100 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:01.893964 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9145da-d1fe-4217-aa9f-e2cc91150cb9 service cinder] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:01.899819 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ceea89-d07c-4bf1-bd20-7ce6d7552235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:01.900692 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ceea89-d07c-4bf1-bd20-7ce6d7552235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:01.900958 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ceea89-d07c-4bf1-bd20-7ce6d7552235 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:01.901228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ceea89-d07c-4bf1-bd20-7ce6d7552235 admin admin] PATH_INFO: `/v3/users/62c3e19820b94d0e9972ff461fd732e9` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:01.902505 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ceea89-d07c-4bf1-bd20-7ce6d7552235 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62c3e19820b94d0e9972ff461fd732e9)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:01.904469 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ceea89-d07c-4bf1-bd20-7ce6d7552235 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:01.958684 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-e0ceea89-d07c-4bf1-bd20-7ce6d7552235 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62c3e19820b94d0e9972ff461fd732e9'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:01.965567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-e0ceea89-d07c-4bf1-bd20-7ce6d7552235 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62c3e19820b94d0e9972ff461fd732e9'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:01.978407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-e0ceea89-d07c-4bf1-bd20-7ce6d7552235 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62c3e19820b94d0e9972ff461fd732e9'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:01.979126 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-e0ceea89-d07c-4bf1-bd20-7ce6d7552235 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62c3e19820b94d0e9972ff461fd732e9'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:01.979810 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-e0ceea89-d07c-4bf1-bd20-7ce6d7552235 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62c3e19820b94d0e9972ff461fd732e9'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:01.998127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1230/2466] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:54:01 2022] DELETE /identity/v3/users/62c3e19820b94d0e9972ff461fd732e9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:02.003551 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260156ff-51aa-4e51-8dc9-da25e9085406 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:02.004076 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260156ff-51aa-4e51-8dc9-da25e9085406 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:02.004558 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260156ff-51aa-4e51-8dc9-da25e9085406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:02.028151 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-260156ff-51aa-4e51-8dc9-da25e9085406 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:02.029300 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-260156ff-51aa-4e51-8dc9-da25e9085406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:02.098283 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1237/2467] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:54:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:02.110162 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ceea89-d07c-4bf1-bd20-7ce6d7552235 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:02.112768 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-e0ceea89-d07c-4bf1-bd20-7ce6d7552235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:02.177500 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ceea89-d07c-4bf1-bd20-7ce6d7552235 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:02.181413 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46d5a2-4135-4e77-8b35-f14646a1f2ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:02.182101 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46d5a2-4135-4e77-8b35-f14646a1f2ed service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:02.182382 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46d5a2-4135-4e77-8b35-f14646a1f2ed service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:02.182653 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46d5a2-4135-4e77-8b35-f14646a1f2ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:02.191916 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d46d5a2-4135-4e77-8b35-f14646a1f2ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:02.193377 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d46d5a2-4135-4e77-8b35-f14646a1f2ed service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:02.203556 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1231/2468] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:02.485447 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260156ff-51aa-4e51-8dc9-da25e9085406 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:02.487732 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-260156ff-51aa-4e51-8dc9-da25e9085406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:02.507260 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260156ff-51aa-4e51-8dc9-da25e9085406 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:02.515347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ad49a-e923-40c3-a885-5eadbffc8e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:02.516567 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ad49a-e923-40c3-a885-5eadbffc8e89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:02.516889 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ad49a-e923-40c3-a885-5eadbffc8e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:02.517202 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ad49a-e923-40c3-a885-5eadbffc8e89 admin admin] PATH_INFO: `/v3/projects/41234810a3ee4038bb821e69934688dc` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:02.518941 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18ad49a-e923-40c3-a885-5eadbffc8e89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41234810a3ee4038bb821e69934688dc)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:02.521749 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18ad49a-e923-40c3-a885-5eadbffc8e89 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:02.562520 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:02.575448 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c18ad49a-e923-40c3-a885-5eadbffc8e89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41234810a3ee4038bb821e69934688dc', 'request_id': 'req-c18ad49a-e923-40c3-a885-5eadbffc8e89'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:02.581017 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c18ad49a-e923-40c3-a885-5eadbffc8e89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41234810a3ee4038bb821e69934688dc', 'request_id': 'req-c18ad49a-e923-40c3-a885-5eadbffc8e89'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:02.589672 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c18ad49a-e923-40c3-a885-5eadbffc8e89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41234810a3ee4038bb821e69934688dc', 'request_id': 'req-c18ad49a-e923-40c3-a885-5eadbffc8e89'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:02.601273 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c18ad49a-e923-40c3-a885-5eadbffc8e89 admin admin] The token cache is being invalidate because project 41234810a3ee4038bb821e69934688dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:54:02.601562 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c18ad49a-e923-40c3-a885-5eadbffc8e89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:02.602248 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c18ad49a-e923-40c3-a885-5eadbffc8e89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:02.603823 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1238/2469] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:54:02 2022] DELETE /identity/v3/projects/41234810a3ee4038bb821e69934688dc => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:02.608106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46d5a2-4135-4e77-8b35-f14646a1f2ed service neutron] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:02.618051 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46d5a2-4135-4e77-8b35-f14646a1f2ed service neutron] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:02.681468 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:02.689779 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ade0d-8994-4f69-bbec-b9cc72bd9fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:02.690708 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ade0d-8994-4f69-bbec-b9cc72bd9fa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:02.690993 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ade0d-8994-4f69-bbec-b9cc72bd9fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:02.691279 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ade0d-8994-4f69-bbec-b9cc72bd9fa7 admin admin] PATH_INFO: `/v3/users/2277ab3576334493b72100a08a372a71` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:02.692821 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ade0d-8994-4f69-bbec-b9cc72bd9fa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2277ab3576334493b72100a08a372a71)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:02.695147 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ade0d-8994-4f69-bbec-b9cc72bd9fa7 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:02.743606 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-342ade0d-8994-4f69-bbec-b9cc72bd9fa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2277ab3576334493b72100a08a372a71'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:02.750692 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-342ade0d-8994-4f69-bbec-b9cc72bd9fa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2277ab3576334493b72100a08a372a71'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:02.763238 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-342ade0d-8994-4f69-bbec-b9cc72bd9fa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2277ab3576334493b72100a08a372a71'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:02.763944 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-342ade0d-8994-4f69-bbec-b9cc72bd9fa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2277ab3576334493b72100a08a372a71'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:02.764559 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-342ade0d-8994-4f69-bbec-b9cc72bd9fa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2277ab3576334493b72100a08a372a71'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:02.779190 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1232/2470] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:54:02 2022] DELETE /identity/v3/users/2277ab3576334493b72100a08a372a71 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:03.050645 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ad49a-e923-40c3-a885-5eadbffc8e89 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:03.052433 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-c18ad49a-e923-40c3-a885-5eadbffc8e89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:03.066655 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ad49a-e923-40c3-a885-5eadbffc8e89 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:03.124816 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24af7c-87a4-40ab-9896-42386a95df59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:03.125625 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24af7c-87a4-40ab-9896-42386a95df59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:03.125942 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24af7c-87a4-40ab-9896-42386a95df59 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:03.126224 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24af7c-87a4-40ab-9896-42386a95df59 admin admin] PATH_INFO: `/v3/projects/9f7488e438e942e28122977fa087cdf3` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:03.127419 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad24af7c-87a4-40ab-9896-42386a95df59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f7488e438e942e28122977fa087cdf3)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:03.129464 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad24af7c-87a4-40ab-9896-42386a95df59 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:03.180357 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-ad24af7c-87a4-40ab-9896-42386a95df59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f7488e438e942e28122977fa087cdf3', 'request_id': 'req-ad24af7c-87a4-40ab-9896-42386a95df59'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:03.187051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-ad24af7c-87a4-40ab-9896-42386a95df59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f7488e438e942e28122977fa087cdf3', 'request_id': 'req-ad24af7c-87a4-40ab-9896-42386a95df59'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:03.196703 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-ad24af7c-87a4-40ab-9896-42386a95df59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f7488e438e942e28122977fa087cdf3', 'request_id': 'req-ad24af7c-87a4-40ab-9896-42386a95df59'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:03.208197 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-ad24af7c-87a4-40ab-9896-42386a95df59 admin admin] The token cache is being invalidate because project 9f7488e438e942e28122977fa087cdf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:54:03.208486 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-ad24af7c-87a4-40ab-9896-42386a95df59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:03.209102 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-ad24af7c-87a4-40ab-9896-42386a95df59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:03.210823 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1239/2471] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:54:03 2022] DELETE /identity/v3/projects/9f7488e438e942e28122977fa087cdf3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:03.215803 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07af14-5813-4447-a096-5f55f021fcf2 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:03.216284 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07af14-5813-4447-a096-5f55f021fcf2 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:03.216493 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07af14-5813-4447-a096-5f55f021fcf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:03.236743 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-6c07af14-5813-4447-a096-5f55f021fcf2 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:03.238023 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-6c07af14-5813-4447-a096-5f55f021fcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:03.298266 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1233/2472] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:54:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:03.305987 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d087359-8c3c-490e-b4be-a8dc5127ce6a None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:03.306276 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d087359-8c3c-490e-b4be-a8dc5127ce6a None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:03.306552 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d087359-8c3c-490e-b4be-a8dc5127ce6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:03.325454 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-5d087359-8c3c-490e-b4be-a8dc5127ce6a None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:03.326765 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-5d087359-8c3c-490e-b4be-a8dc5127ce6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:03.335606 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1240/2473] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:54:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:03.339994 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07af14-5813-4447-a096-5f55f021fcf2 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:03.350290 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07af14-5813-4447-a096-5f55f021fcf2 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:03.355305 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc537c4-1d63-4239-9f1c-a6e918e939cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:03.355972 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc537c4-1d63-4239-9f1c-a6e918e939cb admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:03.356251 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc537c4-1d63-4239-9f1c-a6e918e939cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:03.356590 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc537c4-1d63-4239-9f1c-a6e918e939cb admin admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:03.357323 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc537c4-1d63-4239-9f1c-a6e918e939cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:54:03.357622 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc537c4-1d63-4239-9f1c-a6e918e939cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:03.359277 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc537c4-1d63-4239-9f1c-a6e918e939cb admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:03.371420 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1234/2474] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:54:03.375918 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d087359-8c3c-490e-b4be-a8dc5127ce6a None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:03.385392 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d087359-8c3c-490e-b4be-a8dc5127ce6a None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:03.390096 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241d90f-7ac5-4333-8cc7-1231c7358637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:03.390744 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241d90f-7ac5-4333-8cc7-1231c7358637 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:03.391021 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241d90f-7ac5-4333-8cc7-1231c7358637 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:03.391285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241d90f-7ac5-4333-8cc7-1231c7358637 admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:03.391960 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241d90f-7ac5-4333-8cc7-1231c7358637 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:03.393871 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241d90f-7ac5-4333-8cc7-1231c7358637 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:03.422592 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1241/2475] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:54:03 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:03.428160 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc537c4-1d63-4239-9f1c-a6e918e939cb admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:03.438540 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc537c4-1d63-4239-9f1c-a6e918e939cb admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:03.506174 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2db74f-a88e-4f11-8d0b-045d0a1a3e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:03.506837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2db74f-a88e-4f11-8d0b-045d0a1a3e0f admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:03.507133 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2db74f-a88e-4f11-8d0b-045d0a1a3e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:03.507389 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2db74f-a88e-4f11-8d0b-045d0a1a3e0f admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:03.508089 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2db74f-a88e-4f11-8d0b-045d0a1a3e0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:03.510040 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2db74f-a88e-4f11-8d0b-045d0a1a3e0f admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:03.517827 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:03.532485 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1235/2476] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:54:03 2022] POST /identity/v3/users => generated 291 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:54:03.536402 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241d90f-7ac5-4333-8cc7-1231c7358637 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:03.547041 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241d90f-7ac5-4333-8cc7-1231c7358637 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:03.551795 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22814e75-3b98-4f74-9aa3-b2ec9c479784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:03.552477 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22814e75-3b98-4f74-9aa3-b2ec9c479784 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:03.552754 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22814e75-3b98-4f74-9aa3-b2ec9c479784 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:03.553025 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22814e75-3b98-4f74-9aa3-b2ec9c479784 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:03.553737 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22814e75-3b98-4f74-9aa3-b2ec9c479784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:03.555418 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22814e75-3b98-4f74-9aa3-b2ec9c479784 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:03.569244 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1242/2477] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:54:03.570520 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2db74f-a88e-4f11-8d0b-045d0a1a3e0f admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:03.580645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2db74f-a88e-4f11-8d0b-045d0a1a3e0f admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:03.586420 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080c676-b747-4804-95c8-14469de490cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:03.587090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080c676-b747-4804-95c8-14469de490cb admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:03.587385 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080c676-b747-4804-95c8-14469de490cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:03.587655 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080c676-b747-4804-95c8-14469de490cb admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:03.588380 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5080c676-b747-4804-95c8-14469de490cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:03.590014 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5080c676-b747-4804-95c8-14469de490cb admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:03.604164 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1236/2478] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:03.605590 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22814e75-3b98-4f74-9aa3-b2ec9c479784 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:03.616221 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22814e75-3b98-4f74-9aa3-b2ec9c479784 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:03.621633 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518f496-ac0c-4902-ab78-7e7a1d5cb961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:03.622616 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518f496-ac0c-4902-ab78-7e7a1d5cb961 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:03.623444 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518f496-ac0c-4902-ab78-7e7a1d5cb961 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:03.623444 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518f496-ac0c-4902-ab78-7e7a1d5cb961 admin admin] PATH_INFO: `/v3/projects/06a8f32cae7b45a6bb1a323f93d948db/users/f616a23316f14af89692c61b37e8b40e/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:03.633194 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:03.641773 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518f496-ac0c-4902-ab78-7e7a1d5cb961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06a8f32cae7b45a6bb1a323f93d948db, user_id=f616a23316f14af89692c61b37e8b40e, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:03.645117 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518f496-ac0c-4902-ab78-7e7a1d5cb961 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:03.659707 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1243/2479] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:03 2022] PUT /identity/v3/projects/06a8f32cae7b45a6bb1a323f93d948db/users/f616a23316f14af89692c61b37e8b40e/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:03.671532 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7d59f-0c8e-4c21-868f-6713ec6d1118 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:03.671822 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7d59f-0c8e-4c21-868f-6713ec6d1118 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:03.676472 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7d59f-0c8e-4c21-868f-6713ec6d1118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:03.713492 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-33e7d59f-0c8e-4c21-868f-6713ec6d1118 None None] MFA Rules not processed for user `f616a23316f14af89692c61b37e8b40e`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:03.715247 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-33e7d59f-0c8e-4c21-868f-6713ec6d1118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:03.816699 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1237/2480] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:54:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:03.823369 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518f496-ac0c-4902-ab78-7e7a1d5cb961 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:03.936808 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518f496-ac0c-4902-ab78-7e7a1d5cb961 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:03.943174 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a04382-2ee7-4f61-bb23-02145a4faa4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:03.943883 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a04382-2ee7-4f61-bb23-02145a4faa4e admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:03.944316 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a04382-2ee7-4f61-bb23-02145a4faa4e admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:03.944594 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a04382-2ee7-4f61-bb23-02145a4faa4e admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:03.945549 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a04382-2ee7-4f61-bb23-02145a4faa4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:03.948168 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a04382-2ee7-4f61-bb23-02145a4faa4e admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:03.996295 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1244/2481] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:54:03 2022] POST /identity/v3/projects => generated 381 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:04.000766 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7d59f-0c8e-4c21-868f-6713ec6d1118 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:04.019409 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7d59f-0c8e-4c21-868f-6713ec6d1118 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:04.171488 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e22c11-acb6-4857-a286-ac11c074efc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:04.172359 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e22c11-acb6-4857-a286-ac11c074efc7 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:04.172844 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e22c11-acb6-4857-a286-ac11c074efc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:04.173101 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e22c11-acb6-4857-a286-ac11c074efc7 admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:04.173928 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e22c11-acb6-4857-a286-ac11c074efc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:04.176267 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e22c11-acb6-4857-a286-ac11c074efc7 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:04.218413 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1238/2482] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:54:03 2022] POST /identity/v3/users => generated 297 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:04.219647 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a04382-2ee7-4f61-bb23-02145a4faa4e admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:04.239337 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a04382-2ee7-4f61-bb23-02145a4faa4e admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:04.244579 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e106b7-43c0-4679-be72-5ad6d350670c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:04.245261 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e106b7-43c0-4679-be72-5ad6d350670c admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:04.245538 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e106b7-43c0-4679-be72-5ad6d350670c admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:04.245807 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e106b7-43c0-4679-be72-5ad6d350670c admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:04.246814 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e106b7-43c0-4679-be72-5ad6d350670c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:04.248427 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e106b7-43c0-4679-be72-5ad6d350670c admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:04.261710 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1245/2483] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:04.265940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e22c11-acb6-4857-a286-ac11c074efc7 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:04.278701 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e22c11-acb6-4857-a286-ac11c074efc7 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:04.286290 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a5570-10a2-4762-a73b-9c82fda0b042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:04.287203 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a5570-10a2-4762-a73b-9c82fda0b042 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:04.287960 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a5570-10a2-4762-a73b-9c82fda0b042 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:04.288245 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a5570-10a2-4762-a73b-9c82fda0b042 admin admin] PATH_INFO: `/v3/projects/6eff53a12659408c987a3c7c5688c38d/users/0b64dce11c33436c8f637bc0606c29ca/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:04.309371 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a5570-10a2-4762-a73b-9c82fda0b042 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eff53a12659408c987a3c7c5688c38d, user_id=0b64dce11c33436c8f637bc0606c29ca, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:04.314107 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a5570-10a2-4762-a73b-9c82fda0b042 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:04.338528 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1239/2484] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:04 2022] PUT /identity/v3/projects/6eff53a12659408c987a3c7c5688c38d/users/0b64dce11c33436c8f637bc0606c29ca/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:04.339719 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e106b7-43c0-4679-be72-5ad6d350670c admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:04.369876 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e106b7-43c0-4679-be72-5ad6d350670c admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:04.447977 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c27518-b69e-41d1-bdb4-a2a2018e308a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:04.448782 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c27518-b69e-41d1-bdb4-a2a2018e308a admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:04.449155 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c27518-b69e-41d1-bdb4-a2a2018e308a admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:04.449492 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c27518-b69e-41d1-bdb4-a2a2018e308a admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:04.450365 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c27518-b69e-41d1-bdb4-a2a2018e308a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:04.452049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c27518-b69e-41d1-bdb4-a2a2018e308a admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:04.465927 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1246/2485] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:04.468324 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a5570-10a2-4762-a73b-9c82fda0b042 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:04.480309 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a5570-10a2-4762-a73b-9c82fda0b042 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:04.485063 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658aca9f-47b4-42b3-808b-437a2df5705e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:04.486040 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658aca9f-47b4-42b3-808b-437a2df5705e admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:04.486320 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658aca9f-47b4-42b3-808b-437a2df5705e admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:04.486591 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658aca9f-47b4-42b3-808b-437a2df5705e admin admin] PATH_INFO: `/v3/projects/6eff53a12659408c987a3c7c5688c38d/users/0b64dce11c33436c8f637bc0606c29ca/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:04.488851 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658aca9f-47b4-42b3-808b-437a2df5705e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eff53a12659408c987a3c7c5688c38d, user_id=0b64dce11c33436c8f637bc0606c29ca, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:04.491716 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658aca9f-47b4-42b3-808b-437a2df5705e admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:04.504230 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1240/2486] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:04 2022] PUT /identity/v3/projects/6eff53a12659408c987a3c7c5688c38d/users/0b64dce11c33436c8f637bc0606c29ca/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:04.516564 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8c8e6-b756-4040-8dc8-190caa050237 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:04.516889 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8c8e6-b756-4040-8dc8-190caa050237 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:04.517120 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8c8e6-b756-4040-8dc8-190caa050237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:04.548201 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-f9a8c8e6-b756-4040-8dc8-190caa050237 None None] MFA Rules not processed for user `0b64dce11c33436c8f637bc0606c29ca`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:04.549253 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-f9a8c8e6-b756-4040-8dc8-190caa050237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:04.598518 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:04.627547 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1247/2487] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:54:04 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:04.641309 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658aca9f-47b4-42b3-808b-437a2df5705e admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:04.643420 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-658aca9f-47b4-42b3-808b-437a2df5705e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:04.680802 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:04.720892 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658aca9f-47b4-42b3-808b-437a2df5705e admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:04.724954 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb1b45-0812-4018-b381-0cc4256d1076 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:04.725620 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb1b45-0812-4018-b381-0cc4256d1076 service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:04.725928 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb1b45-0812-4018-b381-0cc4256d1076 service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:04.726205 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb1b45-0812-4018-b381-0cc4256d1076 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:04.736412 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb1b45-0812-4018-b381-0cc4256d1076 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:04.738003 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb1b45-0812-4018-b381-0cc4256d1076 service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:04.749638 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1241/2488] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:04 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:04.821303 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8c8e6-b756-4040-8dc8-190caa050237 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:04.831124 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8c8e6-b756-4040-8dc8-190caa050237 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:04.834758 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae27cb-b9f7-41ee-ad1a-023bbba2db85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:04.835396 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae27cb-b9f7-41ee-ad1a-023bbba2db85 service cinder] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:04.835668 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae27cb-b9f7-41ee-ad1a-023bbba2db85 service cinder] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:04.835942 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae27cb-b9f7-41ee-ad1a-023bbba2db85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:04.898995 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae27cb-b9f7-41ee-ad1a-023bbba2db85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:04.899485 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae27cb-b9f7-41ee-ad1a-023bbba2db85 service cinder] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:04.909200 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1248/2489] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:05.180401 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb1b45-0812-4018-b381-0cc4256d1076 service cinder] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:05.244940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb1b45-0812-4018-b381-0cc4256d1076 service cinder] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:05.250619 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf2c2a-2a07-48e4-b4a2-0b7d62481c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:05.251649 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf2c2a-2a07-48e4-b4a2-0b7d62481c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:05.251939 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf2c2a-2a07-48e4-b4a2-0b7d62481c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:05.252213 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf2c2a-2a07-48e4-b4a2-0b7d62481c67 admin admin] PATH_INFO: `/v3/users/f616a23316f14af89692c61b37e8b40e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:05.253490 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf2c2a-2a07-48e4-b4a2-0b7d62481c67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f616a23316f14af89692c61b37e8b40e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:05.255574 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf2c2a-2a07-48e4-b4a2-0b7d62481c67 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:05.305498 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-96bf2c2a-2a07-48e4-b4a2-0b7d62481c67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f616a23316f14af89692c61b37e8b40e'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:05.312446 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-96bf2c2a-2a07-48e4-b4a2-0b7d62481c67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f616a23316f14af89692c61b37e8b40e'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:05.329811 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-96bf2c2a-2a07-48e4-b4a2-0b7d62481c67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f616a23316f14af89692c61b37e8b40e'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:05.330884 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-96bf2c2a-2a07-48e4-b4a2-0b7d62481c67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f616a23316f14af89692c61b37e8b40e'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:05.331304 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-96bf2c2a-2a07-48e4-b4a2-0b7d62481c67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f616a23316f14af89692c61b37e8b40e'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:05.347329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1242/2490] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:54:05 2022] DELETE /identity/v3/users/f616a23316f14af89692c61b37e8b40e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:05.352232 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ae01e-ccde-40de-950b-f300f3f69823 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:05.352525 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ae01e-ccde-40de-950b-f300f3f69823 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:05.352807 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ae01e-ccde-40de-950b-f300f3f69823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:05.383258 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-ee9ae01e-ccde-40de-950b-f300f3f69823 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:05.385507 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-ee9ae01e-ccde-40de-950b-f300f3f69823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:05.457940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf2c2a-2a07-48e4-b4a2-0b7d62481c67 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:05.461114 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-96bf2c2a-2a07-48e4-b4a2-0b7d62481c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:05.468726 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1249/2491] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:54:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:05.482368 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ae01e-ccde-40de-950b-f300f3f69823 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:05.484285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-ee9ae01e-ccde-40de-950b-f300f3f69823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:05.523181 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:05.540664 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf2c2a-2a07-48e4-b4a2-0b7d62481c67 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:05.546771 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecc1ec-8f7b-47dc-b04a-30cc48c2fe35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:05.547794 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecc1ec-8f7b-47dc-b04a-30cc48c2fe35 service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:05.548172 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecc1ec-8f7b-47dc-b04a-30cc48c2fe35 service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:05.548468 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecc1ec-8f7b-47dc-b04a-30cc48c2fe35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:05.551343 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-8fecc1ec-8f7b-47dc-b04a-30cc48c2fe35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:05.564976 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ae01e-ccde-40de-950b-f300f3f69823 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:05.567791 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fecc1ec-8f7b-47dc-b04a-30cc48c2fe35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:05.569555 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b831ddc-15b9-4202-91ed-f8ac24dae2a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:05.570271 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b831ddc-15b9-4202-91ed-f8ac24dae2a6 service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:05.570566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fecc1ec-8f7b-47dc-b04a-30cc48c2fe35 service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:05.571342 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b831ddc-15b9-4202-91ed-f8ac24dae2a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:05.571342 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b831ddc-15b9-4202-91ed-f8ac24dae2a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:05.587161 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b831ddc-15b9-4202-91ed-f8ac24dae2a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:05.588805 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b831ddc-15b9-4202-91ed-f8ac24dae2a6 service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:05.596116 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1243/2492] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:54:05.607745 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1250/2493] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:54:05.987710 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecc1ec-8f7b-47dc-b04a-30cc48c2fe35 service neutron] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:05.991873 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-8fecc1ec-8f7b-47dc-b04a-30cc48c2fe35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:06.008791 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecc1ec-8f7b-47dc-b04a-30cc48c2fe35 service neutron] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:06.013635 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700f2b7-2835-4047-9672-62fd2c86aa12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:06.014684 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700f2b7-2835-4047-9672-62fd2c86aa12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:06.015086 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700f2b7-2835-4047-9672-62fd2c86aa12 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:06.016068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700f2b7-2835-4047-9672-62fd2c86aa12 admin admin] PATH_INFO: `/v3/projects/06a8f32cae7b45a6bb1a323f93d948db` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:06.016925 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700f2b7-2835-4047-9672-62fd2c86aa12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06a8f32cae7b45a6bb1a323f93d948db)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:06.019033 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700f2b7-2835-4047-9672-62fd2c86aa12 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:06.086020 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-a700f2b7-2835-4047-9672-62fd2c86aa12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06a8f32cae7b45a6bb1a323f93d948db', 'request_id': 'req-a700f2b7-2835-4047-9672-62fd2c86aa12'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:06.092770 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-a700f2b7-2835-4047-9672-62fd2c86aa12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06a8f32cae7b45a6bb1a323f93d948db', 'request_id': 'req-a700f2b7-2835-4047-9672-62fd2c86aa12'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:06.101924 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-a700f2b7-2835-4047-9672-62fd2c86aa12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06a8f32cae7b45a6bb1a323f93d948db', 'request_id': 'req-a700f2b7-2835-4047-9672-62fd2c86aa12'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:06.117869 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-a700f2b7-2835-4047-9672-62fd2c86aa12 admin admin] The token cache is being invalidate because project 06a8f32cae7b45a6bb1a323f93d948db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:54:06.118071 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-a700f2b7-2835-4047-9672-62fd2c86aa12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:06.118883 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-a700f2b7-2835-4047-9672-62fd2c86aa12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:06.120601 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1244/2494] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:54:05 2022] DELETE /identity/v3/projects/06a8f32cae7b45a6bb1a323f93d948db => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:06.125019 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b831ddc-15b9-4202-91ed-f8ac24dae2a6 service neutron] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:06.135319 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b831ddc-15b9-4202-91ed-f8ac24dae2a6 service neutron] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:06.164811 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:06.210382 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9574f52-42ae-4b1c-987c-d4e7cbe6e864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:06.211293 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9574f52-42ae-4b1c-987c-d4e7cbe6e864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:06.211573 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9574f52-42ae-4b1c-987c-d4e7cbe6e864 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:06.211846 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9574f52-42ae-4b1c-987c-d4e7cbe6e864 admin admin] PATH_INFO: `/v3/users/0b64dce11c33436c8f637bc0606c29ca` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:06.213040 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9574f52-42ae-4b1c-987c-d4e7cbe6e864 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b64dce11c33436c8f637bc0606c29ca)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:06.215013 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9574f52-42ae-4b1c-987c-d4e7cbe6e864 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:06.274791 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-b9574f52-42ae-4b1c-987c-d4e7cbe6e864 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b64dce11c33436c8f637bc0606c29ca'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:06.294963 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-b9574f52-42ae-4b1c-987c-d4e7cbe6e864 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b64dce11c33436c8f637bc0606c29ca'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:06.304051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-b9574f52-42ae-4b1c-987c-d4e7cbe6e864 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b64dce11c33436c8f637bc0606c29ca'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:06.304798 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-b9574f52-42ae-4b1c-987c-d4e7cbe6e864 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b64dce11c33436c8f637bc0606c29ca'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:06.305544 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-b9574f52-42ae-4b1c-987c-d4e7cbe6e864 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b64dce11c33436c8f637bc0606c29ca'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:06.329890 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1251/2495] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:54:06 2022] DELETE /identity/v3/users/0b64dce11c33436c8f637bc0606c29ca => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:06.634799 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700f2b7-2835-4047-9672-62fd2c86aa12 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:06.636801 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-a700f2b7-2835-4047-9672-62fd2c86aa12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:06.652766 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700f2b7-2835-4047-9672-62fd2c86aa12 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:06.718679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68fa12-5f2a-4b59-b4ae-e213bfb6b62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:06.719549 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68fa12-5f2a-4b59-b4ae-e213bfb6b62d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:06.719828 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68fa12-5f2a-4b59-b4ae-e213bfb6b62d admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:06.720100 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68fa12-5f2a-4b59-b4ae-e213bfb6b62d admin admin] PATH_INFO: `/v3/projects/6eff53a12659408c987a3c7c5688c38d` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:06.721267 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68fa12-5f2a-4b59-b4ae-e213bfb6b62d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eff53a12659408c987a3c7c5688c38d)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:06.723254 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68fa12-5f2a-4b59-b4ae-e213bfb6b62d admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:06.773569 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-8d68fa12-5f2a-4b59-b4ae-e213bfb6b62d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eff53a12659408c987a3c7c5688c38d', 'request_id': 'req-8d68fa12-5f2a-4b59-b4ae-e213bfb6b62d'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:06.779304 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-8d68fa12-5f2a-4b59-b4ae-e213bfb6b62d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eff53a12659408c987a3c7c5688c38d', 'request_id': 'req-8d68fa12-5f2a-4b59-b4ae-e213bfb6b62d'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:06.790170 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-8d68fa12-5f2a-4b59-b4ae-e213bfb6b62d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eff53a12659408c987a3c7c5688c38d', 'request_id': 'req-8d68fa12-5f2a-4b59-b4ae-e213bfb6b62d'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:06.800414 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:06.804592 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-8d68fa12-5f2a-4b59-b4ae-e213bfb6b62d admin admin] The token cache is being invalidate because project 6eff53a12659408c987a3c7c5688c38d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:54:06.805149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-8d68fa12-5f2a-4b59-b4ae-e213bfb6b62d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:06.806247 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-8d68fa12-5f2a-4b59-b4ae-e213bfb6b62d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:06.807878 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1245/2496] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:54:06 2022] DELETE /identity/v3/projects/6eff53a12659408c987a3c7c5688c38d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:06.813109 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48937130-13da-4efe-be9f-69a84c8345b7 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:06.813578 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48937130-13da-4efe-be9f-69a84c8345b7 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:06.813674 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48937130-13da-4efe-be9f-69a84c8345b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:06.835635 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-48937130-13da-4efe-be9f-69a84c8345b7 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:06.837118 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-48937130-13da-4efe-be9f-69a84c8345b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:06.904803 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1252/2497] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:06.912988 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd99fe0-1e2d-4401-a7f8-cfc5342a33d4 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:06.913277 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd99fe0-1e2d-4401-a7f8-cfc5342a33d4 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:06.913553 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd99fe0-1e2d-4401-a7f8-cfc5342a33d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:06.932996 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-bcd99fe0-1e2d-4401-a7f8-cfc5342a33d4 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:06.934239 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-bcd99fe0-1e2d-4401-a7f8-cfc5342a33d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:06.942147 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1246/2498] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:54:06.946360 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48937130-13da-4efe-be9f-69a84c8345b7 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:06.956141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48937130-13da-4efe-be9f-69a84c8345b7 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:06.961707 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db601d0a-e5e9-44d7-9576-45eeb2f5ac72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:06.962426 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db601d0a-e5e9-44d7-9576-45eeb2f5ac72 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:06.962704 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db601d0a-e5e9-44d7-9576-45eeb2f5ac72 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:06.962971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db601d0a-e5e9-44d7-9576-45eeb2f5ac72 admin admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:06.963734 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db601d0a-e5e9-44d7-9576-45eeb2f5ac72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:54:06.964200 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db601d0a-e5e9-44d7-9576-45eeb2f5ac72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:06.965809 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db601d0a-e5e9-44d7-9576-45eeb2f5ac72 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:06.978015 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1253/2499] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:54:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:54:06.982463 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd99fe0-1e2d-4401-a7f8-cfc5342a33d4 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:06.992386 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd99fe0-1e2d-4401-a7f8-cfc5342a33d4 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:06.997447 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad55b87-c032-4e20-868b-01e96dcb5c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:06.998010 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad55b87-c032-4e20-868b-01e96dcb5c7d admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:06.998289 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad55b87-c032-4e20-868b-01e96dcb5c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:06.998577 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad55b87-c032-4e20-868b-01e96dcb5c7d admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:06.999253 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad55b87-c032-4e20-868b-01e96dcb5c7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:07.001171 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad55b87-c032-4e20-868b-01e96dcb5c7d admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:07.032497 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1247/2500] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:54:06 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:54:07.034294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db601d0a-e5e9-44d7-9576-45eeb2f5ac72 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:07.046199 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db601d0a-e5e9-44d7-9576-45eeb2f5ac72 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:07.078961 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:07.109715 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c8da6-935e-4fc3-be7e-4040463784ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:07.110403 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c8da6-935e-4fc3-be7e-4040463784ab admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:07.110683 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c8da6-935e-4fc3-be7e-4040463784ab admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:07.110951 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c8da6-935e-4fc3-be7e-4040463784ab admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:07.111645 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c8da6-935e-4fc3-be7e-4040463784ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:07.113545 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c8da6-935e-4fc3-be7e-4040463784ab admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:07.136328 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1254/2501] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:54:07 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:54:07.141227 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad55b87-c032-4e20-868b-01e96dcb5c7d admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:07.160502 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad55b87-c032-4e20-868b-01e96dcb5c7d admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:07.166624 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e97d5-1d11-4d30-b471-925579ca058c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:07.167290 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e97d5-1d11-4d30-b471-925579ca058c admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:07.167564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e97d5-1d11-4d30-b471-925579ca058c admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:07.167835 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e97d5-1d11-4d30-b471-925579ca058c admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:07.168568 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e97d5-1d11-4d30-b471-925579ca058c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:07.170380 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e97d5-1d11-4d30-b471-925579ca058c admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:07.183208 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1248/2502] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:07.187301 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c8da6-935e-4fc3-be7e-4040463784ab admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:07.198073 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c8da6-935e-4fc3-be7e-4040463784ab admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:07.202902 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ebcb9-f74e-4c5d-83e4-bd8c036f880c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:07.203571 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ebcb9-f74e-4c5d-83e4-bd8c036f880c admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:07.203849 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ebcb9-f74e-4c5d-83e4-bd8c036f880c admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:07.204126 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ebcb9-f74e-4c5d-83e4-bd8c036f880c admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:07.204850 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ebcb9-f74e-4c5d-83e4-bd8c036f880c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:07.206650 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ebcb9-f74e-4c5d-83e4-bd8c036f880c admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:07.220291 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1255/2503] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:07.224814 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e97d5-1d11-4d30-b471-925579ca058c admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:07.235235 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e97d5-1d11-4d30-b471-925579ca058c admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:07.240951 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20666a3f-9259-49e1-81cf-5a0ab9bce5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:07.241869 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20666a3f-9259-49e1-81cf-5a0ab9bce5e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:07.242136 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20666a3f-9259-49e1-81cf-5a0ab9bce5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:07.242421 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20666a3f-9259-49e1-81cf-5a0ab9bce5e8 admin admin] PATH_INFO: `/v3/projects/411d82433fa840c5b59011329a4973c9/users/18ca999c68e247c0a705606bc5a457cf/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:07.258758 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20666a3f-9259-49e1-81cf-5a0ab9bce5e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=411d82433fa840c5b59011329a4973c9, user_id=18ca999c68e247c0a705606bc5a457cf, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:07.261397 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20666a3f-9259-49e1-81cf-5a0ab9bce5e8 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:07.276572 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1249/2504] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:07 2022] PUT /identity/v3/projects/411d82433fa840c5b59011329a4973c9/users/18ca999c68e247c0a705606bc5a457cf/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:07.287392 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b8a59-7ad9-411f-ad43-0a4f2e7bca2d None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:07.287713 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b8a59-7ad9-411f-ad43-0a4f2e7bca2d None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:07.287990 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b8a59-7ad9-411f-ad43-0a4f2e7bca2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:07.314851 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-0c5b8a59-7ad9-411f-ad43-0a4f2e7bca2d None None] MFA Rules not processed for user `18ca999c68e247c0a705606bc5a457cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:07.316100 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-0c5b8a59-7ad9-411f-ad43-0a4f2e7bca2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:07.379029 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1256/2505] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:54:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:07.390321 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20666a3f-9259-49e1-81cf-5a0ab9bce5e8 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:07.392028 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-20666a3f-9259-49e1-81cf-5a0ab9bce5e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:07.450475 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20666a3f-9259-49e1-81cf-5a0ab9bce5e8 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:07.454440 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb1853-b881-4a4e-a8c7-7b1b76438dbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:07.455072 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb1853-b881-4a4e-a8c7-7b1b76438dbe service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:07.455346 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb1853-b881-4a4e-a8c7-7b1b76438dbe service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:07.455615 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb1853-b881-4a4e-a8c7-7b1b76438dbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:07.464095 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb1853-b881-4a4e-a8c7-7b1b76438dbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:07.465532 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb1853-b881-4a4e-a8c7-7b1b76438dbe service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:07.474319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1250/2506] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:07.493875 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b8a59-7ad9-411f-ad43-0a4f2e7bca2d None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:07.560516 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b8a59-7ad9-411f-ad43-0a4f2e7bca2d None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:07.565569 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1268c3-a042-48d8-8997-6898022fa8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:07.566564 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1268c3-a042-48d8-8997-6898022fa8a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:07.566840 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1268c3-a042-48d8-8997-6898022fa8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:07.567111 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1268c3-a042-48d8-8997-6898022fa8a0 admin admin] PATH_INFO: `/v3/users/18ca999c68e247c0a705606bc5a457cf` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:07.568443 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1268c3-a042-48d8-8997-6898022fa8a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18ca999c68e247c0a705606bc5a457cf)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:07.570427 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1268c3-a042-48d8-8997-6898022fa8a0 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:07.616959 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:07.622534 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-af1268c3-a042-48d8-8997-6898022fa8a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18ca999c68e247c0a705606bc5a457cf'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:07.635101 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-af1268c3-a042-48d8-8997-6898022fa8a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18ca999c68e247c0a705606bc5a457cf'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:07.642639 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-af1268c3-a042-48d8-8997-6898022fa8a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18ca999c68e247c0a705606bc5a457cf'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:07.643411 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-af1268c3-a042-48d8-8997-6898022fa8a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18ca999c68e247c0a705606bc5a457cf'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:07.644183 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-af1268c3-a042-48d8-8997-6898022fa8a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18ca999c68e247c0a705606bc5a457cf'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:07.662228 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1257/2507] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:54:07 2022] DELETE /identity/v3/users/18ca999c68e247c0a705606bc5a457cf => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:07.666857 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc38e0b-ac98-4580-a12f-83d57a57db79 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:07.667338 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc38e0b-ac98-4580-a12f-83d57a57db79 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:07.667338 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc38e0b-ac98-4580-a12f-83d57a57db79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:07.685827 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-7dc38e0b-ac98-4580-a12f-83d57a57db79 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:07.687063 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-7dc38e0b-ac98-4580-a12f-83d57a57db79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:07.749304 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1251/2508] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:54:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:07.759311 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1268c3-a042-48d8-8997-6898022fa8a0 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:07.760906 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-af1268c3-a042-48d8-8997-6898022fa8a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:07.819929 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1268c3-a042-48d8-8997-6898022fa8a0 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:07.824074 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a8db2-9a8a-4f4b-8c52-88807453d3a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:07.824721 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a8db2-9a8a-4f4b-8c52-88807453d3a8 service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:07.824978 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a8db2-9a8a-4f4b-8c52-88807453d3a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:07.825281 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a8db2-9a8a-4f4b-8c52-88807453d3a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:07.841131 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a8db2-9a8a-4f4b-8c52-88807453d3a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:07.843502 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a8db2-9a8a-4f4b-8c52-88807453d3a8 service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:07.855106 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1258/2509] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:08.135665 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc38e0b-ac98-4580-a12f-83d57a57db79 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:08.137274 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-7dc38e0b-ac98-4580-a12f-83d57a57db79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:08.164579 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc38e0b-ac98-4580-a12f-83d57a57db79 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:08.170764 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975a0e2-eb9d-47e7-b447-a19039e5e461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:08.171650 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975a0e2-eb9d-47e7-b447-a19039e5e461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:08.171933 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975a0e2-eb9d-47e7-b447-a19039e5e461 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:08.172209 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975a0e2-eb9d-47e7-b447-a19039e5e461 admin admin] PATH_INFO: `/v3/projects/411d82433fa840c5b59011329a4973c9` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:08.173405 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975a0e2-eb9d-47e7-b447-a19039e5e461 admin admin] RBAC: Authorizing `identity:delete_project(project_id=411d82433fa840c5b59011329a4973c9)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:08.177246 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975a0e2-eb9d-47e7-b447-a19039e5e461 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:08.221505 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:08.233737 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-4975a0e2-eb9d-47e7-b447-a19039e5e461 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '411d82433fa840c5b59011329a4973c9', 'request_id': 'req-4975a0e2-eb9d-47e7-b447-a19039e5e461'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:08.239211 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-4975a0e2-eb9d-47e7-b447-a19039e5e461 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '411d82433fa840c5b59011329a4973c9', 'request_id': 'req-4975a0e2-eb9d-47e7-b447-a19039e5e461'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:08.247647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-4975a0e2-eb9d-47e7-b447-a19039e5e461 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '411d82433fa840c5b59011329a4973c9', 'request_id': 'req-4975a0e2-eb9d-47e7-b447-a19039e5e461'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:08.260346 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-4975a0e2-eb9d-47e7-b447-a19039e5e461 admin admin] The token cache is being invalidate because project 411d82433fa840c5b59011329a4973c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:54:08.260634 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-4975a0e2-eb9d-47e7-b447-a19039e5e461 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:08.261305 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-4975a0e2-eb9d-47e7-b447-a19039e5e461 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:08.262976 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1252/2510] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:54:08 2022] DELETE /identity/v3/projects/411d82433fa840c5b59011329a4973c9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:08.269383 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d2080-b3a9-43de-ae3b-b6c346a88d4c None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:08.269667 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d2080-b3a9-43de-ae3b-b6c346a88d4c None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:08.270001 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d2080-b3a9-43de-ae3b-b6c346a88d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:08.289248 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-803d2080-b3a9-43de-ae3b-b6c346a88d4c None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:08.290475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-803d2080-b3a9-43de-ae3b-b6c346a88d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:08.356400 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1259/2511] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:54:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:08.423937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d777e4c-494f-459b-b873-a7dc4fb2568a None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:08.424191 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d777e4c-494f-459b-b873-a7dc4fb2568a None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:08.424493 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d777e4c-494f-459b-b873-a7dc4fb2568a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:08.443503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-3d777e4c-494f-459b-b873-a7dc4fb2568a None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:08.444826 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-3d777e4c-494f-459b-b873-a7dc4fb2568a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:08.453489 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1253/2512] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:54:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:08.457873 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d2080-b3a9-43de-ae3b-b6c346a88d4c None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:08.468775 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d2080-b3a9-43de-ae3b-b6c346a88d4c None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:08.473968 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee132c-59e7-420f-9546-931047d419a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:08.474657 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee132c-59e7-420f-9546-931047d419a9 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:08.474937 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee132c-59e7-420f-9546-931047d419a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:08.475211 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee132c-59e7-420f-9546-931047d419a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:08.475963 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee132c-59e7-420f-9546-931047d419a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:54:08.476284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee132c-59e7-420f-9546-931047d419a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:08.477943 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee132c-59e7-420f-9546-931047d419a9 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:08.497106 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1260/2513] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:54:08.501915 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d777e4c-494f-459b-b873-a7dc4fb2568a None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:08.512095 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d777e4c-494f-459b-b873-a7dc4fb2568a None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:08.517509 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffae17b-d098-4626-8c5a-dcae31c4aa47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:08.518241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffae17b-d098-4626-8c5a-dcae31c4aa47 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:08.518518 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffae17b-d098-4626-8c5a-dcae31c4aa47 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:08.518793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffae17b-d098-4626-8c5a-dcae31c4aa47 admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:08.519542 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffae17b-d098-4626-8c5a-dcae31c4aa47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:08.521525 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffae17b-d098-4626-8c5a-dcae31c4aa47 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:08.553954 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1254/2514] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:54:08 2022] POST /identity/v3/projects => generated 361 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:54:08.558417 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee132c-59e7-420f-9546-931047d419a9 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:08.569225 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee132c-59e7-420f-9546-931047d419a9 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:08.617654 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:08.634605 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fd2d9-8c7b-4534-9995-7e65fcc9f383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:08.635276 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fd2d9-8c7b-4534-9995-7e65fcc9f383 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:08.635569 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fd2d9-8c7b-4534-9995-7e65fcc9f383 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:08.635954 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fd2d9-8c7b-4534-9995-7e65fcc9f383 admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:08.636653 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953fd2d9-8c7b-4534-9995-7e65fcc9f383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:08.638658 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953fd2d9-8c7b-4534-9995-7e65fcc9f383 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:08.659022 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1261/2515] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:54:08 2022] POST /identity/v3/users => generated 281 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:08.663307 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffae17b-d098-4626-8c5a-dcae31c4aa47 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:08.674141 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffae17b-d098-4626-8c5a-dcae31c4aa47 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:08.679907 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c487fa-de5a-43f3-9624-3c9fa922d73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:08.680629 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c487fa-de5a-43f3-9624-3c9fa922d73b admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:08.680911 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c487fa-de5a-43f3-9624-3c9fa922d73b admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:08.681187 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c487fa-de5a-43f3-9624-3c9fa922d73b admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:08.681943 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c487fa-de5a-43f3-9624-3c9fa922d73b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:08.683588 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c487fa-de5a-43f3-9624-3c9fa922d73b admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:08.694718 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1255/2516] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:08.698778 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fd2d9-8c7b-4534-9995-7e65fcc9f383 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:08.709485 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fd2d9-8c7b-4534-9995-7e65fcc9f383 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:08.715379 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e43cba3-0b6c-4aab-b743-69023980cac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:08.716040 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43cba3-0b6c-4aab-b743-69023980cac1 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:08.716320 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43cba3-0b6c-4aab-b743-69023980cac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:08.716585 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43cba3-0b6c-4aab-b743-69023980cac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:08.717305 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e43cba3-0b6c-4aab-b743-69023980cac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:08.718938 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e43cba3-0b6c-4aab-b743-69023980cac1 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:08.729633 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1262/2517] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:08.734012 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c487fa-de5a-43f3-9624-3c9fa922d73b admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:08.744462 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c487fa-de5a-43f3-9624-3c9fa922d73b admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:08.749179 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b163d-ac6f-4ca4-bb0a-8187c8174246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:08.750082 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b163d-ac6f-4ca4-bb0a-8187c8174246 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:08.750359 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b163d-ac6f-4ca4-bb0a-8187c8174246 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:08.750629 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b163d-ac6f-4ca4-bb0a-8187c8174246 admin admin] PATH_INFO: `/v3/projects/7a9987c9058249b3841f41b0b2f4ba32/users/0fedfb5da18c4d7a84508a34ce766cdc/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:08.765254 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b163d-ac6f-4ca4-bb0a-8187c8174246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a9987c9058249b3841f41b0b2f4ba32, user_id=0fedfb5da18c4d7a84508a34ce766cdc, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:08.768012 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b163d-ac6f-4ca4-bb0a-8187c8174246 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:08.783605 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1256/2518] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:08 2022] PUT /identity/v3/projects/7a9987c9058249b3841f41b0b2f4ba32/users/0fedfb5da18c4d7a84508a34ce766cdc/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:08.793872 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731dcb4-7b74-4557-bbbd-bdf002dae855 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:08.794163 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731dcb4-7b74-4557-bbbd-bdf002dae855 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:08.794438 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731dcb4-7b74-4557-bbbd-bdf002dae855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:08.822091 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-6731dcb4-7b74-4557-bbbd-bdf002dae855 None None] MFA Rules not processed for user `0fedfb5da18c4d7a84508a34ce766cdc`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:08.823307 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-6731dcb4-7b74-4557-bbbd-bdf002dae855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:08.897632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1263/2519] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:54:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:08.929060 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b163d-ac6f-4ca4-bb0a-8187c8174246 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:08.931175 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-ff3b163d-ac6f-4ca4-bb0a-8187c8174246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:08.992952 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b163d-ac6f-4ca4-bb0a-8187c8174246 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:08.996984 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91765985-375b-4465-8cb3-384db7dbf836 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:08.997633 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91765985-375b-4465-8cb3-384db7dbf836 service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:08.997958 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91765985-375b-4465-8cb3-384db7dbf836 service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:08.998231 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91765985-375b-4465-8cb3-384db7dbf836 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:09.007567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91765985-375b-4465-8cb3-384db7dbf836 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:09.009025 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91765985-375b-4465-8cb3-384db7dbf836 service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:09.018389 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1257/2520] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:09.033151 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731dcb4-7b74-4557-bbbd-bdf002dae855 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:09.100213 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731dcb4-7b74-4557-bbbd-bdf002dae855 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:09.105154 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d297387-2152-4387-adc8-e22a070d98db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:09.106062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d297387-2152-4387-adc8-e22a070d98db admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:09.106340 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d297387-2152-4387-adc8-e22a070d98db admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:09.106616 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d297387-2152-4387-adc8-e22a070d98db admin admin] PATH_INFO: `/v3/users/0fedfb5da18c4d7a84508a34ce766cdc` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:09.107823 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d297387-2152-4387-adc8-e22a070d98db admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fedfb5da18c4d7a84508a34ce766cdc)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:09.109765 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d297387-2152-4387-adc8-e22a070d98db admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:09.161516 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-3d297387-2152-4387-adc8-e22a070d98db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fedfb5da18c4d7a84508a34ce766cdc'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:09.169176 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:09.174314 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-3d297387-2152-4387-adc8-e22a070d98db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fedfb5da18c4d7a84508a34ce766cdc'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:09.183244 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-3d297387-2152-4387-adc8-e22a070d98db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fedfb5da18c4d7a84508a34ce766cdc'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:09.185186 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-3d297387-2152-4387-adc8-e22a070d98db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fedfb5da18c4d7a84508a34ce766cdc'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:09.185186 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-3d297387-2152-4387-adc8-e22a070d98db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fedfb5da18c4d7a84508a34ce766cdc'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:09.198859 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1264/2521] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:54:09 2022] DELETE /identity/v3/users/0fedfb5da18c4d7a84508a34ce766cdc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:09.203507 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71804e-5a94-48c2-b778-804b00a16568 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:09.203794 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71804e-5a94-48c2-b778-804b00a16568 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:09.204070 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71804e-5a94-48c2-b778-804b00a16568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:09.221905 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-5a71804e-5a94-48c2-b778-804b00a16568 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:09.223210 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-5a71804e-5a94-48c2-b778-804b00a16568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:09.287250 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1258/2522] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:54:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:54:09.297056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d297387-2152-4387-adc8-e22a070d98db admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:09.298653 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-3d297387-2152-4387-adc8-e22a070d98db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:09.358189 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d297387-2152-4387-adc8-e22a070d98db admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:09.361686 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3085e-d2b1-4ff3-8a3c-7c9c9ed32117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:09.362368 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3085e-d2b1-4ff3-8a3c-7c9c9ed32117 service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:09.362931 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3085e-d2b1-4ff3-8a3c-7c9c9ed32117 service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:09.362931 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3085e-d2b1-4ff3-8a3c-7c9c9ed32117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:09.372122 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3085e-d2b1-4ff3-8a3c-7c9c9ed32117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:09.373578 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3085e-d2b1-4ff3-8a3c-7c9c9ed32117 service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:09.383390 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1265/2523] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:09.646579 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71804e-5a94-48c2-b778-804b00a16568 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:09.648143 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-5a71804e-5a94-48c2-b778-804b00a16568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:09.655121 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:09.661017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71804e-5a94-48c2-b778-804b00a16568 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:09.666826 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb239e46-979b-4c46-9a19-f233a3a3bb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:09.668026 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb239e46-979b-4c46-9a19-f233a3a3bb23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:09.668378 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb239e46-979b-4c46-9a19-f233a3a3bb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:09.668739 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb239e46-979b-4c46-9a19-f233a3a3bb23 admin admin] PATH_INFO: `/v3/projects/7a9987c9058249b3841f41b0b2f4ba32` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:09.670577 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb239e46-979b-4c46-9a19-f233a3a3bb23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a9987c9058249b3841f41b0b2f4ba32)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:09.672519 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb239e46-979b-4c46-9a19-f233a3a3bb23 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:09.725254 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-fb239e46-979b-4c46-9a19-f233a3a3bb23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a9987c9058249b3841f41b0b2f4ba32', 'request_id': 'req-fb239e46-979b-4c46-9a19-f233a3a3bb23'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:09.730864 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-fb239e46-979b-4c46-9a19-f233a3a3bb23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a9987c9058249b3841f41b0b2f4ba32', 'request_id': 'req-fb239e46-979b-4c46-9a19-f233a3a3bb23'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:09.738780 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-fb239e46-979b-4c46-9a19-f233a3a3bb23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a9987c9058249b3841f41b0b2f4ba32', 'request_id': 'req-fb239e46-979b-4c46-9a19-f233a3a3bb23'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:09.749689 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-fb239e46-979b-4c46-9a19-f233a3a3bb23 admin admin] The token cache is being invalidate because project 7a9987c9058249b3841f41b0b2f4ba32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:54:09.750004 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-fb239e46-979b-4c46-9a19-f233a3a3bb23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:09.750621 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-fb239e46-979b-4c46-9a19-f233a3a3bb23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:09.752199 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1259/2524] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:54:09 2022] DELETE /identity/v3/projects/7a9987c9058249b3841f41b0b2f4ba32 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:09.757373 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4faf43f-a09e-48b2-bd73-51738695571b None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:09.757659 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4faf43f-a09e-48b2-bd73-51738695571b None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:09.757977 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4faf43f-a09e-48b2-bd73-51738695571b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:09.775993 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-c4faf43f-a09e-48b2-bd73-51738695571b None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:09.777202 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-c4faf43f-a09e-48b2-bd73-51738695571b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:09.846288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1266/2525] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:54:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:09.854567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb192295-8da4-4da1-90a8-84e0b640685a None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:09.854856 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb192295-8da4-4da1-90a8-84e0b640685a None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:09.855155 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb192295-8da4-4da1-90a8-84e0b640685a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:09.874818 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-fb192295-8da4-4da1-90a8-84e0b640685a None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:09.876043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-fb192295-8da4-4da1-90a8-84e0b640685a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:09.885563 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1260/2526] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:54:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:09.889963 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4faf43f-a09e-48b2-bd73-51738695571b None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:09.900266 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4faf43f-a09e-48b2-bd73-51738695571b None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:09.906185 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a2fa3-8cf1-4dd8-835d-9fb85e998edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:09.907197 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a2fa3-8cf1-4dd8-835d-9fb85e998edf admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:09.907472 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a2fa3-8cf1-4dd8-835d-9fb85e998edf admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:09.907736 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a2fa3-8cf1-4dd8-835d-9fb85e998edf admin admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:09.908472 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a2fa3-8cf1-4dd8-835d-9fb85e998edf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:54:09.908773 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a2fa3-8cf1-4dd8-835d-9fb85e998edf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:09.910446 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a2fa3-8cf1-4dd8-835d-9fb85e998edf admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:09.922638 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1267/2527] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:54:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:54:09.927051 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb192295-8da4-4da1-90a8-84e0b640685a None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:09.936738 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb192295-8da4-4da1-90a8-84e0b640685a None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:09.942656 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4247c29-0cf8-497c-a179-b93da69cd2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:09.943330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4247c29-0cf8-497c-a179-b93da69cd2b6 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:09.943611 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4247c29-0cf8-497c-a179-b93da69cd2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:09.943883 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4247c29-0cf8-497c-a179-b93da69cd2b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:09.944563 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4247c29-0cf8-497c-a179-b93da69cd2b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:09.946578 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4247c29-0cf8-497c-a179-b93da69cd2b6 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:09.974853 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1261/2528] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:54:09 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:09.979358 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a2fa3-8cf1-4dd8-835d-9fb85e998edf admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:09.989736 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a2fa3-8cf1-4dd8-835d-9fb85e998edf admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:10.050260 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dadf36-8603-4f3d-8abb-2bc8b3d79bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:10.050934 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dadf36-8603-4f3d-8abb-2bc8b3d79bab admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:10.051207 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dadf36-8603-4f3d-8abb-2bc8b3d79bab admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:10.051473 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dadf36-8603-4f3d-8abb-2bc8b3d79bab admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:10.052152 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dadf36-8603-4f3d-8abb-2bc8b3d79bab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:10.054117 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dadf36-8603-4f3d-8abb-2bc8b3d79bab admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:10.064023 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:10.077017 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1268/2529] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:54:09 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:10.081305 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4247c29-0cf8-497c-a179-b93da69cd2b6 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:10.091844 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4247c29-0cf8-497c-a179-b93da69cd2b6 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:10.096922 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c771689-aa7e-4c1a-8a99-3668eb261c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:10.097701 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c771689-aa7e-4c1a-8a99-3668eb261c9f admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:10.098014 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c771689-aa7e-4c1a-8a99-3668eb261c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:10.098282 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c771689-aa7e-4c1a-8a99-3668eb261c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:10.099010 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c771689-aa7e-4c1a-8a99-3668eb261c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:10.100616 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c771689-aa7e-4c1a-8a99-3668eb261c9f admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:10.111310 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1262/2530] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:10.115469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dadf36-8603-4f3d-8abb-2bc8b3d79bab admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:10.125882 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dadf36-8603-4f3d-8abb-2bc8b3d79bab admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:10.131434 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1fcb1-27df-4625-a2ee-9e971e079ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:10.132086 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1fcb1-27df-4625-a2ee-9e971e079ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:10.132445 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1fcb1-27df-4625-a2ee-9e971e079ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:10.132738 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1fcb1-27df-4625-a2ee-9e971e079ee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:10.133512 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1fcb1-27df-4625-a2ee-9e971e079ee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:10.135163 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1fcb1-27df-4625-a2ee-9e971e079ee9 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:10.147556 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1269/2531] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:54:10.152153 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c771689-aa7e-4c1a-8a99-3668eb261c9f admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:10.163705 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c771689-aa7e-4c1a-8a99-3668eb261c9f admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:10.169566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd66da-8fc7-41a0-8d07-af0f55fcbe5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:10.170526 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd66da-8fc7-41a0-8d07-af0f55fcbe5c admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:10.170804 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd66da-8fc7-41a0-8d07-af0f55fcbe5c admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:10.171080 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd66da-8fc7-41a0-8d07-af0f55fcbe5c admin admin] PATH_INFO: `/v3/projects/8b9e60f569774345932b1c4ef9c9fda7/users/2687e594aac44e0ba7e0b164186d8448/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:10.187207 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd66da-8fc7-41a0-8d07-af0f55fcbe5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b9e60f569774345932b1c4ef9c9fda7, user_id=2687e594aac44e0ba7e0b164186d8448, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:10.189945 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd66da-8fc7-41a0-8d07-af0f55fcbe5c admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:10.203714 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1263/2532] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:10 2022] PUT /identity/v3/projects/8b9e60f569774345932b1c4ef9c9fda7/users/2687e594aac44e0ba7e0b164186d8448/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:10.215350 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcf00e-aa50-40e8-8387-80b5aecb230c None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:10.215608 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcf00e-aa50-40e8-8387-80b5aecb230c None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:10.215877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcf00e-aa50-40e8-8387-80b5aecb230c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:10.243439 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-c2bcf00e-aa50-40e8-8387-80b5aecb230c None None] MFA Rules not processed for user `2687e594aac44e0ba7e0b164186d8448`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:10.244570 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-c2bcf00e-aa50-40e8-8387-80b5aecb230c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:10.311729 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1270/2533] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:54:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:10.323654 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd66da-8fc7-41a0-8d07-af0f55fcbe5c admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:10.325522 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-efbd66da-8fc7-41a0-8d07-af0f55fcbe5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:10.413356 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd66da-8fc7-41a0-8d07-af0f55fcbe5c admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:10.417108 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71649ef9-1570-4682-8ecb-e21c1b312172 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05f331339d143c09eaa12efe2b80653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:10.418125 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71649ef9-1570-4682-8ecb-e21c1b312172 service glance] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:10.418125 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71649ef9-1570-4682-8ecb-e21c1b312172 service glance] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:10.418347 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71649ef9-1570-4682-8ecb-e21c1b312172 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:10.428174 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71649ef9-1570-4682-8ecb-e21c1b312172 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:10.429621 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71649ef9-1570-4682-8ecb-e21c1b312172 service glance] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:10.440453 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1264/2534] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:10.618322 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bcf00e-aa50-40e8-8387-80b5aecb230c None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:10.620481 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-c2bcf00e-aa50-40e8-8387-80b5aecb230c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:10.721993 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bcf00e-aa50-40e8-8387-80b5aecb230c None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:10.729020 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f41d2-210b-4f26-997f-030876e2bdaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:10.731988 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f41d2-210b-4f26-997f-030876e2bdaf service nova] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:10.731988 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f41d2-210b-4f26-997f-030876e2bdaf service nova] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:10.731988 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f41d2-210b-4f26-997f-030876e2bdaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:10.733339 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-5f0f41d2-210b-4f26-997f-030876e2bdaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:10.759625 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f41d2-210b-4f26-997f-030876e2bdaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:10.762822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f41d2-210b-4f26-997f-030876e2bdaf service nova] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:10.776402 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1271/2535] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:11.703454 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9063724-43fd-4d57-bc94-e936b08522e2 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:11.703914 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9063724-43fd-4d57-bc94-e936b08522e2 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:11.704004 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9063724-43fd-4d57-bc94-e936b08522e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:11.711649 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:11.723699 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-d9063724-43fd-4d57-bc94-e936b08522e2 None None] MFA Rules not processed for user `c9647d15389e49e6b7c43ea1b1538a13`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:11.725682 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-d9063724-43fd-4d57-bc94-e936b08522e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:11.781708 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1265/2536] 10.222.0.27 () {58 vars in 967 bytes} [Tue Jul 5 20:54:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:11.836522 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f41d2-210b-4f26-997f-030876e2bdaf service nova] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:11.838260 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-5f0f41d2-210b-4f26-997f-030876e2bdaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:11.908399 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:11.927209 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f41d2-210b-4f26-997f-030876e2bdaf service nova] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:11.933902 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1081f-9bad-4089-8a14-eecd694c1fa6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90aa580a2e10467a93c2d79d1906bd8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:11.934587 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1081f-9bad-4089-8a14-eecd694c1fa6 service swift] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:11.934866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1081f-9bad-4089-8a14-eecd694c1fa6 service swift] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:11.935137 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1081f-9bad-4089-8a14-eecd694c1fa6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:11.944738 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f1081f-9bad-4089-8a14-eecd694c1fa6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:11.946386 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f1081f-9bad-4089-8a14-eecd694c1fa6 service swift] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:11.956113 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1272/2537] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Jul 5 20:54:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 20:54:19.314161 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9063724-43fd-4d57-bc94-e936b08522e2 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:19.316289 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-d9063724-43fd-4d57-bc94-e936b08522e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:19.398070 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9063724-43fd-4d57-bc94-e936b08522e2 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:19.402793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1205675-51c1-41cb-b61f-1ea651afa5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:19.403681 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1205675-51c1-41cb-b61f-1ea651afa5af admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:19.403956 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1205675-51c1-41cb-b61f-1ea651afa5af admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:19.404230 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1205675-51c1-41cb-b61f-1ea651afa5af admin admin] PATH_INFO: `/v3/users/6a0aa7299eb64cb4b9211ce197c6ab4c` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:19.405425 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1205675-51c1-41cb-b61f-1ea651afa5af admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a0aa7299eb64cb4b9211ce197c6ab4c)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:19.407742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1205675-51c1-41cb-b61f-1ea651afa5af admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:19.456190 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-f1205675-51c1-41cb-b61f-1ea651afa5af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a0aa7299eb64cb4b9211ce197c6ab4c'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:19.464873 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-f1205675-51c1-41cb-b61f-1ea651afa5af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a0aa7299eb64cb4b9211ce197c6ab4c'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:19.477168 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-f1205675-51c1-41cb-b61f-1ea651afa5af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a0aa7299eb64cb4b9211ce197c6ab4c'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:19.477930 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-f1205675-51c1-41cb-b61f-1ea651afa5af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a0aa7299eb64cb4b9211ce197c6ab4c'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:19.478521 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-f1205675-51c1-41cb-b61f-1ea651afa5af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a0aa7299eb64cb4b9211ce197c6ab4c'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:19.492123 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1266/2538] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:54:19 2022] DELETE /identity/v3/users/6a0aa7299eb64cb4b9211ce197c6ab4c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:19.671959 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1081f-9bad-4089-8a14-eecd694c1fa6 service swift] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:19.685651 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1081f-9bad-4089-8a14-eecd694c1fa6 service swift] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:19.751525 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7e970-7a56-46aa-b04f-d83c205a5665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:19.752319 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7e970-7a56-46aa-b04f-d83c205a5665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:19.752760 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7e970-7a56-46aa-b04f-d83c205a5665 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:19.753039 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7e970-7a56-46aa-b04f-d83c205a5665 admin admin] PATH_INFO: `/v3/projects/b00e5f5f4cee424ba278dbde85c96625` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:19.754451 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7e970-7a56-46aa-b04f-d83c205a5665 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b00e5f5f4cee424ba278dbde85c96625)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:19.756397 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7e970-7a56-46aa-b04f-d83c205a5665 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:19.810210 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-93e7e970-7a56-46aa-b04f-d83c205a5665 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b00e5f5f4cee424ba278dbde85c96625', 'request_id': 'req-93e7e970-7a56-46aa-b04f-d83c205a5665'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:19.818957 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-93e7e970-7a56-46aa-b04f-d83c205a5665 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b00e5f5f4cee424ba278dbde85c96625', 'request_id': 'req-93e7e970-7a56-46aa-b04f-d83c205a5665'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:19.828968 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-93e7e970-7a56-46aa-b04f-d83c205a5665 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b00e5f5f4cee424ba278dbde85c96625', 'request_id': 'req-93e7e970-7a56-46aa-b04f-d83c205a5665'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:19.841278 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-93e7e970-7a56-46aa-b04f-d83c205a5665 admin admin] The token cache is being invalidate because project b00e5f5f4cee424ba278dbde85c96625 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:54:19.841556 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-93e7e970-7a56-46aa-b04f-d83c205a5665 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:19.842185 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-93e7e970-7a56-46aa-b04f-d83c205a5665 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:19.844093 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1273/2539] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:54:19 2022] DELETE /identity/v3/projects/b00e5f5f4cee424ba278dbde85c96625 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:19.848750 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1205675-51c1-41cb-b61f-1ea651afa5af admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:19.850412 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-f1205675-51c1-41cb-b61f-1ea651afa5af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:19.865566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1205675-51c1-41cb-b61f-1ea651afa5af admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:19.893447 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:19.928517 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af52cce7-27e7-4fac-a285-2d255d632b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:19.929388 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52cce7-27e7-4fac-a285-2d255d632b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:19.929661 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52cce7-27e7-4fac-a285-2d255d632b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:19.929962 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52cce7-27e7-4fac-a285-2d255d632b30 admin admin] PATH_INFO: `/v3/users/b9eff5fa55e3489aa5f972682390d963` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:19.931238 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af52cce7-27e7-4fac-a285-2d255d632b30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9eff5fa55e3489aa5f972682390d963)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:19.933234 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af52cce7-27e7-4fac-a285-2d255d632b30 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:19.980902 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-af52cce7-27e7-4fac-a285-2d255d632b30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9eff5fa55e3489aa5f972682390d963'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:19.988164 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-af52cce7-27e7-4fac-a285-2d255d632b30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9eff5fa55e3489aa5f972682390d963'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:20.001720 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-af52cce7-27e7-4fac-a285-2d255d632b30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9eff5fa55e3489aa5f972682390d963'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:20.002665 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-af52cce7-27e7-4fac-a285-2d255d632b30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9eff5fa55e3489aa5f972682390d963'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:20.003343 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-af52cce7-27e7-4fac-a285-2d255d632b30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9eff5fa55e3489aa5f972682390d963'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:20.019083 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1267/2540] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:54:19 2022] DELETE /identity/v3/users/b9eff5fa55e3489aa5f972682390d963 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:20.201809 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7e970-7a56-46aa-b04f-d83c205a5665 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:20.203301 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-93e7e970-7a56-46aa-b04f-d83c205a5665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:20.217027 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7e970-7a56-46aa-b04f-d83c205a5665 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:20.276584 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f07f6-2721-45a4-bb2d-e6723075c234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:20.277372 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f07f6-2721-45a4-bb2d-e6723075c234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:20.277638 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f07f6-2721-45a4-bb2d-e6723075c234 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:20.277942 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f07f6-2721-45a4-bb2d-e6723075c234 admin admin] PATH_INFO: `/v3/projects/efbc1e9aa66245e59f1c5a0b7aae04ce` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:20.279111 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f07f6-2721-45a4-bb2d-e6723075c234 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efbc1e9aa66245e59f1c5a0b7aae04ce)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:20.281473 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f07f6-2721-45a4-bb2d-e6723075c234 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:20.292491 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:20.343101 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-5c2f07f6-2721-45a4-bb2d-e6723075c234 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efbc1e9aa66245e59f1c5a0b7aae04ce', 'request_id': 'req-5c2f07f6-2721-45a4-bb2d-e6723075c234'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:20.350835 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-5c2f07f6-2721-45a4-bb2d-e6723075c234 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efbc1e9aa66245e59f1c5a0b7aae04ce', 'request_id': 'req-5c2f07f6-2721-45a4-bb2d-e6723075c234'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:20.359166 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-5c2f07f6-2721-45a4-bb2d-e6723075c234 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efbc1e9aa66245e59f1c5a0b7aae04ce', 'request_id': 'req-5c2f07f6-2721-45a4-bb2d-e6723075c234'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:20.370189 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-5c2f07f6-2721-45a4-bb2d-e6723075c234 admin admin] The token cache is being invalidate because project efbc1e9aa66245e59f1c5a0b7aae04ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:54:20.370489 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-5c2f07f6-2721-45a4-bb2d-e6723075c234 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:20.371162 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-5c2f07f6-2721-45a4-bb2d-e6723075c234 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:20.372719 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1274/2541] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:54:20 2022] DELETE /identity/v3/projects/efbc1e9aa66245e59f1c5a0b7aae04ce => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:23.335556 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af52cce7-27e7-4fac-a285-2d255d632b30 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:23.337190 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-af52cce7-27e7-4fac-a285-2d255d632b30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:23.417120 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af52cce7-27e7-4fac-a285-2d255d632b30 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:23.463424 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:23.485488 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86899706-fa66-4c61-bae8-9c858b490a2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:23.486181 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86899706-fa66-4c61-bae8-9c858b490a2d service nova] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:23.486459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86899706-fa66-4c61-bae8-9c858b490a2d service nova] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:23.486730 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86899706-fa66-4c61-bae8-9c858b490a2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:23.488745 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-86899706-fa66-4c61-bae8-9c858b490a2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:23.546558 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86899706-fa66-4c61-bae8-9c858b490a2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:23.548174 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86899706-fa66-4c61-bae8-9c858b490a2d service nova] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:23.557362 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1268/2542] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:28.398540 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96c734-38a5-4981-a3ca-bd243c03286f None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:28.399069 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96c734-38a5-4981-a3ca-bd243c03286f None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:28.399190 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96c734-38a5-4981-a3ca-bd243c03286f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:28.417301 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-3b96c734-38a5-4981-a3ca-bd243c03286f None None] MFA Rules not processed for user `c9647d15389e49e6b7c43ea1b1538a13`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:28.418566 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-3b96c734-38a5-4981-a3ca-bd243c03286f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:28.477181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1275/2543] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Jul 5 20:54:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:28.489629 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86899706-fa66-4c61-bae8-9c858b490a2d service nova] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:28.491121 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-86899706-fa66-4c61-bae8-9c858b490a2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:28.570135 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86899706-fa66-4c61-bae8-9c858b490a2d service nova] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:28.576154 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41bcac-feb0-49fe-adc1-6a88889b22fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90aa580a2e10467a93c2d79d1906bd8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:28.576808 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41bcac-feb0-49fe-adc1-6a88889b22fa service swift] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:28.577085 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41bcac-feb0-49fe-adc1-6a88889b22fa service swift] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:28.577355 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41bcac-feb0-49fe-adc1-6a88889b22fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:28.586669 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41bcac-feb0-49fe-adc1-6a88889b22fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:28.588281 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41bcac-feb0-49fe-adc1-6a88889b22fa service swift] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:28.597123 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1269/2544] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Jul 5 20:54:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 20:54:30.141103 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96c734-38a5-4981-a3ca-bd243c03286f None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:30.144309 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-3b96c734-38a5-4981-a3ca-bd243c03286f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:30.187346 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96c734-38a5-4981-a3ca-bd243c03286f None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:30.211745 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c454c-d7d3-44a4-8763-022cec76b9e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:30.212418 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c454c-d7d3-44a4-8763-022cec76b9e5 service nova] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:30.212700 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c454c-d7d3-44a4-8763-022cec76b9e5 service nova] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:30.213300 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c454c-d7d3-44a4-8763-022cec76b9e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:30.218053 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-cd7c454c-d7d3-44a4-8763-022cec76b9e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:30.236216 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c454c-d7d3-44a4-8763-022cec76b9e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:30.237829 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c454c-d7d3-44a4-8763-022cec76b9e5 service nova] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:30.252381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1276/2545] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:32.121357 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41bcac-feb0-49fe-adc1-6a88889b22fa service swift] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:32.122945 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-5e41bcac-feb0-49fe-adc1-6a88889b22fa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:32.199675 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41bcac-feb0-49fe-adc1-6a88889b22fa service swift] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:32.204767 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e0e70-522f-4993-94e3-2d606fff80fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:32.205686 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e0e70-522f-4993-94e3-2d606fff80fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:32.205992 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e0e70-522f-4993-94e3-2d606fff80fe admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:32.206260 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e0e70-522f-4993-94e3-2d606fff80fe admin admin] PATH_INFO: `/v3/users/2687e594aac44e0ba7e0b164186d8448` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:32.207571 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e0e70-522f-4993-94e3-2d606fff80fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=2687e594aac44e0ba7e0b164186d8448)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:32.209552 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e0e70-522f-4993-94e3-2d606fff80fe admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:32.228019 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:32.274178 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-d81e0e70-522f-4993-94e3-2d606fff80fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2687e594aac44e0ba7e0b164186d8448'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:32.284368 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-d81e0e70-522f-4993-94e3-2d606fff80fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2687e594aac44e0ba7e0b164186d8448'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:32.300787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-d81e0e70-522f-4993-94e3-2d606fff80fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2687e594aac44e0ba7e0b164186d8448'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:32.301633 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-d81e0e70-522f-4993-94e3-2d606fff80fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2687e594aac44e0ba7e0b164186d8448'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:32.302415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-d81e0e70-522f-4993-94e3-2d606fff80fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2687e594aac44e0ba7e0b164186d8448'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:32.317833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1270/2546] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:54:32 2022] DELETE /identity/v3/users/2687e594aac44e0ba7e0b164186d8448 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:32.322615 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93e5a2-b161-433c-9d37-4cf69adf450c None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:32.323100 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93e5a2-b161-433c-9d37-4cf69adf450c None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:32.323100 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93e5a2-b161-433c-9d37-4cf69adf450c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:32.343976 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-6d93e5a2-b161-433c-9d37-4cf69adf450c None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:32.345495 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-6d93e5a2-b161-433c-9d37-4cf69adf450c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:32.433248 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1277/2547] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:54:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:54:32.442814 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e0e70-522f-4993-94e3-2d606fff80fe admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:32.444350 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-d81e0e70-522f-4993-94e3-2d606fff80fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:32.558177 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e0e70-522f-4993-94e3-2d606fff80fe admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:32.562376 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09268188-9883-488a-9782-c8e94ca30b2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:32.563126 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09268188-9883-488a-9782-c8e94ca30b2b service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:32.563481 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09268188-9883-488a-9782-c8e94ca30b2b service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:32.563831 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09268188-9883-488a-9782-c8e94ca30b2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:32.578840 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09268188-9883-488a-9782-c8e94ca30b2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:32.580422 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09268188-9883-488a-9782-c8e94ca30b2b service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:32.603179 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1271/2548] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:32.924746 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d93e5a2-b161-433c-9d37-4cf69adf450c None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:32.926814 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-6d93e5a2-b161-433c-9d37-4cf69adf450c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:32.952298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d93e5a2-b161-433c-9d37-4cf69adf450c None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:32.962444 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009e867-00b4-4afc-af1a-667096700b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:32.963602 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009e867-00b4-4afc-af1a-667096700b8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:32.963857 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009e867-00b4-4afc-af1a-667096700b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:32.964236 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009e867-00b4-4afc-af1a-667096700b8d admin admin] PATH_INFO: `/v3/projects/8b9e60f569774345932b1c4ef9c9fda7` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:32.965613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4009e867-00b4-4afc-af1a-667096700b8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b9e60f569774345932b1c4ef9c9fda7)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:32.967854 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4009e867-00b4-4afc-af1a-667096700b8d admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:33.013449 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:33.038623 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-4009e867-00b4-4afc-af1a-667096700b8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b9e60f569774345932b1c4ef9c9fda7', 'request_id': 'req-4009e867-00b4-4afc-af1a-667096700b8d'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:33.047380 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-4009e867-00b4-4afc-af1a-667096700b8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b9e60f569774345932b1c4ef9c9fda7', 'request_id': 'req-4009e867-00b4-4afc-af1a-667096700b8d'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:33.063769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-4009e867-00b4-4afc-af1a-667096700b8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b9e60f569774345932b1c4ef9c9fda7', 'request_id': 'req-4009e867-00b4-4afc-af1a-667096700b8d'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:33.082682 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-4009e867-00b4-4afc-af1a-667096700b8d admin admin] The token cache is being invalidate because project 8b9e60f569774345932b1c4ef9c9fda7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:54:33.082982 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-4009e867-00b4-4afc-af1a-667096700b8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:33.083785 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-4009e867-00b4-4afc-af1a-667096700b8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:33.085400 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1278/2549] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:54:32 2022] DELETE /identity/v3/projects/8b9e60f569774345932b1c4ef9c9fda7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:33.090581 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f52a3-588b-4bb6-94c6-41009a1ea3fd None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:33.090941 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f52a3-588b-4bb6-94c6-41009a1ea3fd None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:33.091292 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f52a3-588b-4bb6-94c6-41009a1ea3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:33.116937 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-aa8f52a3-588b-4bb6-94c6-41009a1ea3fd None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:33.118334 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-aa8f52a3-588b-4bb6-94c6-41009a1ea3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:33.232747 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1272/2550] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:54:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:54:33.240178 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213fe47-038b-45ff-8d2c-c9c217286a41 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:33.240655 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213fe47-038b-45ff-8d2c-c9c217286a41 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:33.241014 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213fe47-038b-45ff-8d2c-c9c217286a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:33.271660 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-8213fe47-038b-45ff-8d2c-c9c217286a41 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:33.272909 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-8213fe47-038b-45ff-8d2c-c9c217286a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:33.284724 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1279/2551] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:54:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:33.289618 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f52a3-588b-4bb6-94c6-41009a1ea3fd None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:33.300947 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f52a3-588b-4bb6-94c6-41009a1ea3fd None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:33.310272 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a561d-9b37-42d0-a58f-9088fefe9740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:33.311302 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a561d-9b37-42d0-a58f-9088fefe9740 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:33.312989 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a561d-9b37-42d0-a58f-9088fefe9740 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:33.313508 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a561d-9b37-42d0-a58f-9088fefe9740 admin admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:33.314960 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a561d-9b37-42d0-a58f-9088fefe9740 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:54:33.315547 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a561d-9b37-42d0-a58f-9088fefe9740 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:33.318793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a561d-9b37-42d0-a58f-9088fefe9740 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:33.346008 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213fe47-038b-45ff-8d2c-c9c217286a41 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:33.351398 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1273/2552] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:54:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:54:33.358061 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213fe47-038b-45ff-8d2c-c9c217286a41 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:33.363503 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce71c7-5a4c-4736-b6dc-8f8d74027fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:33.364266 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce71c7-5a4c-4736-b6dc-8f8d74027fda admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:33.364617 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce71c7-5a4c-4736-b6dc-8f8d74027fda admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:33.364965 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce71c7-5a4c-4736-b6dc-8f8d74027fda admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:33.366065 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce71c7-5a4c-4736-b6dc-8f8d74027fda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:33.368491 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce71c7-5a4c-4736-b6dc-8f8d74027fda admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:33.426880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1280/2553] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:54:33 2022] POST /identity/v3/projects => generated 375 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:33.431391 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a561d-9b37-42d0-a58f-9088fefe9740 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:33.444180 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a561d-9b37-42d0-a58f-9088fefe9740 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:33.479277 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:33.535808 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237d565-55f0-423a-8640-053d04b8cd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:33.536662 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237d565-55f0-423a-8640-053d04b8cd63 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:33.537068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237d565-55f0-423a-8640-053d04b8cd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:33.537552 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237d565-55f0-423a-8640-053d04b8cd63 admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:33.538370 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237d565-55f0-423a-8640-053d04b8cd63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:33.540842 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237d565-55f0-423a-8640-053d04b8cd63 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:33.569745 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1274/2554] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:54:33 2022] POST /identity/v3/users => generated 288 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:33.574225 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce71c7-5a4c-4736-b6dc-8f8d74027fda admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:33.585581 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce71c7-5a4c-4736-b6dc-8f8d74027fda admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:33.593506 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11397e90-5625-4a78-92b0-bd4c841d2acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:33.594217 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11397e90-5625-4a78-92b0-bd4c841d2acd admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:33.594523 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11397e90-5625-4a78-92b0-bd4c841d2acd admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:33.594802 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11397e90-5625-4a78-92b0-bd4c841d2acd admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:33.595552 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11397e90-5625-4a78-92b0-bd4c841d2acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:33.597212 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11397e90-5625-4a78-92b0-bd4c841d2acd admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:33.609025 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1281/2555] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:33.612855 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237d565-55f0-423a-8640-053d04b8cd63 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:33.625163 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237d565-55f0-423a-8640-053d04b8cd63 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:33.632094 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a4af4-1818-4ca0-aa35-1bffaf1372d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:33.632929 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a4af4-1818-4ca0-aa35-1bffaf1372d2 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:33.634026 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a4af4-1818-4ca0-aa35-1bffaf1372d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:33.634410 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a4af4-1818-4ca0-aa35-1bffaf1372d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:33.635356 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3a4af4-1818-4ca0-aa35-1bffaf1372d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:33.637193 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3a4af4-1818-4ca0-aa35-1bffaf1372d2 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:33.652195 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1275/2556] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:54:33.653137 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11397e90-5625-4a78-92b0-bd4c841d2acd admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:33.666723 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11397e90-5625-4a78-92b0-bd4c841d2acd admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:33.671695 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb6952-360b-49cb-a773-5807d1c5d31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:33.672618 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb6952-360b-49cb-a773-5807d1c5d31b admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:33.672900 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb6952-360b-49cb-a773-5807d1c5d31b admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:33.673169 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb6952-360b-49cb-a773-5807d1c5d31b admin admin] PATH_INFO: `/v3/projects/9c35165687194487abc8d87325efdc3f/users/b1d6d17987ff4d8c83b6fb9cac812eee/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:33.699165 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fb6952-360b-49cb-a773-5807d1c5d31b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c35165687194487abc8d87325efdc3f, user_id=b1d6d17987ff4d8c83b6fb9cac812eee, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:33.701899 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fb6952-360b-49cb-a773-5807d1c5d31b admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:33.717946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1282/2557] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:33 2022] PUT /identity/v3/projects/9c35165687194487abc8d87325efdc3f/users/b1d6d17987ff4d8c83b6fb9cac812eee/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:54:33.731669 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ccf190-76e5-4658-910b-dced5d30ef26 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:33.732018 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ccf190-76e5-4658-910b-dced5d30ef26 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:33.732323 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ccf190-76e5-4658-910b-dced5d30ef26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:33.768625 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-49ccf190-76e5-4658-910b-dced5d30ef26 None None] MFA Rules not processed for user `b1d6d17987ff4d8c83b6fb9cac812eee`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:33.769879 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-49ccf190-76e5-4658-910b-dced5d30ef26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:33.852871 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1276/2558] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:54:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:54:33.863412 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb6952-360b-49cb-a773-5807d1c5d31b admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:33.865363 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-a9fb6952-360b-49cb-a773-5807d1c5d31b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:33.949859 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb6952-360b-49cb-a773-5807d1c5d31b admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:33.955384 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca08c72-ce97-41e7-84a9-f9fc92680d72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:33.956323 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca08c72-ce97-41e7-84a9-f9fc92680d72 service cinder] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:33.956665 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca08c72-ce97-41e7-84a9-f9fc92680d72 service cinder] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:33.956956 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca08c72-ce97-41e7-84a9-f9fc92680d72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:33.967287 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca08c72-ce97-41e7-84a9-f9fc92680d72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:33.968982 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca08c72-ce97-41e7-84a9-f9fc92680d72 service cinder] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:33.980446 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1283/2559] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:42.275020 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4980d93-8d49-4a6f-9fab-656068556304 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:42.275830 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4980d93-8d49-4a6f-9fab-656068556304 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:42.276161 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4980d93-8d49-4a6f-9fab-656068556304 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:42.278271 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1277/2560] 10.222.0.27 () {54 vars in 921 bytes} [Tue Jul 5 20:54:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:54:42.286535 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30d7f7-5402-4f3d-92cb-2b930823b9b8 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:42.287430 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30d7f7-5402-4f3d-92cb-2b930823b9b8 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:42.287609 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30d7f7-5402-4f3d-92cb-2b930823b9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:42.313280 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-ff30d7f7-5402-4f3d-92cb-2b930823b9b8 None None] MFA Rules not processed for user `814b675b98b844a2a12a39890ee69d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:42.314549 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-ff30d7f7-5402-4f3d-92cb-2b930823b9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:42.363354 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:42.386677 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1284/2561] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Jul 5 20:54:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:42.398511 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4980d93-8d49-4a6f-9fab-656068556304 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:42.400179 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-a4980d93-8d49-4a6f-9fab-656068556304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:42.458915 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4980d93-8d49-4a6f-9fab-656068556304 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:42.463554 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c3cce-1c0e-4355-ad01-adbffb29e822 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a05f331339d143c09eaa12efe2b80653', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:42.464264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c3cce-1c0e-4355-ad01-adbffb29e822 service glance] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:42.464544 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c3cce-1c0e-4355-ad01-adbffb29e822 service glance] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:42.464815 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c3cce-1c0e-4355-ad01-adbffb29e822 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:42.475859 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c3cce-1c0e-4355-ad01-adbffb29e822 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:42.477319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c3cce-1c0e-4355-ad01-adbffb29e822 service glance] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:42.488679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1278/2562] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:42.563382 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c6bf9-7f20-40fe-9b3c-4406863be48f None None] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:42.563668 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c6bf9-7f20-40fe-9b3c-4406863be48f None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:42.563946 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c6bf9-7f20-40fe-9b3c-4406863be48f None None] PATH_INFO: `/` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:42.565350 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1285/2563] 10.222.0.27 () {54 vars in 921 bytes} [Tue Jul 5 20:54:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:54:42.570301 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ec09b-e9d5-484f-a2a0-df989b1a500f None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:42.570589 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ec09b-e9d5-484f-a2a0-df989b1a500f None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:42.570870 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ec09b-e9d5-484f-a2a0-df989b1a500f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:42.590032 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-b09ec09b-e9d5-484f-a2a0-df989b1a500f None None] MFA Rules not processed for user `157a258bcff642cb91a0a474f8f50941`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:42.591274 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-b09ec09b-e9d5-484f-a2a0-df989b1a500f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:42.620706 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:42.648453 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1279/2564] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Jul 5 20:54:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:42.660515 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c6bf9-7f20-40fe-9b3c-4406863be48f None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:42.662818 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-805c6bf9-7f20-40fe-9b3c-4406863be48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:42.678301 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c6bf9-7f20-40fe-9b3c-4406863be48f None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:42.683984 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9395b52-b358-45a4-b940-a9dcebd88fae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:42.684714 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9395b52-b358-45a4-b940-a9dcebd88fae service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:42.685000 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9395b52-b358-45a4-b940-a9dcebd88fae service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:42.685290 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9395b52-b358-45a4-b940-a9dcebd88fae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:42.695532 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9395b52-b358-45a4-b940-a9dcebd88fae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:42.696960 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9395b52-b358-45a4-b940-a9dcebd88fae service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:42.705291 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1286/2565] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:42.792067 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe03b04-9c51-48ec-88bf-4c72d6a20f10 None None] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:42.792437 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe03b04-9c51-48ec-88bf-4c72d6a20f10 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:42.793070 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe03b04-9c51-48ec-88bf-4c72d6a20f10 None None] PATH_INFO: `/` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:42.797026 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1280/2566] 10.222.0.27 () {54 vars in 921 bytes} [Tue Jul 5 20:54:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 05 20:54:42.803424 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094b1a7-f7d0-4bb7-a1bb-ed053df0ff12 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:42.803702 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094b1a7-f7d0-4bb7-a1bb-ed053df0ff12 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:42.803973 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094b1a7-f7d0-4bb7-a1bb-ed053df0ff12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:42.825039 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-7094b1a7-f7d0-4bb7-a1bb-ed053df0ff12 None None] MFA Rules not processed for user `814b675b98b844a2a12a39890ee69d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:42.826449 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-7094b1a7-f7d0-4bb7-a1bb-ed053df0ff12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:42.843395 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1287/2567] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Jul 5 20:54:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:42.854651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe03b04-9c51-48ec-88bf-4c72d6a20f10 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:42.856715 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-dfe03b04-9c51-48ec-88bf-4c72d6a20f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:42.872026 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe03b04-9c51-48ec-88bf-4c72d6a20f10 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:42.876414 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007677d9-4443-463a-ba01-5f7c30944302 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:42.877055 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007677d9-4443-463a-ba01-5f7c30944302 service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:42.877335 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007677d9-4443-463a-ba01-5f7c30944302 service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:42.877604 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007677d9-4443-463a-ba01-5f7c30944302 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:42.888444 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007677d9-4443-463a-ba01-5f7c30944302 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:42.889916 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007677d9-4443-463a-ba01-5f7c30944302 service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:42.901249 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1281/2568] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:42.967497 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094b1a7-f7d0-4bb7-a1bb-ed053df0ff12 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:42.968275 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-7094b1a7-f7d0-4bb7-a1bb-ed053df0ff12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:43.050857 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094b1a7-f7d0-4bb7-a1bb-ed053df0ff12 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:43.057401 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608c891-88af-44f4-81f8-e63c74fafdf5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16662dd5e2e74163b6aa2e1e7ef07524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:43.058373 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608c891-88af-44f4-81f8-e63c74fafdf5 service placement] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:43.058641 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608c891-88af-44f4-81f8-e63c74fafdf5 service placement] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:43.059115 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608c891-88af-44f4-81f8-e63c74fafdf5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:43.061313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-c608c891-88af-44f4-81f8-e63c74fafdf5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:43.075473 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c608c891-88af-44f4-81f8-e63c74fafdf5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:43.077111 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c608c891-88af-44f4-81f8-e63c74fafdf5 service placement] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:43.091671 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1288/2569] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:44.156313 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007677d9-4443-463a-ba01-5f7c30944302 service neutron] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:44.198436 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608c891-88af-44f4-81f8-e63c74fafdf5 service placement] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:44.207879 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608c891-88af-44f4-81f8-e63c74fafdf5 service placement] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:44.211736 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a62285-b38d-4743-a87c-7ade95cbe670 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:44.212448 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a62285-b38d-4743-a87c-7ade95cbe670 service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:44.212975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a62285-b38d-4743-a87c-7ade95cbe670 service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:44.213114 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a62285-b38d-4743-a87c-7ade95cbe670 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:44.214976 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-98a62285-b38d-4743-a87c-7ade95cbe670 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:44.226908 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007677d9-4443-463a-ba01-5f7c30944302 service neutron] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:44.231562 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f09c72-a9e8-4f9b-ba8e-068a243489ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:44.233069 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f09c72-a9e8-4f9b-ba8e-068a243489ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:44.233360 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f09c72-a9e8-4f9b-ba8e-068a243489ff admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:44.233636 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f09c72-a9e8-4f9b-ba8e-068a243489ff admin admin] PATH_INFO: `/v3/users/b1d6d17987ff4d8c83b6fb9cac812eee` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:44.234927 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f09c72-a9e8-4f9b-ba8e-068a243489ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1d6d17987ff4d8c83b6fb9cac812eee)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:44.236882 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f09c72-a9e8-4f9b-ba8e-068a243489ff admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:44.289828 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a62285-b38d-4743-a87c-7ade95cbe670 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:44.290656 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-d9f09c72-a9e8-4f9b-ba8e-068a243489ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1d6d17987ff4d8c83b6fb9cac812eee'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:44.291317 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a62285-b38d-4743-a87c-7ade95cbe670 service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:44.298009 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-d9f09c72-a9e8-4f9b-ba8e-068a243489ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1d6d17987ff4d8c83b6fb9cac812eee'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:44.301640 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1289/2570] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:54:44.311796 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-d9f09c72-a9e8-4f9b-ba8e-068a243489ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1d6d17987ff4d8c83b6fb9cac812eee'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:44.314675 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-d9f09c72-a9e8-4f9b-ba8e-068a243489ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1d6d17987ff4d8c83b6fb9cac812eee'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:44.315330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-d9f09c72-a9e8-4f9b-ba8e-068a243489ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1d6d17987ff4d8c83b6fb9cac812eee'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:44.329683 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1282/2571] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:54:44 2022] DELETE /identity/v3/users/b1d6d17987ff4d8c83b6fb9cac812eee => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:44.334230 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac98705-1782-4a95-8fc3-d30d23db652b None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:44.334514 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac98705-1782-4a95-8fc3-d30d23db652b None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:44.334835 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac98705-1782-4a95-8fc3-d30d23db652b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:44.353652 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-4ac98705-1782-4a95-8fc3-d30d23db652b None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:44.355285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-4ac98705-1782-4a95-8fc3-d30d23db652b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:44.406293 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:44.425327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1290/2572] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:54:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:54:44.445356 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f09c72-a9e8-4f9b-ba8e-068a243489ff admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:44.446863 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-d9f09c72-a9e8-4f9b-ba8e-068a243489ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:44.507953 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:44.512919 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f09c72-a9e8-4f9b-ba8e-068a243489ff admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:44.518633 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73591138-9327-48e5-93a3-2cc23907120f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:44.519462 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73591138-9327-48e5-93a3-2cc23907120f service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:44.519998 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73591138-9327-48e5-93a3-2cc23907120f service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:44.520497 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73591138-9327-48e5-93a3-2cc23907120f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:44.531380 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73591138-9327-48e5-93a3-2cc23907120f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:44.532951 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73591138-9327-48e5-93a3-2cc23907120f service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:44.545474 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1283/2573] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:44.772363 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc3b95-fb27-41f8-9511-35620e48c6f0 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:44.772938 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc3b95-fb27-41f8-9511-35620e48c6f0 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:44.773217 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc3b95-fb27-41f8-9511-35620e48c6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:44.794136 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-e3fc3b95-fb27-41f8-9511-35620e48c6f0 None None] MFA Rules not processed for user `c9647d15389e49e6b7c43ea1b1538a13`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:44.795389 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-e3fc3b95-fb27-41f8-9511-35620e48c6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:44.851083 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73591138-9327-48e5-93a3-2cc23907120f service neutron] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:44.852683 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-73591138-9327-48e5-93a3-2cc23907120f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:44.868414 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1291/2574] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Jul 5 20:54:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:44.877301 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73591138-9327-48e5-93a3-2cc23907120f service neutron] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:44.884770 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394ba1f-3a1c-4780-aa89-738e0bf426a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:44.885723 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc3b95-fb27-41f8-9511-35620e48c6f0 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:44.886087 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394ba1f-3a1c-4780-aa89-738e0bf426a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:44.886529 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394ba1f-3a1c-4780-aa89-738e0bf426a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:44.886955 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394ba1f-3a1c-4780-aa89-738e0bf426a5 admin admin] PATH_INFO: `/v3/projects/9c35165687194487abc8d87325efdc3f` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:44.888327 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-e3fc3b95-fb27-41f8-9511-35620e48c6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:44.889417 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394ba1f-3a1c-4780-aa89-738e0bf426a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c35165687194487abc8d87325efdc3f)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:44.892446 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394ba1f-3a1c-4780-aa89-738e0bf426a5 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:44.950737 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-3394ba1f-3a1c-4780-aa89-738e0bf426a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c35165687194487abc8d87325efdc3f', 'request_id': 'req-3394ba1f-3a1c-4780-aa89-738e0bf426a5'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:44.958216 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-3394ba1f-3a1c-4780-aa89-738e0bf426a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c35165687194487abc8d87325efdc3f', 'request_id': 'req-3394ba1f-3a1c-4780-aa89-738e0bf426a5'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:44.968274 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-3394ba1f-3a1c-4780-aa89-738e0bf426a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c35165687194487abc8d87325efdc3f', 'request_id': 'req-3394ba1f-3a1c-4780-aa89-738e0bf426a5'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:44.969585 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc3b95-fb27-41f8-9511-35620e48c6f0 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:44.985612 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-3394ba1f-3a1c-4780-aa89-738e0bf426a5 admin admin] The token cache is being invalidate because project 9c35165687194487abc8d87325efdc3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:54:44.986129 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-3394ba1f-3a1c-4780-aa89-738e0bf426a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:44.986922 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-3394ba1f-3a1c-4780-aa89-738e0bf426a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:44.988854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1284/2575] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:54:44 2022] DELETE /identity/v3/projects/9c35165687194487abc8d87325efdc3f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:45.056212 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9fc498-55af-413e-803f-085ecef28a6b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90aa580a2e10467a93c2d79d1906bd8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:45.056776 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fc498-55af-413e-803f-085ecef28a6b service swift] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:45.057079 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fc498-55af-413e-803f-085ecef28a6b service swift] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:45.057352 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fc498-55af-413e-803f-085ecef28a6b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:45.059565 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-db9fc498-55af-413e-803f-085ecef28a6b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:45.109770 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:45.138019 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9fc498-55af-413e-803f-085ecef28a6b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:45.144635 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9fc498-55af-413e-803f-085ecef28a6b service swift] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:45.158899 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1292/2576] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Jul 5 20:54:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 05 20:54:48.613298 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394ba1f-3a1c-4780-aa89-738e0bf426a5 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:48.616029 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-3394ba1f-3a1c-4780-aa89-738e0bf426a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:48.755493 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394ba1f-3a1c-4780-aa89-738e0bf426a5 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:48.760684 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555e360-f849-48b8-899d-cc4c7616d153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:48.761663 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555e360-f849-48b8-899d-cc4c7616d153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:48.762054 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555e360-f849-48b8-899d-cc4c7616d153 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:48.762375 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555e360-f849-48b8-899d-cc4c7616d153 admin admin] PATH_INFO: `/v3/users/96c018ba46da45b3a079189aafdcdecd` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:48.764071 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555e360-f849-48b8-899d-cc4c7616d153 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96c018ba46da45b3a079189aafdcdecd)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:48.766193 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555e360-f849-48b8-899d-cc4c7616d153 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:48.831660 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-3555e360-f849-48b8-899d-cc4c7616d153 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96c018ba46da45b3a079189aafdcdecd'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:48.839272 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-3555e360-f849-48b8-899d-cc4c7616d153 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96c018ba46da45b3a079189aafdcdecd'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:48.852538 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-3555e360-f849-48b8-899d-cc4c7616d153 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96c018ba46da45b3a079189aafdcdecd'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:48.853446 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-3555e360-f849-48b8-899d-cc4c7616d153 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96c018ba46da45b3a079189aafdcdecd'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:48.854206 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-3555e360-f849-48b8-899d-cc4c7616d153 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96c018ba46da45b3a079189aafdcdecd'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:48.857026 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:48.874979 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1285/2577] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:54:48 2022] DELETE /identity/v3/users/96c018ba46da45b3a079189aafdcdecd => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:49.086207 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9fc498-55af-413e-803f-085ecef28a6b service swift] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:49.101368 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9fc498-55af-413e-803f-085ecef28a6b service swift] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:49.171840 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f0e0c-8ac6-4333-8e0e-b6f9908961af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:49.172831 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f0e0c-8ac6-4333-8e0e-b6f9908961af admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:49.173168 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f0e0c-8ac6-4333-8e0e-b6f9908961af admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:49.173499 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f0e0c-8ac6-4333-8e0e-b6f9908961af admin admin] PATH_INFO: `/v3/projects/61f25a3062bf49a78c6872c66daa887d` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:49.174802 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f0e0c-8ac6-4333-8e0e-b6f9908961af admin admin] RBAC: Authorizing `identity:delete_project(project_id=61f25a3062bf49a78c6872c66daa887d)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:49.176997 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f0e0c-8ac6-4333-8e0e-b6f9908961af admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:49.250513 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-469f0e0c-8ac6-4333-8e0e-b6f9908961af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61f25a3062bf49a78c6872c66daa887d', 'request_id': 'req-469f0e0c-8ac6-4333-8e0e-b6f9908961af'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:49.256831 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-469f0e0c-8ac6-4333-8e0e-b6f9908961af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61f25a3062bf49a78c6872c66daa887d', 'request_id': 'req-469f0e0c-8ac6-4333-8e0e-b6f9908961af'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:49.265881 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-469f0e0c-8ac6-4333-8e0e-b6f9908961af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61f25a3062bf49a78c6872c66daa887d', 'request_id': 'req-469f0e0c-8ac6-4333-8e0e-b6f9908961af'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:49.281561 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-469f0e0c-8ac6-4333-8e0e-b6f9908961af admin admin] The token cache is being invalidate because project 61f25a3062bf49a78c6872c66daa887d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:54:49.282040 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-469f0e0c-8ac6-4333-8e0e-b6f9908961af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:49.282814 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-469f0e0c-8ac6-4333-8e0e-b6f9908961af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:54:49.284685 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1293/2578] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:54:49 2022] DELETE /identity/v3/projects/61f25a3062bf49a78c6872c66daa887d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:54:49.289817 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95646f2b-5362-436c-a26b-3af9f437ce56 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:49.290155 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95646f2b-5362-436c-a26b-3af9f437ce56 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:49.290516 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95646f2b-5362-436c-a26b-3af9f437ce56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:49.310717 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-95646f2b-5362-436c-a26b-3af9f437ce56 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:49.312235 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-95646f2b-5362-436c-a26b-3af9f437ce56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:49.382918 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1286/2579] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:49.391500 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5b35b-adf8-4ad9-9a69-3b3c3b700a0c None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:49.391791 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5b35b-adf8-4ad9-9a69-3b3c3b700a0c None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:49.392122 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5b35b-adf8-4ad9-9a69-3b3c3b700a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:49.414693 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-38f5b35b-adf8-4ad9-9a69-3b3c3b700a0c None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:49.416023 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-38f5b35b-adf8-4ad9-9a69-3b3c3b700a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:49.424260 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1294/2580] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:54:49.428583 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95646f2b-5362-436c-a26b-3af9f437ce56 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:49.438837 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95646f2b-5362-436c-a26b-3af9f437ce56 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:49.443946 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bae3b1-f94f-47b8-a36c-7e7a9a4b1c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:49.444636 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bae3b1-f94f-47b8-a36c-7e7a9a4b1c06 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:49.444902 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bae3b1-f94f-47b8-a36c-7e7a9a4b1c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:49.445175 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bae3b1-f94f-47b8-a36c-7e7a9a4b1c06 admin admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:49.445949 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bae3b1-f94f-47b8-a36c-7e7a9a4b1c06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:54:49.446260 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bae3b1-f94f-47b8-a36c-7e7a9a4b1c06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:49.448071 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bae3b1-f94f-47b8-a36c-7e7a9a4b1c06 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:49.461878 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1287/2581] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:54:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:54:49.465349 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5b35b-adf8-4ad9-9a69-3b3c3b700a0c None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:49.476927 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5b35b-adf8-4ad9-9a69-3b3c3b700a0c None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:49.481787 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4e919-8e4a-4acf-9d6d-425a8f9968b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:49.482600 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4e919-8e4a-4acf-9d6d-425a8f9968b8 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:49.482879 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4e919-8e4a-4acf-9d6d-425a8f9968b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:49.483150 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4e919-8e4a-4acf-9d6d-425a8f9968b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:49.483976 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e4e919-8e4a-4acf-9d6d-425a8f9968b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:49.486074 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e4e919-8e4a-4acf-9d6d-425a8f9968b8 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:49.529171 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1295/2582] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:54:49 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:49.533988 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bae3b1-f94f-47b8-a36c-7e7a9a4b1c06 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:49.544686 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bae3b1-f94f-47b8-a36c-7e7a9a4b1c06 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:49.610985 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df309c17-abed-4514-be81-b7527094455b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:49.611766 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df309c17-abed-4514-be81-b7527094455b admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:49.612052 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df309c17-abed-4514-be81-b7527094455b admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:49.612327 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df309c17-abed-4514-be81-b7527094455b admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:49.613058 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df309c17-abed-4514-be81-b7527094455b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:49.615070 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df309c17-abed-4514-be81-b7527094455b admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:49.637242 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1288/2583] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:54:49 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:54:49.641470 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4e919-8e4a-4acf-9d6d-425a8f9968b8 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:49.652133 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4e919-8e4a-4acf-9d6d-425a8f9968b8 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:49.657053 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4206b-7d19-4922-b8b6-4a5313e07910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:49.657716 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4206b-7d19-4922-b8b6-4a5313e07910 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:49.658031 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4206b-7d19-4922-b8b6-4a5313e07910 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:49.658303 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4206b-7d19-4922-b8b6-4a5313e07910 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:49.659033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d4206b-7d19-4922-b8b6-4a5313e07910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:49.660652 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d4206b-7d19-4922-b8b6-4a5313e07910 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:49.671636 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1296/2584] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:49.675641 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df309c17-abed-4514-be81-b7527094455b admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:49.687021 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df309c17-abed-4514-be81-b7527094455b admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:49.693772 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf47f41-8c45-46bf-b220-e0592509066d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:49.694550 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf47f41-8c45-46bf-b220-e0592509066d admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:49.694833 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf47f41-8c45-46bf-b220-e0592509066d admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:49.695107 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf47f41-8c45-46bf-b220-e0592509066d admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:49.696065 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf47f41-8c45-46bf-b220-e0592509066d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:49.697582 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf47f41-8c45-46bf-b220-e0592509066d admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:49.709861 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1289/2585] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:54:49.714162 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4206b-7d19-4922-b8b6-4a5313e07910 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:49.730472 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4206b-7d19-4922-b8b6-4a5313e07910 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:49.735437 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056ba98-bc98-4f3f-98fb-b21ffac54530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:49.736331 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056ba98-bc98-4f3f-98fb-b21ffac54530 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:49.736631 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056ba98-bc98-4f3f-98fb-b21ffac54530 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:49.736905 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056ba98-bc98-4f3f-98fb-b21ffac54530 admin admin] PATH_INFO: `/v3/projects/ef39352fe7714fac9d2235fb556c0531/users/0fc065a56e5f499ababfb5272ef309c9/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:49.759748 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056ba98-bc98-4f3f-98fb-b21ffac54530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef39352fe7714fac9d2235fb556c0531, user_id=0fc065a56e5f499ababfb5272ef309c9, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:49.762539 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056ba98-bc98-4f3f-98fb-b21ffac54530 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:49.767280 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:49.790085 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1297/2586] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:54:49 2022] PUT /identity/v3/projects/ef39352fe7714fac9d2235fb556c0531/users/0fc065a56e5f499ababfb5272ef309c9/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:54:49.795306 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84183b-a1f5-4b4e-a4fa-5bb18f092efc None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:49.795624 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84183b-a1f5-4b4e-a4fa-5bb18f092efc None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:49.795910 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84183b-a1f5-4b4e-a4fa-5bb18f092efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:49.833433 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-bd84183b-a1f5-4b4e-a4fa-5bb18f092efc None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:49.834926 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-bd84183b-a1f5-4b4e-a4fa-5bb18f092efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:49.900709 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:54:49.915772 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1290/2587] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:49.925571 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056ba98-bc98-4f3f-98fb-b21ffac54530 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:49.928187 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-1056ba98-bc98-4f3f-98fb-b21ffac54530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:49.995915 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056ba98-bc98-4f3f-98fb-b21ffac54530 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:49.999866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b805f20-ae56-44f1-9a54-f89d4c180917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:50.000627 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b805f20-ae56-44f1-9a54-f89d4c180917 service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:50.000746 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b805f20-ae56-44f1-9a54-f89d4c180917 service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:50.002990 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b805f20-ae56-44f1-9a54-f89d4c180917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:50.011344 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b805f20-ae56-44f1-9a54-f89d4c180917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:50.012832 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b805f20-ae56-44f1-9a54-f89d4c180917 service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:50.026713 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1298/2588] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:54.655780 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b26f9-cff2-40fc-ab14-bce05a297681 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:54.656347 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b26f9-cff2-40fc-ab14-bce05a297681 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:54.656347 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b26f9-cff2-40fc-ab14-bce05a297681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:54.686631 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-f07b26f9-cff2-40fc-ab14-bce05a297681 None None] MFA Rules not processed for user `0fc065a56e5f499ababfb5272ef309c9`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:54.687857 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-f07b26f9-cff2-40fc-ab14-bce05a297681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:54.759017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1291/2589] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:54:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:54.778105 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b805f20-ae56-44f1-9a54-f89d4c180917 service neutron] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:54.781239 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-3b805f20-ae56-44f1-9a54-f89d4c180917 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:54.865393 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b805f20-ae56-44f1-9a54-f89d4c180917 service neutron] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:54.871172 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79366d7-5bed-41ec-81e4-9478b6631bd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:54.871819 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79366d7-5bed-41ec-81e4-9478b6631bd3 service nova] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:54.872100 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79366d7-5bed-41ec-81e4-9478b6631bd3 service nova] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:54.872372 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79366d7-5bed-41ec-81e4-9478b6631bd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:54.881828 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79366d7-5bed-41ec-81e4-9478b6631bd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:54.883461 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79366d7-5bed-41ec-81e4-9478b6631bd3 service nova] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:54.892713 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1299/2590] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:54:56.448810 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08768877-f52f-4923-8765-5159a21cc8f5 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:56.449349 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08768877-f52f-4923-8765-5159a21cc8f5 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:56.449349 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08768877-f52f-4923-8765-5159a21cc8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:56.468534 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-08768877-f52f-4923-8765-5159a21cc8f5 None None] MFA Rules not processed for user `0fc065a56e5f499ababfb5272ef309c9`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:54:56.470073 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-08768877-f52f-4923-8765-5159a21cc8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:56.478287 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1292/2591] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:54:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:54:56.823483 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79366d7-5bed-41ec-81e4-9478b6631bd3 service nova] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:54:56.834506 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79366d7-5bed-41ec-81e4-9478b6631bd3 service nova] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:54:56.838404 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610982e-dbf4-4856-a1ab-8c74b90d653a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:54:56.839052 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610982e-dbf4-4856-a1ab-8c74b90d653a service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:54:56.839325 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610982e-dbf4-4856-a1ab-8c74b90d653a service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:54:56.839595 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610982e-dbf4-4856-a1ab-8c74b90d653a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:54:56.841457 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-f610982e-dbf4-4856-a1ab-8c74b90d653a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:54:56.860319 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610982e-dbf4-4856-a1ab-8c74b90d653a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:54:56.862156 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610982e-dbf4-4856-a1ab-8c74b90d653a service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:54:56.872181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1300/2592] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:54:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:00.504919 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44794743-b5a1-4a1a-af1b-498661874ea7 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:00.505385 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44794743-b5a1-4a1a-af1b-498661874ea7 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:00.505480 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44794743-b5a1-4a1a-af1b-498661874ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:00.523934 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-44794743-b5a1-4a1a-af1b-498661874ea7 None None] MFA Rules not processed for user `c9647d15389e49e6b7c43ea1b1538a13`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:00.525144 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-44794743-b5a1-4a1a-af1b-498661874ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:00.583508 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1293/2593] 10.222.0.27 () {58 vars in 967 bytes} [Tue Jul 5 20:55:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:00.597023 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610982e-dbf4-4856-a1ab-8c74b90d653a service neutron] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:00.598537 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-f610982e-dbf4-4856-a1ab-8c74b90d653a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:00.672145 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610982e-dbf4-4856-a1ab-8c74b90d653a service neutron] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:00.677226 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f939fe-d00d-4175-a6e8-42f50c5ba2a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90aa580a2e10467a93c2d79d1906bd8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:00.677869 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f939fe-d00d-4175-a6e8-42f50c5ba2a9 service swift] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:00.678152 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f939fe-d00d-4175-a6e8-42f50c5ba2a9 service swift] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:00.678419 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f939fe-d00d-4175-a6e8-42f50c5ba2a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:00.686957 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f939fe-d00d-4175-a6e8-42f50c5ba2a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:00.688512 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f939fe-d00d-4175-a6e8-42f50c5ba2a9 service swift] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:00.693321 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:00.697481 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1301/2594] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Jul 5 20:55:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 05 20:55:10.576655 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=60 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:40.377882 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44794743-b5a1-4a1a-af1b-498661874ea7 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:40.387900 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44794743-b5a1-4a1a-af1b-498661874ea7 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:40.392586 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d97c5e-b59a-4406-910a-ab02f5cec92a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:40.393236 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d97c5e-b59a-4406-910a-ab02f5cec92a service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:40.393515 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d97c5e-b59a-4406-910a-ab02f5cec92a service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:40.393788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d97c5e-b59a-4406-910a-ab02f5cec92a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:40.395922 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-25d97c5e-b59a-4406-910a-ab02f5cec92a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:40.409157 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d97c5e-b59a-4406-910a-ab02f5cec92a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:40.410646 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d97c5e-b59a-4406-910a-ab02f5cec92a service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:40.421988 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1294/2595] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:43.571921 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f939fe-d00d-4175-a6e8-42f50c5ba2a9 service swift] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:43.573365 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-99f939fe-d00d-4175-a6e8-42f50c5ba2a9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:43.625456 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d97c5e-b59a-4406-910a-ab02f5cec92a service neutron] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:43.627063 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-25d97c5e-b59a-4406-910a-ab02f5cec92a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:43.640110 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d97c5e-b59a-4406-910a-ab02f5cec92a service neutron] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:43.645318 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb152e41-88aa-4c32-9169-6307cf17dfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:43.646246 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb152e41-88aa-4c32-9169-6307cf17dfa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:43.646646 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb152e41-88aa-4c32-9169-6307cf17dfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:43.646934 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb152e41-88aa-4c32-9169-6307cf17dfa9 admin admin] PATH_INFO: `/v3/users/1f6d6f1250b14637bb24345550161cda` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:43.648196 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb152e41-88aa-4c32-9169-6307cf17dfa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f6d6f1250b14637bb24345550161cda)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:43.649269 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f939fe-d00d-4175-a6e8-42f50c5ba2a9 service swift] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:43.650248 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb152e41-88aa-4c32-9169-6307cf17dfa9 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:43.654766 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db588002-8146-4137-a3d4-b9a3f481cb16 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16662dd5e2e74163b6aa2e1e7ef07524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:43.655416 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db588002-8146-4137-a3d4-b9a3f481cb16 service placement] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:43.655699 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db588002-8146-4137-a3d4-b9a3f481cb16 service placement] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:43.655975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db588002-8146-4137-a3d4-b9a3f481cb16 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:43.657786 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-db588002-8146-4137-a3d4-b9a3f481cb16 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:43.670413 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db588002-8146-4137-a3d4-b9a3f481cb16 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:43.672008 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db588002-8146-4137-a3d4-b9a3f481cb16 service placement] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:43.683183 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1302/2596] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:43.699461 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-bb152e41-88aa-4c32-9169-6307cf17dfa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f6d6f1250b14637bb24345550161cda'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:43.706890 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-bb152e41-88aa-4c32-9169-6307cf17dfa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f6d6f1250b14637bb24345550161cda'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:43.719749 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-bb152e41-88aa-4c32-9169-6307cf17dfa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f6d6f1250b14637bb24345550161cda'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:43.720457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-bb152e41-88aa-4c32-9169-6307cf17dfa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f6d6f1250b14637bb24345550161cda'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:43.721055 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-bb152e41-88aa-4c32-9169-6307cf17dfa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f6d6f1250b14637bb24345550161cda'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:43.735241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1295/2597] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:55:43 2022] DELETE /identity/v3/users/1f6d6f1250b14637bb24345550161cda => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:43.912834 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db588002-8146-4137-a3d4-b9a3f481cb16 service placement] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:43.923423 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db588002-8146-4137-a3d4-b9a3f481cb16 service placement] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:43.985420 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623e24e-d38b-4495-80e0-9b875662c7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:43.986390 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623e24e-d38b-4495-80e0-9b875662c7cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:43.986657 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623e24e-d38b-4495-80e0-9b875662c7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:43.986930 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623e24e-d38b-4495-80e0-9b875662c7cf admin admin] PATH_INFO: `/v3/projects/15de4592868d4fa79817f1761b2003e0` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:43.988153 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623e24e-d38b-4495-80e0-9b875662c7cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=15de4592868d4fa79817f1761b2003e0)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:43.990150 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623e24e-d38b-4495-80e0-9b875662c7cf admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:44.038988 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-8623e24e-d38b-4495-80e0-9b875662c7cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15de4592868d4fa79817f1761b2003e0', 'request_id': 'req-8623e24e-d38b-4495-80e0-9b875662c7cf'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:44.045092 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-8623e24e-d38b-4495-80e0-9b875662c7cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15de4592868d4fa79817f1761b2003e0', 'request_id': 'req-8623e24e-d38b-4495-80e0-9b875662c7cf'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:44.054088 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-8623e24e-d38b-4495-80e0-9b875662c7cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15de4592868d4fa79817f1761b2003e0', 'request_id': 'req-8623e24e-d38b-4495-80e0-9b875662c7cf'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:44.066729 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-8623e24e-d38b-4495-80e0-9b875662c7cf admin admin] The token cache is being invalidate because project 15de4592868d4fa79817f1761b2003e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:55:44.067018 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-8623e24e-d38b-4495-80e0-9b875662c7cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:44.067645 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-8623e24e-d38b-4495-80e0-9b875662c7cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:44.069255 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1303/2598] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:55:43 2022] DELETE /identity/v3/projects/15de4592868d4fa79817f1761b2003e0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:44.074434 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9682efe-64c0-4dbc-8a19-82ec4e2c4f0d None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:44.074721 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9682efe-64c0-4dbc-8a19-82ec4e2c4f0d None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:44.074997 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9682efe-64c0-4dbc-8a19-82ec4e2c4f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:44.094249 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-c9682efe-64c0-4dbc-8a19-82ec4e2c4f0d None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:44.095565 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-c9682efe-64c0-4dbc-8a19-82ec4e2c4f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:44.161580 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1296/2599] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:55:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:44.169525 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07bff9-2ca7-47b5-8eae-786839dff704 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:44.169809 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07bff9-2ca7-47b5-8eae-786839dff704 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:44.170114 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07bff9-2ca7-47b5-8eae-786839dff704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:44.190278 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-ad07bff9-2ca7-47b5-8eae-786839dff704 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:44.191479 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-ad07bff9-2ca7-47b5-8eae-786839dff704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:44.199999 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1304/2600] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:55:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:55:44.204362 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9682efe-64c0-4dbc-8a19-82ec4e2c4f0d None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:44.214594 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9682efe-64c0-4dbc-8a19-82ec4e2c4f0d None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:44.222106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2cbd15-6916-4900-a097-ef44992e6c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:44.223231 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cbd15-6916-4900-a097-ef44992e6c60 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:44.223705 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cbd15-6916-4900-a097-ef44992e6c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:44.224130 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cbd15-6916-4900-a097-ef44992e6c60 admin admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:44.225181 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2cbd15-6916-4900-a097-ef44992e6c60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:55:44.225672 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2cbd15-6916-4900-a097-ef44992e6c60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:44.228291 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2cbd15-6916-4900-a097-ef44992e6c60 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:44.242542 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1297/2601] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:55:44.247466 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07bff9-2ca7-47b5-8eae-786839dff704 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:44.262297 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07bff9-2ca7-47b5-8eae-786839dff704 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:44.269573 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31f5a8-58a4-4a1e-acda-69fe5110d76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:44.270614 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31f5a8-58a4-4a1e-acda-69fe5110d76f admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:44.270939 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31f5a8-58a4-4a1e-acda-69fe5110d76f admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:44.271286 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31f5a8-58a4-4a1e-acda-69fe5110d76f admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:44.272295 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc31f5a8-58a4-4a1e-acda-69fe5110d76f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:44.274586 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc31f5a8-58a4-4a1e-acda-69fe5110d76f admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:44.285556 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:44.305573 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1305/2602] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:55:44 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:44.310093 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2cbd15-6916-4900-a097-ef44992e6c60 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:44.320689 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2cbd15-6916-4900-a097-ef44992e6c60 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:44.366146 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:44.381734 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c420965-447e-43e3-a2e8-e9e3636e1236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:44.382433 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c420965-447e-43e3-a2e8-e9e3636e1236 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:44.382712 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c420965-447e-43e3-a2e8-e9e3636e1236 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:44.382985 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c420965-447e-43e3-a2e8-e9e3636e1236 admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:44.383690 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c420965-447e-43e3-a2e8-e9e3636e1236 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:44.385649 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c420965-447e-43e3-a2e8-e9e3636e1236 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:44.406501 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1298/2603] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:55:44 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:55:44.410692 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31f5a8-58a4-4a1e-acda-69fe5110d76f admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:44.421350 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31f5a8-58a4-4a1e-acda-69fe5110d76f admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:44.426163 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183a3ae-591e-4f8c-8283-cdeba79674ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:44.426830 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183a3ae-591e-4f8c-8283-cdeba79674ae admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:44.427115 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183a3ae-591e-4f8c-8283-cdeba79674ae admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:44.427389 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183a3ae-591e-4f8c-8283-cdeba79674ae admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:44.428120 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183a3ae-591e-4f8c-8283-cdeba79674ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:44.429738 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183a3ae-591e-4f8c-8283-cdeba79674ae admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:44.440436 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1306/2604] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:55:44.444345 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c420965-447e-43e3-a2e8-e9e3636e1236 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:44.454404 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c420965-447e-43e3-a2e8-e9e3636e1236 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:44.459440 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aca4c7-b5b8-4dd6-a4b4-5d8dec46cbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:44.460085 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aca4c7-b5b8-4dd6-a4b4-5d8dec46cbed admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:44.460363 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aca4c7-b5b8-4dd6-a4b4-5d8dec46cbed admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:44.460632 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aca4c7-b5b8-4dd6-a4b4-5d8dec46cbed admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:44.461374 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aca4c7-b5b8-4dd6-a4b4-5d8dec46cbed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:44.463002 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aca4c7-b5b8-4dd6-a4b4-5d8dec46cbed admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:44.473112 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1299/2605] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:55:44.477382 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183a3ae-591e-4f8c-8283-cdeba79674ae admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:44.488073 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183a3ae-591e-4f8c-8283-cdeba79674ae admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:44.493652 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08650d-5d4a-458f-accb-4703ac045df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:44.494569 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08650d-5d4a-458f-accb-4703ac045df5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:44.494847 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08650d-5d4a-458f-accb-4703ac045df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:44.495115 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08650d-5d4a-458f-accb-4703ac045df5 admin admin] PATH_INFO: `/v3/projects/156dcb116a9146f48387241c6d5512d4/users/e6569e8d789544b0b866ed65fdaa9f22/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:44.509737 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b08650d-5d4a-458f-accb-4703ac045df5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=156dcb116a9146f48387241c6d5512d4, user_id=e6569e8d789544b0b866ed65fdaa9f22, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:44.512436 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b08650d-5d4a-458f-accb-4703ac045df5 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:44.527663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1307/2606] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:44 2022] PUT /identity/v3/projects/156dcb116a9146f48387241c6d5512d4/users/e6569e8d789544b0b866ed65fdaa9f22/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:44.538460 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a1c7d-2b0c-4cf2-81ed-d9f0d26fad27 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:44.538732 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a1c7d-2b0c-4cf2-81ed-d9f0d26fad27 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:44.539018 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a1c7d-2b0c-4cf2-81ed-d9f0d26fad27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:44.566258 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-586a1c7d-2b0c-4cf2-81ed-d9f0d26fad27 None None] MFA Rules not processed for user `e6569e8d789544b0b866ed65fdaa9f22`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:44.567500 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-586a1c7d-2b0c-4cf2-81ed-d9f0d26fad27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:44.643055 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1300/2607] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:55:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:44.657639 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08650d-5d4a-458f-accb-4703ac045df5 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:44.659723 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-3b08650d-5d4a-458f-accb-4703ac045df5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:44.739434 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08650d-5d4a-458f-accb-4703ac045df5 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:44.746520 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87681b51-62a5-417b-a228-890a8848e0af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:44.747165 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87681b51-62a5-417b-a228-890a8848e0af service nova] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:44.747437 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87681b51-62a5-417b-a228-890a8848e0af service nova] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:44.747716 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87681b51-62a5-417b-a228-890a8848e0af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:44.756175 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87681b51-62a5-417b-a228-890a8848e0af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:44.757770 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87681b51-62a5-417b-a228-890a8848e0af service nova] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:44.767092 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1308/2608] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:45.005493 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a1c7d-2b0c-4cf2-81ed-d9f0d26fad27 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:45.070642 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a1c7d-2b0c-4cf2-81ed-d9f0d26fad27 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:45.075220 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90238eb-e704-483e-942c-2f50474e3cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:45.076105 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90238eb-e704-483e-942c-2f50474e3cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:45.076390 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90238eb-e704-483e-942c-2f50474e3cac admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:45.076667 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90238eb-e704-483e-942c-2f50474e3cac admin admin] PATH_INFO: `/v3/users/e6569e8d789544b0b866ed65fdaa9f22` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:45.078028 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90238eb-e704-483e-942c-2f50474e3cac admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6569e8d789544b0b866ed65fdaa9f22)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:45.079987 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90238eb-e704-483e-942c-2f50474e3cac admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:45.131455 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c90238eb-e704-483e-942c-2f50474e3cac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6569e8d789544b0b866ed65fdaa9f22'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:45.149257 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c90238eb-e704-483e-942c-2f50474e3cac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6569e8d789544b0b866ed65fdaa9f22'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:45.151670 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:45.166725 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c90238eb-e704-483e-942c-2f50474e3cac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6569e8d789544b0b866ed65fdaa9f22'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:45.167745 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c90238eb-e704-483e-942c-2f50474e3cac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6569e8d789544b0b866ed65fdaa9f22'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:45.168541 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c90238eb-e704-483e-942c-2f50474e3cac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6569e8d789544b0b866ed65fdaa9f22'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:45.185069 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1301/2609] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:55:45 2022] DELETE /identity/v3/users/e6569e8d789544b0b866ed65fdaa9f22 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:55:45.188995 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e23891-cdfd-42c1-a236-102361eb0b08 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:45.189283 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e23891-cdfd-42c1-a236-102361eb0b08 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:45.189560 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e23891-cdfd-42c1-a236-102361eb0b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:45.208312 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-20e23891-cdfd-42c1-a236-102361eb0b08 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:45.209524 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-20e23891-cdfd-42c1-a236-102361eb0b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:45.285197 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1309/2610] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:55:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:45.296647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90238eb-e704-483e-942c-2f50474e3cac admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:45.298100 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-c90238eb-e704-483e-942c-2f50474e3cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:45.356794 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90238eb-e704-483e-942c-2f50474e3cac admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:45.360680 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1b583-8c7e-4d59-be8a-ddeb4591f177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:45.361361 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1b583-8c7e-4d59-be8a-ddeb4591f177 service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:45.361642 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1b583-8c7e-4d59-be8a-ddeb4591f177 service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:45.361947 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1b583-8c7e-4d59-be8a-ddeb4591f177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:45.371294 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1b583-8c7e-4d59-be8a-ddeb4591f177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:45.372790 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1b583-8c7e-4d59-be8a-ddeb4591f177 service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:45.383791 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1302/2611] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:45.746522 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e23891-cdfd-42c1-a236-102361eb0b08 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:45.748254 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-20e23891-cdfd-42c1-a236-102361eb0b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:45.761387 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e23891-cdfd-42c1-a236-102361eb0b08 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:45.766377 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68386d35-7a95-47e7-afc9-ffc5f80e52ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:45.768305 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68386d35-7a95-47e7-afc9-ffc5f80e52ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:45.768767 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68386d35-7a95-47e7-afc9-ffc5f80e52ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:45.769044 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68386d35-7a95-47e7-afc9-ffc5f80e52ce admin admin] PATH_INFO: `/v3/projects/156dcb116a9146f48387241c6d5512d4` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:45.770303 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68386d35-7a95-47e7-afc9-ffc5f80e52ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=156dcb116a9146f48387241c6d5512d4)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:45.772484 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68386d35-7a95-47e7-afc9-ffc5f80e52ce admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:45.812265 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:45.822616 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-68386d35-7a95-47e7-afc9-ffc5f80e52ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '156dcb116a9146f48387241c6d5512d4', 'request_id': 'req-68386d35-7a95-47e7-afc9-ffc5f80e52ce'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:45.828253 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-68386d35-7a95-47e7-afc9-ffc5f80e52ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '156dcb116a9146f48387241c6d5512d4', 'request_id': 'req-68386d35-7a95-47e7-afc9-ffc5f80e52ce'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:45.839242 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-68386d35-7a95-47e7-afc9-ffc5f80e52ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '156dcb116a9146f48387241c6d5512d4', 'request_id': 'req-68386d35-7a95-47e7-afc9-ffc5f80e52ce'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:45.851403 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-68386d35-7a95-47e7-afc9-ffc5f80e52ce admin admin] The token cache is being invalidate because project 156dcb116a9146f48387241c6d5512d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:55:45.851710 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-68386d35-7a95-47e7-afc9-ffc5f80e52ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:45.852388 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-68386d35-7a95-47e7-afc9-ffc5f80e52ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:45.855063 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1310/2612] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:55:45 2022] DELETE /identity/v3/projects/156dcb116a9146f48387241c6d5512d4 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:45.860202 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70576efb-0287-4a36-a492-1f4470c02d7b None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:45.860674 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70576efb-0287-4a36-a492-1f4470c02d7b None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:45.860771 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70576efb-0287-4a36-a492-1f4470c02d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:45.880181 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-70576efb-0287-4a36-a492-1f4470c02d7b None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:45.881401 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-70576efb-0287-4a36-a492-1f4470c02d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:45.942481 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1303/2613] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:55:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:45.951453 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ff1d3-80b2-4d42-a5f5-6e30f3917481 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:45.951739 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ff1d3-80b2-4d42-a5f5-6e30f3917481 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:45.952010 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ff1d3-80b2-4d42-a5f5-6e30f3917481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:45.971159 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-0a9ff1d3-80b2-4d42-a5f5-6e30f3917481 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:45.972381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-0a9ff1d3-80b2-4d42-a5f5-6e30f3917481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:45.980915 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1311/2614] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:55:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:45.985312 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70576efb-0287-4a36-a492-1f4470c02d7b None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:45.995145 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70576efb-0287-4a36-a492-1f4470c02d7b None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:46.000097 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a93aa-36cc-401c-8cd2-b2dcacc62806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:46.000749 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a93aa-36cc-401c-8cd2-b2dcacc62806 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:46.001045 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a93aa-36cc-401c-8cd2-b2dcacc62806 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:46.001306 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a93aa-36cc-401c-8cd2-b2dcacc62806 admin admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:46.002051 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a93aa-36cc-401c-8cd2-b2dcacc62806 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:55:46.002357 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a93aa-36cc-401c-8cd2-b2dcacc62806 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:46.003956 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a93aa-36cc-401c-8cd2-b2dcacc62806 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:46.016214 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1304/2615] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:55:46.020559 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ff1d3-80b2-4d42-a5f5-6e30f3917481 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:46.030661 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ff1d3-80b2-4d42-a5f5-6e30f3917481 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:46.035472 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084e77b-6424-4d1f-b4dd-711b0f4a991c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:46.036123 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084e77b-6424-4d1f-b4dd-711b0f4a991c admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:46.036396 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084e77b-6424-4d1f-b4dd-711b0f4a991c admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:46.036663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084e77b-6424-4d1f-b4dd-711b0f4a991c admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:46.037473 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084e77b-6424-4d1f-b4dd-711b0f4a991c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:46.039526 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084e77b-6424-4d1f-b4dd-711b0f4a991c admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:46.068589 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1312/2616] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:55:46 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:46.073313 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a93aa-36cc-401c-8cd2-b2dcacc62806 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:46.083683 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a93aa-36cc-401c-8cd2-b2dcacc62806 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:46.140696 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14248d78-71a4-4005-9db0-33a52db5494f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:46.141377 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14248d78-71a4-4005-9db0-33a52db5494f admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:46.141657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14248d78-71a4-4005-9db0-33a52db5494f admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:46.141971 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14248d78-71a4-4005-9db0-33a52db5494f admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:46.142656 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14248d78-71a4-4005-9db0-33a52db5494f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:46.144592 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14248d78-71a4-4005-9db0-33a52db5494f admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:46.153803 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:46.169570 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1305/2617] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:55:46 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:46.174056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084e77b-6424-4d1f-b4dd-711b0f4a991c admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:46.185127 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084e77b-6424-4d1f-b4dd-711b0f4a991c admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:46.190415 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911dddf-fd6e-4aa9-8d6d-20d8d3880f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:46.191077 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911dddf-fd6e-4aa9-8d6d-20d8d3880f9f admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:46.191360 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911dddf-fd6e-4aa9-8d6d-20d8d3880f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:46.191635 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911dddf-fd6e-4aa9-8d6d-20d8d3880f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:46.192363 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c911dddf-fd6e-4aa9-8d6d-20d8d3880f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:46.194093 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c911dddf-fd6e-4aa9-8d6d-20d8d3880f9f admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:46.204950 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1313/2618] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:46.209042 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14248d78-71a4-4005-9db0-33a52db5494f admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:46.219583 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14248d78-71a4-4005-9db0-33a52db5494f admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:46.225383 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b8ddf-f546-4a88-aaf4-48ba13500e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:46.226094 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b8ddf-f546-4a88-aaf4-48ba13500e02 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:46.226355 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b8ddf-f546-4a88-aaf4-48ba13500e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:46.226626 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b8ddf-f546-4a88-aaf4-48ba13500e02 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:46.227445 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b8ddf-f546-4a88-aaf4-48ba13500e02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:46.229048 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b8ddf-f546-4a88-aaf4-48ba13500e02 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:46.239430 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1306/2619] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:46.243386 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911dddf-fd6e-4aa9-8d6d-20d8d3880f9f admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:46.253713 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911dddf-fd6e-4aa9-8d6d-20d8d3880f9f admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:46.259701 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040a134-00be-41f8-a886-a6d8ac0e53cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:46.260589 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040a134-00be-41f8-a886-a6d8ac0e53cf admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:46.260869 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040a134-00be-41f8-a886-a6d8ac0e53cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:46.261143 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040a134-00be-41f8-a886-a6d8ac0e53cf admin admin] PATH_INFO: `/v3/projects/eef7cd6349f546ae8dd89fc32462eca6/users/d1ee99a3f4fb43cfa26e5f1eb4fe4982/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:46.277199 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040a134-00be-41f8-a886-a6d8ac0e53cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=eef7cd6349f546ae8dd89fc32462eca6, user_id=d1ee99a3f4fb43cfa26e5f1eb4fe4982, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:46.280304 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040a134-00be-41f8-a886-a6d8ac0e53cf admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:46.294904 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1314/2620] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:46 2022] PUT /identity/v3/projects/eef7cd6349f546ae8dd89fc32462eca6/users/d1ee99a3f4fb43cfa26e5f1eb4fe4982/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:46.305446 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d441d-b8a7-444a-a310-e2fd82617887 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:46.305735 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d441d-b8a7-444a-a310-e2fd82617887 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:46.306046 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d441d-b8a7-444a-a310-e2fd82617887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:46.334352 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-937d441d-b8a7-444a-a310-e2fd82617887 None None] MFA Rules not processed for user `d1ee99a3f4fb43cfa26e5f1eb4fe4982`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:46.335572 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-937d441d-b8a7-444a-a310-e2fd82617887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:46.406419 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1307/2621] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:55:46 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:46.410797 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040a134-00be-41f8-a886-a6d8ac0e53cf admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:46.475715 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040a134-00be-41f8-a886-a6d8ac0e53cf admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:46.480619 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011bb25e-8092-4102-a0c8-d00822b8fda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:46.481642 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bb25e-8092-4102-a0c8-d00822b8fda8 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:46.481642 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bb25e-8092-4102-a0c8-d00822b8fda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:46.481822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bb25e-8092-4102-a0c8-d00822b8fda8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:46.482549 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011bb25e-8092-4102-a0c8-d00822b8fda8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:46.484526 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011bb25e-8092-4102-a0c8-d00822b8fda8 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:46.512880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1315/2622] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:55:46 2022] POST /identity/v3/projects => generated 369 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:46.517048 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d441d-b8a7-444a-a310-e2fd82617887 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:46.529355 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d441d-b8a7-444a-a310-e2fd82617887 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:46.591426 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258277a-96a3-4f8b-a69f-48075d2a1b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:46.592230 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258277a-96a3-4f8b-a69f-48075d2a1b81 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:46.592514 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258277a-96a3-4f8b-a69f-48075d2a1b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:46.592792 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258277a-96a3-4f8b-a69f-48075d2a1b81 admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:46.593604 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258277a-96a3-4f8b-a69f-48075d2a1b81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:46.596017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258277a-96a3-4f8b-a69f-48075d2a1b81 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:46.621057 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1308/2623] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:55:46 2022] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:46.623195 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011bb25e-8092-4102-a0c8-d00822b8fda8 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:46.634513 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011bb25e-8092-4102-a0c8-d00822b8fda8 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:46.639310 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece49d5-4c31-401a-8ce3-198e3f1fa73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:46.639975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece49d5-4c31-401a-8ce3-198e3f1fa73f admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:46.640253 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece49d5-4c31-401a-8ce3-198e3f1fa73f admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:46.640525 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece49d5-4c31-401a-8ce3-198e3f1fa73f admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:46.641248 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece49d5-4c31-401a-8ce3-198e3f1fa73f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:46.642901 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece49d5-4c31-401a-8ce3-198e3f1fa73f admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:46.654601 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1316/2624] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:46.658935 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258277a-96a3-4f8b-a69f-48075d2a1b81 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:46.669114 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258277a-96a3-4f8b-a69f-48075d2a1b81 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:46.673704 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd6101-e420-4c15-8b88-febd4da2f3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:46.674653 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd6101-e420-4c15-8b88-febd4da2f3b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:46.674949 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd6101-e420-4c15-8b88-febd4da2f3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:46.675340 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd6101-e420-4c15-8b88-febd4da2f3b9 admin admin] PATH_INFO: `/v3/projects/2805715fe118416098d355839a82c7bc/users/6b610c70fbd24bf680f99330237826d4/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:46.690458 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd6101-e420-4c15-8b88-febd4da2f3b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2805715fe118416098d355839a82c7bc, user_id=6b610c70fbd24bf680f99330237826d4, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:46.693110 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd6101-e420-4c15-8b88-febd4da2f3b9 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:46.706848 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1309/2625] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:46 2022] PUT /identity/v3/projects/2805715fe118416098d355839a82c7bc/users/6b610c70fbd24bf680f99330237826d4/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:55:46.710986 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece49d5-4c31-401a-8ce3-198e3f1fa73f admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:46.722261 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece49d5-4c31-401a-8ce3-198e3f1fa73f admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:46.757933 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:46.786814 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ac90d-b20d-4321-b4ee-2e976c30593b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:46.787509 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ac90d-b20d-4321-b4ee-2e976c30593b admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:46.787765 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ac90d-b20d-4321-b4ee-2e976c30593b admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:46.788033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ac90d-b20d-4321-b4ee-2e976c30593b admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:46.788804 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ac90d-b20d-4321-b4ee-2e976c30593b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:46.790505 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ac90d-b20d-4321-b4ee-2e976c30593b admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:46.800837 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1317/2626] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:55:46.805370 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd6101-e420-4c15-8b88-febd4da2f3b9 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:46.816339 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd6101-e420-4c15-8b88-febd4da2f3b9 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:46.821323 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761450f-0683-499e-9dfd-17f70c63deda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:46.822252 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761450f-0683-499e-9dfd-17f70c63deda admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:46.822534 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761450f-0683-499e-9dfd-17f70c63deda admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:46.822808 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761450f-0683-499e-9dfd-17f70c63deda admin admin] PATH_INFO: `/v3/projects/2805715fe118416098d355839a82c7bc/users/6b610c70fbd24bf680f99330237826d4/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:46.824857 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7761450f-0683-499e-9dfd-17f70c63deda admin admin] RBAC: Authorizing `identity:create_grant(project_id=2805715fe118416098d355839a82c7bc, user_id=6b610c70fbd24bf680f99330237826d4, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:46.827564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7761450f-0683-499e-9dfd-17f70c63deda admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:46.838013 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1310/2627] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:46 2022] PUT /identity/v3/projects/2805715fe118416098d355839a82c7bc/users/6b610c70fbd24bf680f99330237826d4/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:55:46.848418 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bcaad9-6c60-4cf7-a887-661531a24032 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:46.848700 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bcaad9-6c60-4cf7-a887-661531a24032 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:46.849068 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bcaad9-6c60-4cf7-a887-661531a24032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:46.877094 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-19bcaad9-6c60-4cf7-a887-661531a24032 None None] MFA Rules not processed for user `6b610c70fbd24bf680f99330237826d4`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:46.878326 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-19bcaad9-6c60-4cf7-a887-661531a24032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:46.946550 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1318/2628] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:55:46 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:46.959340 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761450f-0683-499e-9dfd-17f70c63deda admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:46.961209 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-7761450f-0683-499e-9dfd-17f70c63deda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:46.990935 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:47.024646 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761450f-0683-499e-9dfd-17f70c63deda admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:47.029152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3bd41-8d77-4aec-9530-e8a066950273 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:47.029891 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3bd41-8d77-4aec-9530-e8a066950273 service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:47.030176 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3bd41-8d77-4aec-9530-e8a066950273 service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:47.030449 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3bd41-8d77-4aec-9530-e8a066950273 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:47.040591 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3bd41-8d77-4aec-9530-e8a066950273 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:47.042101 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3bd41-8d77-4aec-9530-e8a066950273 service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:47.051709 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1311/2629] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:46 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:47.096147 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bcaad9-6c60-4cf7-a887-661531a24032 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:47.098072 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-19bcaad9-6c60-4cf7-a887-661531a24032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:47.111302 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bcaad9-6c60-4cf7-a887-661531a24032 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:47.115371 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96233a-9c2f-4c15-aca4-ab5472f3bd48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:47.116001 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96233a-9c2f-4c15-aca4-ab5472f3bd48 service cinder] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:47.116281 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96233a-9c2f-4c15-aca4-ab5472f3bd48 service cinder] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:47.116551 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96233a-9c2f-4c15-aca4-ab5472f3bd48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:47.174528 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c96233a-9c2f-4c15-aca4-ab5472f3bd48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:47.175952 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c96233a-9c2f-4c15-aca4-ab5472f3bd48 service cinder] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:47.185244 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1319/2630] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:47 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:50.126672 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65d6c6-5784-4366-9426-a661a1ae78ef None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:50.127159 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65d6c6-5784-4366-9426-a661a1ae78ef None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:50.127257 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65d6c6-5784-4366-9426-a661a1ae78ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:50.146870 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-ac65d6c6-5784-4366-9426-a661a1ae78ef None None] MFA Rules not processed for user `0fc065a56e5f499ababfb5272ef309c9`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:50.148101 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-ac65d6c6-5784-4366-9426-a661a1ae78ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:50.208940 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1312/2631] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:55:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:50.548838 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96233a-9c2f-4c15-aca4-ab5472f3bd48 service cinder] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:50.606983 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=100 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:50.612972 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96233a-9c2f-4c15-aca4-ab5472f3bd48 service cinder] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:50.617570 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c538bf-15f5-4587-872c-2827437e9d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:50.618514 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c538bf-15f5-4587-872c-2827437e9d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:50.618768 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c538bf-15f5-4587-872c-2827437e9d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:50.619070 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c538bf-15f5-4587-872c-2827437e9d62 admin admin] PATH_INFO: `/v3/users/d1ee99a3f4fb43cfa26e5f1eb4fe4982` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:50.620265 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c538bf-15f5-4587-872c-2827437e9d62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1ee99a3f4fb43cfa26e5f1eb4fe4982)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:50.622241 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c538bf-15f5-4587-872c-2827437e9d62 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:50.671243 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-e0c538bf-15f5-4587-872c-2827437e9d62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1ee99a3f4fb43cfa26e5f1eb4fe4982'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:50.684231 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-e0c538bf-15f5-4587-872c-2827437e9d62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1ee99a3f4fb43cfa26e5f1eb4fe4982'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:50.691150 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-e0c538bf-15f5-4587-872c-2827437e9d62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1ee99a3f4fb43cfa26e5f1eb4fe4982'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:50.691876 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-e0c538bf-15f5-4587-872c-2827437e9d62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1ee99a3f4fb43cfa26e5f1eb4fe4982'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:50.692476 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-e0c538bf-15f5-4587-872c-2827437e9d62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1ee99a3f4fb43cfa26e5f1eb4fe4982'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:50.706236 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1320/2632] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:55:50 2022] DELETE /identity/v3/users/d1ee99a3f4fb43cfa26e5f1eb4fe4982 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:50.710723 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e4800-35b9-4c3d-b91c-645d1918f838 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:50.711131 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e4800-35b9-4c3d-b91c-645d1918f838 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:50.711471 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e4800-35b9-4c3d-b91c-645d1918f838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:50.729421 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-821e4800-35b9-4c3d-b91c-645d1918f838 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:50.730793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-821e4800-35b9-4c3d-b91c-645d1918f838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:50.791324 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1313/2633] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:55:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:50.801487 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c538bf-15f5-4587-872c-2827437e9d62 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:50.803183 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-e0c538bf-15f5-4587-872c-2827437e9d62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:50.880360 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c538bf-15f5-4587-872c-2827437e9d62 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:50.885629 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c317f-9ff3-428d-8eee-52f58bdb7314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:50.890509 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c317f-9ff3-428d-8eee-52f58bdb7314 service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:50.890796 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c317f-9ff3-428d-8eee-52f58bdb7314 service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:50.891070 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c317f-9ff3-428d-8eee-52f58bdb7314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:50.901218 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c317f-9ff3-428d-8eee-52f58bdb7314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:50.903055 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c317f-9ff3-428d-8eee-52f58bdb7314 service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:50.913583 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1321/2634] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:51.210866 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e4800-35b9-4c3d-b91c-645d1918f838 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:51.214229 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-821e4800-35b9-4c3d-b91c-645d1918f838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:51.234387 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e4800-35b9-4c3d-b91c-645d1918f838 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:51.241807 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37015e-4d3b-414d-9ff3-2d489232c755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:51.242813 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37015e-4d3b-414d-9ff3-2d489232c755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:51.243088 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37015e-4d3b-414d-9ff3-2d489232c755 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:51.243365 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37015e-4d3b-414d-9ff3-2d489232c755 admin admin] PATH_INFO: `/v3/projects/eef7cd6349f546ae8dd89fc32462eca6` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:51.244685 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f37015e-4d3b-414d-9ff3-2d489232c755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eef7cd6349f546ae8dd89fc32462eca6)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:51.246643 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f37015e-4d3b-414d-9ff3-2d489232c755 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:51.294738 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-6f37015e-4d3b-414d-9ff3-2d489232c755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eef7cd6349f546ae8dd89fc32462eca6', 'request_id': 'req-6f37015e-4d3b-414d-9ff3-2d489232c755'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:51.301092 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-6f37015e-4d3b-414d-9ff3-2d489232c755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eef7cd6349f546ae8dd89fc32462eca6', 'request_id': 'req-6f37015e-4d3b-414d-9ff3-2d489232c755'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:51.310799 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-6f37015e-4d3b-414d-9ff3-2d489232c755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eef7cd6349f546ae8dd89fc32462eca6', 'request_id': 'req-6f37015e-4d3b-414d-9ff3-2d489232c755'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:51.313501 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:51.326458 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-6f37015e-4d3b-414d-9ff3-2d489232c755 admin admin] The token cache is being invalidate because project eef7cd6349f546ae8dd89fc32462eca6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:55:51.326750 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-6f37015e-4d3b-414d-9ff3-2d489232c755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:51.327414 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-6f37015e-4d3b-414d-9ff3-2d489232c755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:51.329080 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1314/2635] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:55:51 2022] DELETE /identity/v3/projects/eef7cd6349f546ae8dd89fc32462eca6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:51.333103 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c317f-9ff3-428d-8eee-52f58bdb7314 service neutron] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:51.343612 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c317f-9ff3-428d-8eee-52f58bdb7314 service neutron] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:51.400881 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eccf75-c37c-41e2-9cc5-23a82756e8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:51.401770 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eccf75-c37c-41e2-9cc5-23a82756e8f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:51.402107 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eccf75-c37c-41e2-9cc5-23a82756e8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:51.402442 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eccf75-c37c-41e2-9cc5-23a82756e8f6 admin admin] PATH_INFO: `/v3/users/6b610c70fbd24bf680f99330237826d4` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:51.403953 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eccf75-c37c-41e2-9cc5-23a82756e8f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b610c70fbd24bf680f99330237826d4)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:51.405914 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eccf75-c37c-41e2-9cc5-23a82756e8f6 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:51.427061 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:51.456036 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-67eccf75-c37c-41e2-9cc5-23a82756e8f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b610c70fbd24bf680f99330237826d4'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:51.468847 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-67eccf75-c37c-41e2-9cc5-23a82756e8f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b610c70fbd24bf680f99330237826d4'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:51.477418 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-67eccf75-c37c-41e2-9cc5-23a82756e8f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b610c70fbd24bf680f99330237826d4'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:51.478231 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-67eccf75-c37c-41e2-9cc5-23a82756e8f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b610c70fbd24bf680f99330237826d4'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:51.478851 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-67eccf75-c37c-41e2-9cc5-23a82756e8f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b610c70fbd24bf680f99330237826d4'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:51.492834 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1322/2636] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:55:51 2022] DELETE /identity/v3/users/6b610c70fbd24bf680f99330237826d4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:55:51.764776 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37015e-4d3b-414d-9ff3-2d489232c755 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:51.766449 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-6f37015e-4d3b-414d-9ff3-2d489232c755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:51.781193 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37015e-4d3b-414d-9ff3-2d489232c755 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:51.845578 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84797f6-2abf-4c3b-898c-4df75637c13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:51.846503 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84797f6-2abf-4c3b-898c-4df75637c13f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:51.846793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84797f6-2abf-4c3b-898c-4df75637c13f admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:51.847051 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84797f6-2abf-4c3b-898c-4df75637c13f admin admin] PATH_INFO: `/v3/projects/2805715fe118416098d355839a82c7bc` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:51.848254 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84797f6-2abf-4c3b-898c-4df75637c13f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2805715fe118416098d355839a82c7bc)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:51.850448 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84797f6-2abf-4c3b-898c-4df75637c13f admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:51.905020 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c84797f6-2abf-4c3b-898c-4df75637c13f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2805715fe118416098d355839a82c7bc', 'request_id': 'req-c84797f6-2abf-4c3b-898c-4df75637c13f'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:51.911472 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c84797f6-2abf-4c3b-898c-4df75637c13f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2805715fe118416098d355839a82c7bc', 'request_id': 'req-c84797f6-2abf-4c3b-898c-4df75637c13f'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:51.921409 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c84797f6-2abf-4c3b-898c-4df75637c13f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2805715fe118416098d355839a82c7bc', 'request_id': 'req-c84797f6-2abf-4c3b-898c-4df75637c13f'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:51.935849 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c84797f6-2abf-4c3b-898c-4df75637c13f admin admin] The token cache is being invalidate because project 2805715fe118416098d355839a82c7bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:55:51.936330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c84797f6-2abf-4c3b-898c-4df75637c13f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:51.937609 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c84797f6-2abf-4c3b-898c-4df75637c13f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:51.939512 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1315/2637] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:55:51 2022] DELETE /identity/v3/projects/2805715fe118416098d355839a82c7bc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:51.944841 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e14992-095e-4a9f-aaef-bdefed62a007 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:51.945343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e14992-095e-4a9f-aaef-bdefed62a007 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:51.945604 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e14992-095e-4a9f-aaef-bdefed62a007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:51.964475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-91e14992-095e-4a9f-aaef-bdefed62a007 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:51.965690 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-91e14992-095e-4a9f-aaef-bdefed62a007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:52.033917 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1323/2638] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:55:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:52.041863 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896cf83-7df4-48e0-9226-8fe890789c41 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:52.042275 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896cf83-7df4-48e0-9226-8fe890789c41 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:52.042557 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896cf83-7df4-48e0-9226-8fe890789c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:52.070979 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-9896cf83-7df4-48e0-9226-8fe890789c41 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:52.072242 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-9896cf83-7df4-48e0-9226-8fe890789c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:52.080441 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1316/2639] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:55:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:55:52.084936 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e14992-095e-4a9f-aaef-bdefed62a007 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:52.094997 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e14992-095e-4a9f-aaef-bdefed62a007 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:52.099497 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511de9a-4fdd-4e07-a3bc-bb3d181f7e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:52.100171 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511de9a-4fdd-4e07-a3bc-bb3d181f7e52 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:52.100447 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511de9a-4fdd-4e07-a3bc-bb3d181f7e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:52.100718 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511de9a-4fdd-4e07-a3bc-bb3d181f7e52 admin admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:52.101451 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8511de9a-4fdd-4e07-a3bc-bb3d181f7e52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:55:52.101749 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8511de9a-4fdd-4e07-a3bc-bb3d181f7e52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:52.103505 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8511de9a-4fdd-4e07-a3bc-bb3d181f7e52 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:52.115010 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1324/2640] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 05 20:55:52.119432 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896cf83-7df4-48e0-9226-8fe890789c41 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:52.128672 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896cf83-7df4-48e0-9226-8fe890789c41 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:52.133760 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996a1ee-d472-44f0-8fb6-8bfa85a986e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:52.134515 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996a1ee-d472-44f0-8fb6-8bfa85a986e4 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:52.134791 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996a1ee-d472-44f0-8fb6-8bfa85a986e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:52.135063 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996a1ee-d472-44f0-8fb6-8bfa85a986e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:52.135758 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996a1ee-d472-44f0-8fb6-8bfa85a986e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:52.137668 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996a1ee-d472-44f0-8fb6-8bfa85a986e4 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:52.171154 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1317/2641] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:55:52 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:52.175500 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511de9a-4fdd-4e07-a3bc-bb3d181f7e52 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:52.186172 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511de9a-4fdd-4e07-a3bc-bb3d181f7e52 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:52.248020 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1baa07-08da-4f8f-8e3a-2fb85c06ab9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:52.248726 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1baa07-08da-4f8f-8e3a-2fb85c06ab9b admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:52.249004 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1baa07-08da-4f8f-8e3a-2fb85c06ab9b admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:52.249261 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1baa07-08da-4f8f-8e3a-2fb85c06ab9b admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:52.250004 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1baa07-08da-4f8f-8e3a-2fb85c06ab9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:52.251927 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1baa07-08da-4f8f-8e3a-2fb85c06ab9b admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:52.275214 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1325/2642] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:55:52 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:52.280166 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996a1ee-d472-44f0-8fb6-8bfa85a986e4 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:52.290840 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996a1ee-d472-44f0-8fb6-8bfa85a986e4 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:52.295672 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a841f-68d8-42c1-a152-7fa4bff4bc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:52.296334 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a841f-68d8-42c1-a152-7fa4bff4bc5e admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:52.296612 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a841f-68d8-42c1-a152-7fa4bff4bc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:52.296865 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a841f-68d8-42c1-a152-7fa4bff4bc5e admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:52.297589 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a841f-68d8-42c1-a152-7fa4bff4bc5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:52.299230 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a841f-68d8-42c1-a152-7fa4bff4bc5e admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:52.311763 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1318/2643] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:52.315225 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1baa07-08da-4f8f-8e3a-2fb85c06ab9b admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:52.325479 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1baa07-08da-4f8f-8e3a-2fb85c06ab9b admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:52.330251 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f77445-0401-424e-a409-76231f6bd6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:52.330943 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f77445-0401-424e-a409-76231f6bd6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:52.331218 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f77445-0401-424e-a409-76231f6bd6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:52.331485 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f77445-0401-424e-a409-76231f6bd6d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:52.332235 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f77445-0401-424e-a409-76231f6bd6d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:52.333869 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f77445-0401-424e-a409-76231f6bd6d6 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:52.347082 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1326/2644] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:52.348318 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a841f-68d8-42c1-a152-7fa4bff4bc5e admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:52.358664 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a841f-68d8-42c1-a152-7fa4bff4bc5e admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:52.364160 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a40454-d74c-4e40-82a6-23775b223ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:52.365052 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a40454-d74c-4e40-82a6-23775b223ac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:52.365330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a40454-d74c-4e40-82a6-23775b223ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:52.365603 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a40454-d74c-4e40-82a6-23775b223ac4 admin admin] PATH_INFO: `/v3/projects/6d28614cd12d4396a0e9e669164b85d3/users/6e3b71830fec48d78610d4dcf47566be/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:52.381039 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a40454-d74c-4e40-82a6-23775b223ac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d28614cd12d4396a0e9e669164b85d3, user_id=6e3b71830fec48d78610d4dcf47566be, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:52.383847 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a40454-d74c-4e40-82a6-23775b223ac4 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:52.397408 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1319/2645] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:52 2022] PUT /identity/v3/projects/6d28614cd12d4396a0e9e669164b85d3/users/6e3b71830fec48d78610d4dcf47566be/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:55:52.408328 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ddbc2-657a-4223-be53-cb35402a2ccb None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:52.408615 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ddbc2-657a-4223-be53-cb35402a2ccb None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:52.408892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ddbc2-657a-4223-be53-cb35402a2ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:52.414940 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:52.440232 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-591ddbc2-657a-4223-be53-cb35402a2ccb None None] MFA Rules not processed for user `6e3b71830fec48d78610d4dcf47566be`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:52.441397 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-591ddbc2-657a-4223-be53-cb35402a2ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:52.511148 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1327/2646] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:55:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:52.515914 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a40454-d74c-4e40-82a6-23775b223ac4 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:52.541510 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:52.580555 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a40454-d74c-4e40-82a6-23775b223ac4 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:52.585574 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4084e4d-1355-4900-9481-16cd94f9930d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:52.586918 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4084e4d-1355-4900-9481-16cd94f9930d admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:52.586918 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4084e4d-1355-4900-9481-16cd94f9930d admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:52.586918 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4084e4d-1355-4900-9481-16cd94f9930d admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:52.587546 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4084e4d-1355-4900-9481-16cd94f9930d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:52.589492 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4084e4d-1355-4900-9481-16cd94f9930d admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:52.620308 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1320/2647] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:55:52 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:52.621626 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ddbc2-657a-4223-be53-cb35402a2ccb None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:52.634282 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ddbc2-657a-4223-be53-cb35402a2ccb None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:52.707262 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923686dd-cef8-4a92-be5d-07649208641a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:52.707951 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923686dd-cef8-4a92-be5d-07649208641a admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:52.708231 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923686dd-cef8-4a92-be5d-07649208641a admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:52.708503 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923686dd-cef8-4a92-be5d-07649208641a admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:52.709249 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923686dd-cef8-4a92-be5d-07649208641a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:52.711341 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923686dd-cef8-4a92-be5d-07649208641a admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:52.737163 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1328/2648] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:55:52 2022] POST /identity/v3/users => generated 296 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:55:52.738455 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4084e4d-1355-4900-9481-16cd94f9930d admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:52.749410 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4084e4d-1355-4900-9481-16cd94f9930d admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:52.754133 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc14f9df-ae7f-4375-81be-b39622e52e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:52.754808 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14f9df-ae7f-4375-81be-b39622e52e32 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:52.755088 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14f9df-ae7f-4375-81be-b39622e52e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:52.755360 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14f9df-ae7f-4375-81be-b39622e52e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:52.756120 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc14f9df-ae7f-4375-81be-b39622e52e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:52.757766 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc14f9df-ae7f-4375-81be-b39622e52e32 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:52.770852 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1321/2649] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:52.775024 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923686dd-cef8-4a92-be5d-07649208641a admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:52.786483 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923686dd-cef8-4a92-be5d-07649208641a admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:52.791276 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18dce7-590d-4b4c-8255-72f0c0620a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:52.792245 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18dce7-590d-4b4c-8255-72f0c0620a38 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:52.792587 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18dce7-590d-4b4c-8255-72f0c0620a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:52.792916 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18dce7-590d-4b4c-8255-72f0c0620a38 admin admin] PATH_INFO: `/v3/projects/6f6ae93b6adb4c21acf18a58a2622ddf/users/39d47377bde3498bb6f7557360ab5631/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:52.809549 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d18dce7-590d-4b4c-8255-72f0c0620a38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f6ae93b6adb4c21acf18a58a2622ddf, user_id=39d47377bde3498bb6f7557360ab5631, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:52.812261 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d18dce7-590d-4b4c-8255-72f0c0620a38 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:52.829952 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1329/2650] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:52 2022] PUT /identity/v3/projects/6f6ae93b6adb4c21acf18a58a2622ddf/users/39d47377bde3498bb6f7557360ab5631/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:55:52.833811 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc14f9df-ae7f-4375-81be-b39622e52e32 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:52.844240 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc14f9df-ae7f-4375-81be-b39622e52e32 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:52.903644 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070c381-508b-44fb-a4f9-088b6d2333c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:52.904644 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070c381-508b-44fb-a4f9-088b6d2333c7 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:52.904931 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070c381-508b-44fb-a4f9-088b6d2333c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:52.905172 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070c381-508b-44fb-a4f9-088b6d2333c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:52.905916 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b070c381-508b-44fb-a4f9-088b6d2333c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:52.907580 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b070c381-508b-44fb-a4f9-088b6d2333c7 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:52.917654 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1322/2651] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:52.922135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18dce7-590d-4b4c-8255-72f0c0620a38 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:52.932723 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18dce7-590d-4b4c-8255-72f0c0620a38 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:52.937577 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b539a-20bf-4a1c-9a1f-1a91e6fd68c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:52.938568 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b539a-20bf-4a1c-9a1f-1a91e6fd68c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:52.938947 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b539a-20bf-4a1c-9a1f-1a91e6fd68c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:52.939287 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b539a-20bf-4a1c-9a1f-1a91e6fd68c4 admin admin] PATH_INFO: `/v3/projects/6f6ae93b6adb4c21acf18a58a2622ddf/users/39d47377bde3498bb6f7557360ab5631/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:52.941340 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b539a-20bf-4a1c-9a1f-1a91e6fd68c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f6ae93b6adb4c21acf18a58a2622ddf, user_id=39d47377bde3498bb6f7557360ab5631, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:52.944122 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b539a-20bf-4a1c-9a1f-1a91e6fd68c4 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:52.955152 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1330/2652] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:52 2022] PUT /identity/v3/projects/6f6ae93b6adb4c21acf18a58a2622ddf/users/39d47377bde3498bb6f7557360ab5631/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:52.966609 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d12788-bcd7-4252-9d8d-9051849080dc None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:52.966891 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d12788-bcd7-4252-9d8d-9051849080dc None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:52.967469 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d12788-bcd7-4252-9d8d-9051849080dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:52.995845 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-54d12788-bcd7-4252-9d8d-9051849080dc None None] MFA Rules not processed for user `39d47377bde3498bb6f7557360ab5631`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:52.997087 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-54d12788-bcd7-4252-9d8d-9051849080dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:53.075181 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1323/2653] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:55:52 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:53.089398 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b539a-20bf-4a1c-9a1f-1a91e6fd68c4 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:53.091836 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-464b539a-20bf-4a1c-9a1f-1a91e6fd68c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:53.221652 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:53.239672 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b539a-20bf-4a1c-9a1f-1a91e6fd68c4 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:53.246534 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6173dfd-2515-41e7-8a63-4822fac288df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:53.247776 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6173dfd-2515-41e7-8a63-4822fac288df service cinder] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:53.248329 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6173dfd-2515-41e7-8a63-4822fac288df service cinder] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:53.249561 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6173dfd-2515-41e7-8a63-4822fac288df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:53.262963 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6173dfd-2515-41e7-8a63-4822fac288df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:53.265513 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6173dfd-2515-41e7-8a63-4822fac288df service cinder] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:53.286318 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1331/2654] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:53.673587 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d12788-bcd7-4252-9d8d-9051849080dc None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:53.683133 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d12788-bcd7-4252-9d8d-9051849080dc None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:53.688120 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baea618-de83-41cf-b188-10bbac5562c1 tempest-VolumeQuotaClassesTest-618236289 tempest-VolumeQuotaClassesTest-618236289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d47377bde3498bb6f7557360ab5631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f6ae93b6adb4c21acf18a58a2622ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:53.688845 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baea618-de83-41cf-b188-10bbac5562c1 tempest-VolumeQuotaClassesTest-618236289 tempest-VolumeQuotaClassesTest-618236289-project-admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:53.689153 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baea618-de83-41cf-b188-10bbac5562c1 tempest-VolumeQuotaClassesTest-618236289 tempest-VolumeQuotaClassesTest-618236289-project-admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:53.689434 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baea618-de83-41cf-b188-10bbac5562c1 tempest-VolumeQuotaClassesTest-618236289 tempest-VolumeQuotaClassesTest-618236289-project-admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:53.690202 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baea618-de83-41cf-b188-10bbac5562c1 tempest-VolumeQuotaClassesTest-618236289 tempest-VolumeQuotaClassesTest-618236289-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:55:53.690560 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baea618-de83-41cf-b188-10bbac5562c1 tempest-VolumeQuotaClassesTest-618236289 tempest-VolumeQuotaClassesTest-618236289-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:53.692184 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baea618-de83-41cf-b188-10bbac5562c1 tempest-VolumeQuotaClassesTest-618236289 tempest-VolumeQuotaClassesTest-618236289-project-admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:53.704315 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1324/2655] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:55:53.708379 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6173dfd-2515-41e7-8a63-4822fac288df service cinder] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:53.717983 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6173dfd-2515-41e7-8a63-4822fac288df service cinder] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:53.722798 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6393386-9a93-4d66-b322-bdfd978a697c tempest-VolumeQuotaClassesTest-618236289 tempest-VolumeQuotaClassesTest-618236289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d47377bde3498bb6f7557360ab5631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f6ae93b6adb4c21acf18a58a2622ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:53.723472 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6393386-9a93-4d66-b322-bdfd978a697c tempest-VolumeQuotaClassesTest-618236289 tempest-VolumeQuotaClassesTest-618236289-project-admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:53.723732 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6393386-9a93-4d66-b322-bdfd978a697c tempest-VolumeQuotaClassesTest-618236289 tempest-VolumeQuotaClassesTest-618236289-project-admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:53.724000 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6393386-9a93-4d66-b322-bdfd978a697c tempest-VolumeQuotaClassesTest-618236289 tempest-VolumeQuotaClassesTest-618236289-project-admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:53.724712 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6393386-9a93-4d66-b322-bdfd978a697c tempest-VolumeQuotaClassesTest-618236289 tempest-VolumeQuotaClassesTest-618236289-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:53.726668 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6393386-9a93-4d66-b322-bdfd978a697c tempest-VolumeQuotaClassesTest-618236289 tempest-VolumeQuotaClassesTest-618236289-project-admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:53.756185 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1332/2656] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:55:53 2022] POST /identity/v3/projects => generated 354 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:53.760269 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baea618-de83-41cf-b188-10bbac5562c1 tempest-VolumeQuotaClassesTest-618236289 tempest-VolumeQuotaClassesTest-618236289-project-admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:53.766715 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:53.771004 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baea618-de83-41cf-b188-10bbac5562c1 tempest-VolumeQuotaClassesTest-618236289 tempest-VolumeQuotaClassesTest-618236289-project-admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:53.834457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d78f1b-fcbf-48a3-87fb-87ff2b5ea1db tempest-VolumeQuotaClassesTest-618236289 tempest-VolumeQuotaClassesTest-618236289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d47377bde3498bb6f7557360ab5631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f6ae93b6adb4c21acf18a58a2622ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:53.835128 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d78f1b-fcbf-48a3-87fb-87ff2b5ea1db tempest-VolumeQuotaClassesTest-618236289 tempest-VolumeQuotaClassesTest-618236289-project-admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:53.835409 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d78f1b-fcbf-48a3-87fb-87ff2b5ea1db tempest-VolumeQuotaClassesTest-618236289 tempest-VolumeQuotaClassesTest-618236289-project-admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:53.835682 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d78f1b-fcbf-48a3-87fb-87ff2b5ea1db tempest-VolumeQuotaClassesTest-618236289 tempest-VolumeQuotaClassesTest-618236289-project-admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:53.836436 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d78f1b-fcbf-48a3-87fb-87ff2b5ea1db tempest-VolumeQuotaClassesTest-618236289 tempest-VolumeQuotaClassesTest-618236289-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:55:53.836741 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d78f1b-fcbf-48a3-87fb-87ff2b5ea1db tempest-VolumeQuotaClassesTest-618236289 tempest-VolumeQuotaClassesTest-618236289-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:53.838485 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d78f1b-fcbf-48a3-87fb-87ff2b5ea1db tempest-VolumeQuotaClassesTest-618236289 tempest-VolumeQuotaClassesTest-618236289-project-admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:53.850228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1325/2657] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:55:53.886672 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6393386-9a93-4d66-b322-bdfd978a697c tempest-VolumeQuotaClassesTest-618236289 tempest-VolumeQuotaClassesTest-618236289-project-admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:53.898510 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6393386-9a93-4d66-b322-bdfd978a697c tempest-VolumeQuotaClassesTest-618236289 tempest-VolumeQuotaClassesTest-618236289-project-admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:53.904096 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc3a8d-52f8-4885-aa7f-637522a7173b tempest-VolumeQuotaClassesTest-618236289 tempest-VolumeQuotaClassesTest-618236289-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d47377bde3498bb6f7557360ab5631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f6ae93b6adb4c21acf18a58a2622ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:53.905049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc3a8d-52f8-4885-aa7f-637522a7173b tempest-VolumeQuotaClassesTest-618236289 tempest-VolumeQuotaClassesTest-618236289-project-admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:53.905340 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc3a8d-52f8-4885-aa7f-637522a7173b tempest-VolumeQuotaClassesTest-618236289 tempest-VolumeQuotaClassesTest-618236289-project-admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:53.905614 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc3a8d-52f8-4885-aa7f-637522a7173b tempest-VolumeQuotaClassesTest-618236289 tempest-VolumeQuotaClassesTest-618236289-project-admin] PATH_INFO: `/v3/projects/c53b85f5dcd24308980c88f448ebd1fc` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:53.906843 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc3a8d-52f8-4885-aa7f-637522a7173b tempest-VolumeQuotaClassesTest-618236289 tempest-VolumeQuotaClassesTest-618236289-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c53b85f5dcd24308980c88f448ebd1fc)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:53.908801 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc3a8d-52f8-4885-aa7f-637522a7173b tempest-VolumeQuotaClassesTest-618236289 tempest-VolumeQuotaClassesTest-618236289-project-admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:53.957300 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-8abc3a8d-52f8-4885-aa7f-637522a7173b tempest-VolumeQuotaClassesTest-618236289 tempest-VolumeQuotaClassesTest-618236289-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c53b85f5dcd24308980c88f448ebd1fc', 'request_id': 'req-8abc3a8d-52f8-4885-aa7f-637522a7173b'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:53.962873 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-8abc3a8d-52f8-4885-aa7f-637522a7173b tempest-VolumeQuotaClassesTest-618236289 tempest-VolumeQuotaClassesTest-618236289-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c53b85f5dcd24308980c88f448ebd1fc', 'request_id': 'req-8abc3a8d-52f8-4885-aa7f-637522a7173b'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:53.971055 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-8abc3a8d-52f8-4885-aa7f-637522a7173b tempest-VolumeQuotaClassesTest-618236289 tempest-VolumeQuotaClassesTest-618236289-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c53b85f5dcd24308980c88f448ebd1fc', 'request_id': 'req-8abc3a8d-52f8-4885-aa7f-637522a7173b'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:53.982955 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-8abc3a8d-52f8-4885-aa7f-637522a7173b tempest-VolumeQuotaClassesTest-618236289 tempest-VolumeQuotaClassesTest-618236289-project-admin] The token cache is being invalidate because project c53b85f5dcd24308980c88f448ebd1fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:55:53.983409 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-8abc3a8d-52f8-4885-aa7f-637522a7173b tempest-VolumeQuotaClassesTest-618236289 tempest-VolumeQuotaClassesTest-618236289-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:53.984098 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-8abc3a8d-52f8-4885-aa7f-637522a7173b tempest-VolumeQuotaClassesTest-618236289 tempest-VolumeQuotaClassesTest-618236289-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:53.985663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1333/2658] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:55:53 2022] DELETE /identity/v3/projects/c53b85f5dcd24308980c88f448ebd1fc => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:54.185224 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d78f1b-fcbf-48a3-87fb-87ff2b5ea1db tempest-VolumeQuotaClassesTest-618236289 tempest-VolumeQuotaClassesTest-618236289-project-admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:54.187276 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-77d78f1b-fcbf-48a3-87fb-87ff2b5ea1db tempest-VolumeQuotaClassesTest-618236289 tempest-VolumeQuotaClassesTest-618236289-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:54.254639 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d78f1b-fcbf-48a3-87fb-87ff2b5ea1db tempest-VolumeQuotaClassesTest-618236289 tempest-VolumeQuotaClassesTest-618236289-project-admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:54.314146 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03649351-8487-436d-8899-9c9eb03ebfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:54.315212 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03649351-8487-436d-8899-9c9eb03ebfe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:54.315488 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03649351-8487-436d-8899-9c9eb03ebfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:54.315775 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03649351-8487-436d-8899-9c9eb03ebfe4 admin admin] PATH_INFO: `/v3/users/6e3b71830fec48d78610d4dcf47566be` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:54.317023 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03649351-8487-436d-8899-9c9eb03ebfe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e3b71830fec48d78610d4dcf47566be)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:54.319093 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03649351-8487-436d-8899-9c9eb03ebfe4 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:54.366629 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-03649351-8487-436d-8899-9c9eb03ebfe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e3b71830fec48d78610d4dcf47566be'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:54.367971 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:54.374674 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-03649351-8487-436d-8899-9c9eb03ebfe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e3b71830fec48d78610d4dcf47566be'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:54.388016 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-03649351-8487-436d-8899-9c9eb03ebfe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e3b71830fec48d78610d4dcf47566be'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:54.388835 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-03649351-8487-436d-8899-9c9eb03ebfe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e3b71830fec48d78610d4dcf47566be'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:54.389561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-03649351-8487-436d-8899-9c9eb03ebfe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e3b71830fec48d78610d4dcf47566be'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:54.404149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1326/2659] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:55:54 2022] DELETE /identity/v3/users/6e3b71830fec48d78610d4dcf47566be => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:54.408755 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c2681-4911-43aa-956b-1655e2cf8baa None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:54.409189 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c2681-4911-43aa-956b-1655e2cf8baa None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:54.409470 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c2681-4911-43aa-956b-1655e2cf8baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:54.427380 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-f48c2681-4911-43aa-956b-1655e2cf8baa None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:54.429002 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-f48c2681-4911-43aa-956b-1655e2cf8baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:54.488095 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1334/2660] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:55:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:55:54.498561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03649351-8487-436d-8899-9c9eb03ebfe4 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:54.500840 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-03649351-8487-436d-8899-9c9eb03ebfe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:54.572966 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03649351-8487-436d-8899-9c9eb03ebfe4 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:54.577163 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8af530-3e35-4cc0-bc03-cc930eb14fc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:54.577818 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8af530-3e35-4cc0-bc03-cc930eb14fc4 service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:54.578130 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8af530-3e35-4cc0-bc03-cc930eb14fc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:54.578406 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8af530-3e35-4cc0-bc03-cc930eb14fc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:54.590118 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8af530-3e35-4cc0-bc03-cc930eb14fc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:54.591685 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8af530-3e35-4cc0-bc03-cc930eb14fc4 service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:54.602531 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1327/2661] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:54.889959 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c2681-4911-43aa-956b-1655e2cf8baa None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:54.891397 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-f48c2681-4911-43aa-956b-1655e2cf8baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:54.905031 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c2681-4911-43aa-956b-1655e2cf8baa None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:54.909905 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6b37b-b535-4fd6-9009-582cb746d4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:54.910935 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6b37b-b535-4fd6-9009-582cb746d4e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:54.911218 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6b37b-b535-4fd6-9009-582cb746d4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:54.911471 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6b37b-b535-4fd6-9009-582cb746d4e0 admin admin] PATH_INFO: `/v3/projects/6d28614cd12d4396a0e9e669164b85d3` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:54.912665 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc6b37b-b535-4fd6-9009-582cb746d4e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d28614cd12d4396a0e9e669164b85d3)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:54.914644 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc6b37b-b535-4fd6-9009-582cb746d4e0 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:54.961253 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:54.965694 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-3dc6b37b-b535-4fd6-9009-582cb746d4e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d28614cd12d4396a0e9e669164b85d3', 'request_id': 'req-3dc6b37b-b535-4fd6-9009-582cb746d4e0'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:54.972281 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-3dc6b37b-b535-4fd6-9009-582cb746d4e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d28614cd12d4396a0e9e669164b85d3', 'request_id': 'req-3dc6b37b-b535-4fd6-9009-582cb746d4e0'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:54.980635 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-3dc6b37b-b535-4fd6-9009-582cb746d4e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d28614cd12d4396a0e9e669164b85d3', 'request_id': 'req-3dc6b37b-b535-4fd6-9009-582cb746d4e0'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:54.992479 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-3dc6b37b-b535-4fd6-9009-582cb746d4e0 admin admin] The token cache is being invalidate because project 6d28614cd12d4396a0e9e669164b85d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:55:54.992769 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-3dc6b37b-b535-4fd6-9009-582cb746d4e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:54.993411 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-3dc6b37b-b535-4fd6-9009-582cb746d4e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:54.995138 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1335/2662] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:55:54 2022] DELETE /identity/v3/projects/6d28614cd12d4396a0e9e669164b85d3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:55:54.999337 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8af530-3e35-4cc0-bc03-cc930eb14fc4 service neutron] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:55.010370 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8af530-3e35-4cc0-bc03-cc930eb14fc4 service neutron] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:55.072229 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f288f7-f932-4aeb-b876-d262e936573d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:55.073123 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f288f7-f932-4aeb-b876-d262e936573d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:55.073407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f288f7-f932-4aeb-b876-d262e936573d admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:55.073684 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f288f7-f932-4aeb-b876-d262e936573d admin admin] PATH_INFO: `/v3/users/39d47377bde3498bb6f7557360ab5631` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:55.074964 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f288f7-f932-4aeb-b876-d262e936573d admin admin] RBAC: Authorizing `identity:delete_user(user_id=39d47377bde3498bb6f7557360ab5631)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:55.076964 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f288f7-f932-4aeb-b876-d262e936573d admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:55.126450 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c0f288f7-f932-4aeb-b876-d262e936573d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39d47377bde3498bb6f7557360ab5631'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:55.133181 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c0f288f7-f932-4aeb-b876-d262e936573d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39d47377bde3498bb6f7557360ab5631'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:55.143178 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:55.145732 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c0f288f7-f932-4aeb-b876-d262e936573d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39d47377bde3498bb6f7557360ab5631'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:55.147394 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c0f288f7-f932-4aeb-b876-d262e936573d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39d47377bde3498bb6f7557360ab5631'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:55.148159 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c0f288f7-f932-4aeb-b876-d262e936573d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39d47377bde3498bb6f7557360ab5631'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:55.163753 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1328/2663] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:55:54 2022] DELETE /identity/v3/users/39d47377bde3498bb6f7557360ab5631 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:55.455950 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6b37b-b535-4fd6-9009-582cb746d4e0 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:55.457483 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-3dc6b37b-b535-4fd6-9009-582cb746d4e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:55.471617 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6b37b-b535-4fd6-9009-582cb746d4e0 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:55.533527 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2ee9b-c78c-4914-b5e3-77bbac9af630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:55.534516 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2ee9b-c78c-4914-b5e3-77bbac9af630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:55.534773 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2ee9b-c78c-4914-b5e3-77bbac9af630 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:55.535059 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2ee9b-c78c-4914-b5e3-77bbac9af630 admin admin] PATH_INFO: `/v3/projects/6f6ae93b6adb4c21acf18a58a2622ddf` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:55.536319 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2ee9b-c78c-4914-b5e3-77bbac9af630 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f6ae93b6adb4c21acf18a58a2622ddf)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:55.538379 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2ee9b-c78c-4914-b5e3-77bbac9af630 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:55.586346 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-84e2ee9b-c78c-4914-b5e3-77bbac9af630 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f6ae93b6adb4c21acf18a58a2622ddf', 'request_id': 'req-84e2ee9b-c78c-4914-b5e3-77bbac9af630'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:55.591926 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-84e2ee9b-c78c-4914-b5e3-77bbac9af630 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f6ae93b6adb4c21acf18a58a2622ddf', 'request_id': 'req-84e2ee9b-c78c-4914-b5e3-77bbac9af630'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:55.600652 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-84e2ee9b-c78c-4914-b5e3-77bbac9af630 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f6ae93b6adb4c21acf18a58a2622ddf', 'request_id': 'req-84e2ee9b-c78c-4914-b5e3-77bbac9af630'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:55.612026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-84e2ee9b-c78c-4914-b5e3-77bbac9af630 admin admin] The token cache is being invalidate because project 6f6ae93b6adb4c21acf18a58a2622ddf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:55:55.612307 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-84e2ee9b-c78c-4914-b5e3-77bbac9af630 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:55.613051 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-84e2ee9b-c78c-4914-b5e3-77bbac9af630 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:55.614790 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1336/2664] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:55:55 2022] DELETE /identity/v3/projects/6f6ae93b6adb4c21acf18a58a2622ddf => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:55.619784 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13889fa9-3396-463f-a992-63c84da10042 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:55.620067 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13889fa9-3396-463f-a992-63c84da10042 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:55.620336 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13889fa9-3396-463f-a992-63c84da10042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:55.638516 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-13889fa9-3396-463f-a992-63c84da10042 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:55.639703 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-13889fa9-3396-463f-a992-63c84da10042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:55.698544 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1329/2665] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:55.706612 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c90bbc-fb28-4e25-a05a-582f80dc459d None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:55.706895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c90bbc-fb28-4e25-a05a-582f80dc459d None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:55.707165 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c90bbc-fb28-4e25-a05a-582f80dc459d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:55.726419 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-72c90bbc-fb28-4e25-a05a-582f80dc459d None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:55.727622 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-72c90bbc-fb28-4e25-a05a-582f80dc459d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:55.736738 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1337/2666] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:55.740894 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13889fa9-3396-463f-a992-63c84da10042 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:55.751535 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13889fa9-3396-463f-a992-63c84da10042 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:55.757251 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff18de6-67f0-4cfc-8e26-b33b8f27ee40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:55.757960 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff18de6-67f0-4cfc-8e26-b33b8f27ee40 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:55.758251 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff18de6-67f0-4cfc-8e26-b33b8f27ee40 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:55.758523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff18de6-67f0-4cfc-8e26-b33b8f27ee40 admin admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:55.759260 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff18de6-67f0-4cfc-8e26-b33b8f27ee40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:55:55.759618 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff18de6-67f0-4cfc-8e26-b33b8f27ee40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:55.761237 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff18de6-67f0-4cfc-8e26-b33b8f27ee40 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:55.773727 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1330/2667] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:55:55.778573 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c90bbc-fb28-4e25-a05a-582f80dc459d None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:55.788273 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c90bbc-fb28-4e25-a05a-582f80dc459d None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:55.793672 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948fe957-21a6-42ae-89b2-e3903901dbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:55.794355 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948fe957-21a6-42ae-89b2-e3903901dbcc admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:55.794633 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948fe957-21a6-42ae-89b2-e3903901dbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:55.794915 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948fe957-21a6-42ae-89b2-e3903901dbcc admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:55.795583 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948fe957-21a6-42ae-89b2-e3903901dbcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:55.797522 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948fe957-21a6-42ae-89b2-e3903901dbcc admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:55.826610 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1338/2668] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:55:55 2022] POST /identity/v3/projects => generated 389 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:55.830763 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff18de6-67f0-4cfc-8e26-b33b8f27ee40 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:55.841205 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff18de6-67f0-4cfc-8e26-b33b8f27ee40 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:55.900999 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9c2e6-4b58-4822-a76d-a561c1b24586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:55.901664 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9c2e6-4b58-4822-a76d-a561c1b24586 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:55.901957 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9c2e6-4b58-4822-a76d-a561c1b24586 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:55.902228 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9c2e6-4b58-4822-a76d-a561c1b24586 admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:55.903252 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c9c2e6-4b58-4822-a76d-a561c1b24586 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:55.905178 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c9c2e6-4b58-4822-a76d-a561c1b24586 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:55.925518 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1331/2669] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:55:55 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:55.929681 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948fe957-21a6-42ae-89b2-e3903901dbcc admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:55.940302 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948fe957-21a6-42ae-89b2-e3903901dbcc admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:55.945702 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0feb8df-5896-493e-9028-0041c3d7742b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:55.946466 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0feb8df-5896-493e-9028-0041c3d7742b admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:55.946788 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0feb8df-5896-493e-9028-0041c3d7742b admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:55.947033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0feb8df-5896-493e-9028-0041c3d7742b admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:55.947760 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0feb8df-5896-493e-9028-0041c3d7742b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:55.949477 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0feb8df-5896-493e-9028-0041c3d7742b admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:55.960403 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1339/2670] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:55.964248 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9c2e6-4b58-4822-a76d-a561c1b24586 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:55.975016 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9c2e6-4b58-4822-a76d-a561c1b24586 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:55.981047 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4c7c5-fb10-4356-b914-07ebb9113673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:55.981760 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4c7c5-fb10-4356-b914-07ebb9113673 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:55.982082 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4c7c5-fb10-4356-b914-07ebb9113673 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:55.982346 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4c7c5-fb10-4356-b914-07ebb9113673 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:55.983080 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4c7c5-fb10-4356-b914-07ebb9113673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:55.984701 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4c7c5-fb10-4356-b914-07ebb9113673 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:55.995210 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1332/2671] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:55.999636 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0feb8df-5896-493e-9028-0041c3d7742b admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:56.010512 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0feb8df-5896-493e-9028-0041c3d7742b admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:56.015984 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a6140-708e-4421-9731-6983c966b1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:56.016869 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a6140-708e-4421-9731-6983c966b1e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:56.017147 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a6140-708e-4421-9731-6983c966b1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:56.017419 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a6140-708e-4421-9731-6983c966b1e2 admin admin] PATH_INFO: `/v3/projects/55d3dd6d49584f4c80ef1aed08614f0a/users/019fd3eb168140e7a39b3f8cff22c577/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:56.034554 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a6140-708e-4421-9731-6983c966b1e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55d3dd6d49584f4c80ef1aed08614f0a, user_id=019fd3eb168140e7a39b3f8cff22c577, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:56.037258 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a6140-708e-4421-9731-6983c966b1e2 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:56.047744 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:56.054638 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1340/2672] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:55 2022] PUT /identity/v3/projects/55d3dd6d49584f4c80ef1aed08614f0a/users/019fd3eb168140e7a39b3f8cff22c577/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:56.066199 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925da9b-294c-4e45-a26b-0605a3937c1d None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:56.066740 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925da9b-294c-4e45-a26b-0605a3937c1d None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:56.066846 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925da9b-294c-4e45-a26b-0605a3937c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:56.094424 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-5925da9b-294c-4e45-a26b-0605a3937c1d None None] MFA Rules not processed for user `019fd3eb168140e7a39b3f8cff22c577`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:56.095613 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-5925da9b-294c-4e45-a26b-0605a3937c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:56.137930 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:56.163211 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1333/2673] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:55:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:56.167929 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a6140-708e-4421-9731-6983c966b1e2 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:56.233546 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a6140-708e-4421-9731-6983c966b1e2 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:56.238519 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1f651-dc00-4d2e-9d8d-d6fa951558b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:56.239193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1f651-dc00-4d2e-9d8d-d6fa951558b5 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:56.239471 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1f651-dc00-4d2e-9d8d-d6fa951558b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:56.239746 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1f651-dc00-4d2e-9d8d-d6fa951558b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:56.240432 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd1f651-dc00-4d2e-9d8d-d6fa951558b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:56.242382 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd1f651-dc00-4d2e-9d8d-d6fa951558b5 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:56.269869 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1341/2674] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:55:56 2022] POST /identity/v3/projects => generated 389 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:56.274560 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925da9b-294c-4e45-a26b-0605a3937c1d None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:56.287089 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925da9b-294c-4e45-a26b-0605a3937c1d None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:56.346040 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e0f7a-2b8c-418a-91d9-093112a49f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:56.346642 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e0f7a-2b8c-418a-91d9-093112a49f82 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:56.346956 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e0f7a-2b8c-418a-91d9-093112a49f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:56.347233 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e0f7a-2b8c-418a-91d9-093112a49f82 admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:56.347915 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e0f7a-2b8c-418a-91d9-093112a49f82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:56.349870 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e0f7a-2b8c-418a-91d9-093112a49f82 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:56.372564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1334/2675] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:55:56 2022] POST /identity/v3/users => generated 301 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:56.376620 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1f651-dc00-4d2e-9d8d-d6fa951558b5 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:56.387234 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1f651-dc00-4d2e-9d8d-d6fa951558b5 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:56.392131 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc053a-5891-477a-ac17-c48a8798eb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:56.392799 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc053a-5891-477a-ac17-c48a8798eb49 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:56.393087 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc053a-5891-477a-ac17-c48a8798eb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:56.393369 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc053a-5891-477a-ac17-c48a8798eb49 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:56.394127 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc053a-5891-477a-ac17-c48a8798eb49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:56.395713 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc053a-5891-477a-ac17-c48a8798eb49 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:56.406818 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1342/2676] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:55:56.410886 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e0f7a-2b8c-418a-91d9-093112a49f82 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:56.421088 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e0f7a-2b8c-418a-91d9-093112a49f82 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:56.426463 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a60230-6d07-45f0-8e91-acc6210de6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:56.427338 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a60230-6d07-45f0-8e91-acc6210de6c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:56.427618 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a60230-6d07-45f0-8e91-acc6210de6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:56.427895 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a60230-6d07-45f0-8e91-acc6210de6c8 admin admin] PATH_INFO: `/v3/projects/595ce484eb9346a3a3b25bbb0ae83f40/users/f30a5a5003c549349541cfa98d7667e5/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:56.444553 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a60230-6d07-45f0-8e91-acc6210de6c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=595ce484eb9346a3a3b25bbb0ae83f40, user_id=f30a5a5003c549349541cfa98d7667e5, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:56.447290 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a60230-6d07-45f0-8e91-acc6210de6c8 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:56.463077 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1335/2677] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:56 2022] PUT /identity/v3/projects/595ce484eb9346a3a3b25bbb0ae83f40/users/f30a5a5003c549349541cfa98d7667e5/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:55:56.466990 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc053a-5891-477a-ac17-c48a8798eb49 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:56.477777 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc053a-5891-477a-ac17-c48a8798eb49 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:56.540123 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c88063-80c7-4277-b7c9-9fa9827192fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:56.540822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c88063-80c7-4277-b7c9-9fa9827192fa admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:56.541099 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c88063-80c7-4277-b7c9-9fa9827192fa admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:56.541357 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c88063-80c7-4277-b7c9-9fa9827192fa admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:56.542210 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c88063-80c7-4277-b7c9-9fa9827192fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:56.543843 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c88063-80c7-4277-b7c9-9fa9827192fa admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:56.554938 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1343/2678] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:56.559356 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a60230-6d07-45f0-8e91-acc6210de6c8 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:56.570061 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a60230-6d07-45f0-8e91-acc6210de6c8 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:56.575218 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d599c-cb45-4117-8c79-bad3057a6967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:56.576127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d599c-cb45-4117-8c79-bad3057a6967 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:56.576405 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d599c-cb45-4117-8c79-bad3057a6967 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:56.576676 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d599c-cb45-4117-8c79-bad3057a6967 admin admin] PATH_INFO: `/v3/projects/595ce484eb9346a3a3b25bbb0ae83f40/users/f30a5a5003c549349541cfa98d7667e5/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:56.578846 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d599c-cb45-4117-8c79-bad3057a6967 admin admin] RBAC: Authorizing `identity:create_grant(project_id=595ce484eb9346a3a3b25bbb0ae83f40, user_id=f30a5a5003c549349541cfa98d7667e5, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:56.581533 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d599c-cb45-4117-8c79-bad3057a6967 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:56.593025 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1336/2679] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:56 2022] PUT /identity/v3/projects/595ce484eb9346a3a3b25bbb0ae83f40/users/f30a5a5003c549349541cfa98d7667e5/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:56.604341 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872d68b-4c69-4f1c-9243-ddee20119be4 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:56.604559 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872d68b-4c69-4f1c-9243-ddee20119be4 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:56.604824 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872d68b-4c69-4f1c-9243-ddee20119be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:56.633591 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-5872d68b-4c69-4f1c-9243-ddee20119be4 None None] MFA Rules not processed for user `f30a5a5003c549349541cfa98d7667e5`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:56.635403 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-5872d68b-4c69-4f1c-9243-ddee20119be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:56.703866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:56.716926 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1344/2680] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:55:56 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:56.727494 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d599c-cb45-4117-8c79-bad3057a6967 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:56.729333 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-214d599c-cb45-4117-8c79-bad3057a6967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:56.807994 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d599c-cb45-4117-8c79-bad3057a6967 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:56.813112 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50202bfb-f9db-4faf-8751-5e848422f7e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:56.813817 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50202bfb-f9db-4faf-8751-5e848422f7e6 service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:56.814124 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50202bfb-f9db-4faf-8751-5e848422f7e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:56.814417 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50202bfb-f9db-4faf-8751-5e848422f7e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:56.823793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50202bfb-f9db-4faf-8751-5e848422f7e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:56.825229 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50202bfb-f9db-4faf-8751-5e848422f7e6 service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:56.834568 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1337/2681] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:56 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:55:56.960688 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872d68b-4c69-4f1c-9243-ddee20119be4 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:57.023774 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872d68b-4c69-4f1c-9243-ddee20119be4 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:57.029923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9d3a1-da1c-4e7e-8f77-3e905a1f77c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:57.030813 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9d3a1-da1c-4e7e-8f77-3e905a1f77c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:57.031099 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9d3a1-da1c-4e7e-8f77-3e905a1f77c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:57.031374 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9d3a1-da1c-4e7e-8f77-3e905a1f77c6 admin admin] PATH_INFO: `/v3/users/019fd3eb168140e7a39b3f8cff22c577` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:57.032679 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf9d3a1-da1c-4e7e-8f77-3e905a1f77c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=019fd3eb168140e7a39b3f8cff22c577)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:57.034673 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf9d3a1-da1c-4e7e-8f77-3e905a1f77c6 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:57.083715 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-aaf9d3a1-da1c-4e7e-8f77-3e905a1f77c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '019fd3eb168140e7a39b3f8cff22c577'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:57.098352 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-aaf9d3a1-da1c-4e7e-8f77-3e905a1f77c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '019fd3eb168140e7a39b3f8cff22c577'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:57.105724 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-aaf9d3a1-da1c-4e7e-8f77-3e905a1f77c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '019fd3eb168140e7a39b3f8cff22c577'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:57.106425 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-aaf9d3a1-da1c-4e7e-8f77-3e905a1f77c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '019fd3eb168140e7a39b3f8cff22c577'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:57.107033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-aaf9d3a1-da1c-4e7e-8f77-3e905a1f77c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '019fd3eb168140e7a39b3f8cff22c577'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:57.121699 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1345/2682] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:55:56 2022] DELETE /identity/v3/users/019fd3eb168140e7a39b3f8cff22c577 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:57.126673 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333017c-d6a1-4627-9802-bd281b085591 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:57.127171 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333017c-d6a1-4627-9802-bd281b085591 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:57.127280 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333017c-d6a1-4627-9802-bd281b085591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:57.150752 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-7333017c-d6a1-4627-9802-bd281b085591 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:57.150752 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-7333017c-d6a1-4627-9802-bd281b085591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:57.187591 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:57.217140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1338/2683] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:55:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:57.227029 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9d3a1-da1c-4e7e-8f77-3e905a1f77c6 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:57.228582 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-aaf9d3a1-da1c-4e7e-8f77-3e905a1f77c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:57.287814 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9d3a1-da1c-4e7e-8f77-3e905a1f77c6 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:57.291965 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e657933-27f9-4e1a-8cf7-e561b3d2cf1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:57.292602 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e657933-27f9-4e1a-8cf7-e561b3d2cf1d service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:57.292877 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e657933-27f9-4e1a-8cf7-e561b3d2cf1d service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:57.293157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e657933-27f9-4e1a-8cf7-e561b3d2cf1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:57.302548 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e657933-27f9-4e1a-8cf7-e561b3d2cf1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:57.303981 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e657933-27f9-4e1a-8cf7-e561b3d2cf1d service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:57.313393 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1346/2684] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:55:57.598250 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333017c-d6a1-4627-9802-bd281b085591 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:57.599849 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-7333017c-d6a1-4627-9802-bd281b085591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:57.612529 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333017c-d6a1-4627-9802-bd281b085591 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:57.617976 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19202f-7946-4094-9804-839083c36bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:57.618880 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19202f-7946-4094-9804-839083c36bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:57.619148 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19202f-7946-4094-9804-839083c36bea admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:57.619427 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19202f-7946-4094-9804-839083c36bea admin admin] PATH_INFO: `/v3/projects/55d3dd6d49584f4c80ef1aed08614f0a` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:57.620830 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19202f-7946-4094-9804-839083c36bea admin admin] RBAC: Authorizing `identity:delete_project(project_id=55d3dd6d49584f4c80ef1aed08614f0a)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:57.622854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19202f-7946-4094-9804-839083c36bea admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:57.672426 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-0e19202f-7946-4094-9804-839083c36bea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55d3dd6d49584f4c80ef1aed08614f0a', 'request_id': 'req-0e19202f-7946-4094-9804-839083c36bea'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:57.678284 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-0e19202f-7946-4094-9804-839083c36bea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55d3dd6d49584f4c80ef1aed08614f0a', 'request_id': 'req-0e19202f-7946-4094-9804-839083c36bea'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:57.686642 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-0e19202f-7946-4094-9804-839083c36bea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55d3dd6d49584f4c80ef1aed08614f0a', 'request_id': 'req-0e19202f-7946-4094-9804-839083c36bea'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:57.698827 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-0e19202f-7946-4094-9804-839083c36bea admin admin] The token cache is being invalidate because project 55d3dd6d49584f4c80ef1aed08614f0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:55:57.699110 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-0e19202f-7946-4094-9804-839083c36bea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:57.699832 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-0e19202f-7946-4094-9804-839083c36bea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:57.701477 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1339/2685] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:55:57 2022] DELETE /identity/v3/projects/55d3dd6d49584f4c80ef1aed08614f0a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:57.705691 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e657933-27f9-4e1a-8cf7-e561b3d2cf1d service neutron] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:57.715640 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e657933-27f9-4e1a-8cf7-e561b3d2cf1d service neutron] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:57.726803 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:57.776297 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd44b8e-d414-425d-9c47-536c183433fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:57.777163 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd44b8e-d414-425d-9c47-536c183433fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:57.777806 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd44b8e-d414-425d-9c47-536c183433fe admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:57.778104 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd44b8e-d414-425d-9c47-536c183433fe admin admin] PATH_INFO: `/v3/users/f30a5a5003c549349541cfa98d7667e5` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:57.779311 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd44b8e-d414-425d-9c47-536c183433fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=f30a5a5003c549349541cfa98d7667e5)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:57.781253 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd44b8e-d414-425d-9c47-536c183433fe admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:57.829735 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-5cd44b8e-d414-425d-9c47-536c183433fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f30a5a5003c549349541cfa98d7667e5'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:57.842281 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-5cd44b8e-d414-425d-9c47-536c183433fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f30a5a5003c549349541cfa98d7667e5'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:57.849600 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-5cd44b8e-d414-425d-9c47-536c183433fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f30a5a5003c549349541cfa98d7667e5'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:57.850354 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-5cd44b8e-d414-425d-9c47-536c183433fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f30a5a5003c549349541cfa98d7667e5'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:57.850969 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-5cd44b8e-d414-425d-9c47-536c183433fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f30a5a5003c549349541cfa98d7667e5'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:57.866373 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1347/2686] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:55:57 2022] DELETE /identity/v3/users/f30a5a5003c549349541cfa98d7667e5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:58.151050 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19202f-7946-4094-9804-839083c36bea admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:58.153197 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-0e19202f-7946-4094-9804-839083c36bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:58.169221 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19202f-7946-4094-9804-839083c36bea admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:58.233689 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3893ff4-c7ad-4e04-aa5b-b5b84d2cfadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:58.234896 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3893ff4-c7ad-4e04-aa5b-b5b84d2cfadf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:58.235258 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3893ff4-c7ad-4e04-aa5b-b5b84d2cfadf admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:58.235672 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3893ff4-c7ad-4e04-aa5b-b5b84d2cfadf admin admin] PATH_INFO: `/v3/projects/595ce484eb9346a3a3b25bbb0ae83f40` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:58.237638 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3893ff4-c7ad-4e04-aa5b-b5b84d2cfadf admin admin] RBAC: Authorizing `identity:delete_project(project_id=595ce484eb9346a3a3b25bbb0ae83f40)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:58.240757 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3893ff4-c7ad-4e04-aa5b-b5b84d2cfadf admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:58.299490 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-d3893ff4-c7ad-4e04-aa5b-b5b84d2cfadf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '595ce484eb9346a3a3b25bbb0ae83f40', 'request_id': 'req-d3893ff4-c7ad-4e04-aa5b-b5b84d2cfadf'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:58.305645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-d3893ff4-c7ad-4e04-aa5b-b5b84d2cfadf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '595ce484eb9346a3a3b25bbb0ae83f40', 'request_id': 'req-d3893ff4-c7ad-4e04-aa5b-b5b84d2cfadf'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:58.309505 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:58.315103 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-d3893ff4-c7ad-4e04-aa5b-b5b84d2cfadf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '595ce484eb9346a3a3b25bbb0ae83f40', 'request_id': 'req-d3893ff4-c7ad-4e04-aa5b-b5b84d2cfadf'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:58.327500 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-d3893ff4-c7ad-4e04-aa5b-b5b84d2cfadf admin admin] The token cache is being invalidate because project 595ce484eb9346a3a3b25bbb0ae83f40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:55:58.327780 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-d3893ff4-c7ad-4e04-aa5b-b5b84d2cfadf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:58.328400 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-d3893ff4-c7ad-4e04-aa5b-b5b84d2cfadf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:55:58.329968 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1340/2687] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:55:58 2022] DELETE /identity/v3/projects/595ce484eb9346a3a3b25bbb0ae83f40 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:58.334975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c4662-f7fe-4482-abd7-02c5670c6000 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:58.335435 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c4662-f7fe-4482-abd7-02c5670c6000 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:58.335549 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c4662-f7fe-4482-abd7-02c5670c6000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:58.354080 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-dc3c4662-f7fe-4482-abd7-02c5670c6000 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:58.355400 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-dc3c4662-f7fe-4482-abd7-02c5670c6000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:58.418701 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1348/2688] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:58.427631 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61a675-2e4f-49df-b964-ddf1b7ee9995 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:58.427953 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61a675-2e4f-49df-b964-ddf1b7ee9995 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:58.428225 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61a675-2e4f-49df-b964-ddf1b7ee9995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:58.448447 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-4c61a675-2e4f-49df-b964-ddf1b7ee9995 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:58.449663 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-4c61a675-2e4f-49df-b964-ddf1b7ee9995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:58.458483 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1341/2689] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:58.462787 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c4662-f7fe-4482-abd7-02c5670c6000 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:58.472618 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c4662-f7fe-4482-abd7-02c5670c6000 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:58.477402 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed0bc5-fd8d-466f-8c5f-ca2449e10541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:58.478095 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed0bc5-fd8d-466f-8c5f-ca2449e10541 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:58.478375 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed0bc5-fd8d-466f-8c5f-ca2449e10541 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:58.478650 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed0bc5-fd8d-466f-8c5f-ca2449e10541 admin admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:58.479399 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed0bc5-fd8d-466f-8c5f-ca2449e10541 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:55:58.479703 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed0bc5-fd8d-466f-8c5f-ca2449e10541 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:58.481366 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed0bc5-fd8d-466f-8c5f-ca2449e10541 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:58.493645 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1349/2690] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:55:58.498423 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61a675-2e4f-49df-b964-ddf1b7ee9995 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:58.507953 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61a675-2e4f-49df-b964-ddf1b7ee9995 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:58.512626 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c830b-6a17-49f3-a0bf-5a3dd5faa980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:58.513285 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c830b-6a17-49f3-a0bf-5a3dd5faa980 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:58.513615 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c830b-6a17-49f3-a0bf-5a3dd5faa980 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:58.513918 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c830b-6a17-49f3-a0bf-5a3dd5faa980 admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:58.514630 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c830b-6a17-49f3-a0bf-5a3dd5faa980 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:58.516537 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c830b-6a17-49f3-a0bf-5a3dd5faa980 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:58.544273 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1342/2691] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:55:58 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:55:58.548332 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed0bc5-fd8d-466f-8c5f-ca2449e10541 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:58.558813 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed0bc5-fd8d-466f-8c5f-ca2449e10541 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:58.581587 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:58.622741 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44130184-1d9c-4c2f-b20a-fd6ec1653044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:58.623526 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44130184-1d9c-4c2f-b20a-fd6ec1653044 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:58.623910 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44130184-1d9c-4c2f-b20a-fd6ec1653044 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:58.624396 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44130184-1d9c-4c2f-b20a-fd6ec1653044 admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:58.625395 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44130184-1d9c-4c2f-b20a-fd6ec1653044 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:58.627499 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44130184-1d9c-4c2f-b20a-fd6ec1653044 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:58.651926 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1350/2692] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:55:58 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:58.656462 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c830b-6a17-49f3-a0bf-5a3dd5faa980 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:58.667320 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c830b-6a17-49f3-a0bf-5a3dd5faa980 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:58.672066 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706434e-ca85-447d-b06f-416cca8a900c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:58.672733 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706434e-ca85-447d-b06f-416cca8a900c admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:58.673014 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706434e-ca85-447d-b06f-416cca8a900c admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:58.673284 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706434e-ca85-447d-b06f-416cca8a900c admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:58.674043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706434e-ca85-447d-b06f-416cca8a900c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:58.675669 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706434e-ca85-447d-b06f-416cca8a900c admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:58.687752 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1343/2693] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:55:58.692148 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44130184-1d9c-4c2f-b20a-fd6ec1653044 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:58.703065 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44130184-1d9c-4c2f-b20a-fd6ec1653044 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:58.707919 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a085d-5ba4-4bc1-bde9-e91259809180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:58.708580 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a085d-5ba4-4bc1-bde9-e91259809180 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:58.708852 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a085d-5ba4-4bc1-bde9-e91259809180 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:58.709120 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a085d-5ba4-4bc1-bde9-e91259809180 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:58.709859 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a085d-5ba4-4bc1-bde9-e91259809180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:58.711452 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a085d-5ba4-4bc1-bde9-e91259809180 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:58.722313 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1351/2694] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:55:58.726688 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706434e-ca85-447d-b06f-416cca8a900c admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:58.737286 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706434e-ca85-447d-b06f-416cca8a900c admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:58.741954 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716b482-cb17-4239-a405-bab64b5885af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:58.742780 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716b482-cb17-4239-a405-bab64b5885af admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:58.743064 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716b482-cb17-4239-a405-bab64b5885af admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:58.743328 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716b482-cb17-4239-a405-bab64b5885af admin admin] PATH_INFO: `/v3/projects/777e53152e364aca9322559fe7edf945/users/f099dedb88aa4e2b9bb414d4f308ba1f/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:58.758422 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716b482-cb17-4239-a405-bab64b5885af admin admin] RBAC: Authorizing `identity:create_grant(project_id=777e53152e364aca9322559fe7edf945, user_id=f099dedb88aa4e2b9bb414d4f308ba1f, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:58.761271 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716b482-cb17-4239-a405-bab64b5885af admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:58.776211 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1344/2695] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:58 2022] PUT /identity/v3/projects/777e53152e364aca9322559fe7edf945/users/f099dedb88aa4e2b9bb414d4f308ba1f/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:58.782145 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec70b1-fe48-4de4-84d9-1049d7f4dac8 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:58.782490 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec70b1-fe48-4de4-84d9-1049d7f4dac8 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:58.782818 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec70b1-fe48-4de4-84d9-1049d7f4dac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:58.801533 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-35ec70b1-fe48-4de4-84d9-1049d7f4dac8 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:58.802812 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-35ec70b1-fe48-4de4-84d9-1049d7f4dac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:58.863261 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1352/2696] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:58.876524 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716b482-cb17-4239-a405-bab64b5885af admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:58.878474 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-3716b482-cb17-4239-a405-bab64b5885af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:58.938794 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716b482-cb17-4239-a405-bab64b5885af admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:58.942379 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2f3e6-32ea-4a68-a8e3-6f7270ccbd97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:58.943022 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2f3e6-32ea-4a68-a8e3-6f7270ccbd97 service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:58.943297 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2f3e6-32ea-4a68-a8e3-6f7270ccbd97 service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:58.943565 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2f3e6-32ea-4a68-a8e3-6f7270ccbd97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:58.952429 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b2f3e6-32ea-4a68-a8e3-6f7270ccbd97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:58.953906 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b2f3e6-32ea-4a68-a8e3-6f7270ccbd97 service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:58.963174 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1345/2697] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:55:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:55:59.577631 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a332d39-5d82-40cf-b5a3-da151016bafd None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:59.578184 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a332d39-5d82-40cf-b5a3-da151016bafd None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:59.578282 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a332d39-5d82-40cf-b5a3-da151016bafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:59.605534 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-8a332d39-5d82-40cf-b5a3-da151016bafd None None] MFA Rules not processed for user `f099dedb88aa4e2b9bb414d4f308ba1f`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:55:59.607081 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-8a332d39-5d82-40cf-b5a3-da151016bafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:55:59.673608 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1353/2698] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:55:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:55:59.678195 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2f3e6-32ea-4a68-a8e3-6f7270ccbd97 service neutron] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:59.687862 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2f3e6-32ea-4a68-a8e3-6f7270ccbd97 service neutron] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:59.692449 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319d04f-df30-4c53-9809-034f96a9e0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:59.693111 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319d04f-df30-4c53-9809-034f96a9e0f7 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:59.693387 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319d04f-df30-4c53-9809-034f96a9e0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:59.693657 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319d04f-df30-4c53-9809-034f96a9e0f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:59.694369 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319d04f-df30-4c53-9809-034f96a9e0f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:59.696267 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319d04f-df30-4c53-9809-034f96a9e0f7 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:59.726088 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1346/2699] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:55:59 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:59.727285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a332d39-5d82-40cf-b5a3-da151016bafd None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:59.738212 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a332d39-5d82-40cf-b5a3-da151016bafd None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:59.767178 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:59.797347 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940cc3c-607e-4798-83c5-e24902ac8180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:59.798071 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940cc3c-607e-4798-83c5-e24902ac8180 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:59.798355 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940cc3c-607e-4798-83c5-e24902ac8180 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:59.798622 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940cc3c-607e-4798-83c5-e24902ac8180 admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:59.799317 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940cc3c-607e-4798-83c5-e24902ac8180 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:59.801315 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940cc3c-607e-4798-83c5-e24902ac8180 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:59.823394 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1354/2700] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:55:59 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:55:59.827042 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319d04f-df30-4c53-9809-034f96a9e0f7 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:59.837462 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319d04f-df30-4c53-9809-034f96a9e0f7 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:59.842521 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807877f-f9be-4b4a-9f52-1b72535dcfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:59.843175 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807877f-f9be-4b4a-9f52-1b72535dcfe1 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:59.843420 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807877f-f9be-4b4a-9f52-1b72535dcfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:59.843756 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807877f-f9be-4b4a-9f52-1b72535dcfe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:59.844505 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807877f-f9be-4b4a-9f52-1b72535dcfe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:59.846153 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807877f-f9be-4b4a-9f52-1b72535dcfe1 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:59.857323 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1347/2701] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:55:59.861599 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940cc3c-607e-4798-83c5-e24902ac8180 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:59.871983 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940cc3c-607e-4798-83c5-e24902ac8180 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:59.877270 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77c28b-59a3-4f59-94fd-3a9382984916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:59.878232 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77c28b-59a3-4f59-94fd-3a9382984916 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:55:59.878511 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77c28b-59a3-4f59-94fd-3a9382984916 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:55:59.878780 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77c28b-59a3-4f59-94fd-3a9382984916 admin admin] PATH_INFO: `/v3/projects/c29c5ee007c84223ae571959177ea9f7/users/87e2afedf91641ac9312793bfbadb9b6/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:55:59.896164 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77c28b-59a3-4f59-94fd-3a9382984916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c29c5ee007c84223ae571959177ea9f7, user_id=87e2afedf91641ac9312793bfbadb9b6, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:55:59.899037 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77c28b-59a3-4f59-94fd-3a9382984916 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:55:59.915043 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1355/2702] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:55:59 2022] PUT /identity/v3/projects/c29c5ee007c84223ae571959177ea9f7/users/87e2afedf91641ac9312793bfbadb9b6/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:55:59.919441 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807877f-f9be-4b4a-9f52-1b72535dcfe1 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:55:59.930262 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807877f-f9be-4b4a-9f52-1b72535dcfe1 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:55:59.990163 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:55:59.999025 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5a6a7-c418-4dd6-bdc6-03ac3efd6222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:55:59.999777 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5a6a7-c418-4dd6-bdc6-03ac3efd6222 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:00.000265 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5a6a7-c418-4dd6-bdc6-03ac3efd6222 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:00.000675 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5a6a7-c418-4dd6-bdc6-03ac3efd6222 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:00.001592 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d5a6a7-c418-4dd6-bdc6-03ac3efd6222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:00.003241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d5a6a7-c418-4dd6-bdc6-03ac3efd6222 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:00.013164 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1348/2703] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:56:00.017457 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77c28b-59a3-4f59-94fd-3a9382984916 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:00.028155 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77c28b-59a3-4f59-94fd-3a9382984916 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:00.032856 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c309a58-fc86-4043-9dd9-0a4e576e272d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:00.033719 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c309a58-fc86-4043-9dd9-0a4e576e272d admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:00.034065 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c309a58-fc86-4043-9dd9-0a4e576e272d admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:00.034408 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c309a58-fc86-4043-9dd9-0a4e576e272d admin admin] PATH_INFO: `/v3/projects/c29c5ee007c84223ae571959177ea9f7/users/87e2afedf91641ac9312793bfbadb9b6/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:00.036631 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c309a58-fc86-4043-9dd9-0a4e576e272d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c29c5ee007c84223ae571959177ea9f7, user_id=87e2afedf91641ac9312793bfbadb9b6, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:00.039412 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c309a58-fc86-4043-9dd9-0a4e576e272d admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:00.051271 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1356/2704] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:56:00 2022] PUT /identity/v3/projects/c29c5ee007c84223ae571959177ea9f7/users/87e2afedf91641ac9312793bfbadb9b6/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:56:00.769043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53a12a-4cd7-49ee-a35e-c6144893a1ba None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:00.769567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53a12a-4cd7-49ee-a35e-c6144893a1ba None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:00.769567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53a12a-4cd7-49ee-a35e-c6144893a1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:00.796984 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-0a53a12a-4cd7-49ee-a35e-c6144893a1ba None None] MFA Rules not processed for user `87e2afedf91641ac9312793bfbadb9b6`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:00.798289 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-0a53a12a-4cd7-49ee-a35e-c6144893a1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:00.869964 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1349/2705] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:56:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:56:00.880562 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f442a8c-8f61-4128-99ec-b66bbed65b47 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:00.881100 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f442a8c-8f61-4128-99ec-b66bbed65b47 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:00.881100 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f442a8c-8f61-4128-99ec-b66bbed65b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:00.899324 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-8f442a8c-8f61-4128-99ec-b66bbed65b47 None None] MFA Rules not processed for user `f099dedb88aa4e2b9bb414d4f308ba1f`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:00.900456 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-8f442a8c-8f61-4128-99ec-b66bbed65b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:00.956278 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1357/2706] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:56:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:56:00.969098 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53a12a-4cd7-49ee-a35e-c6144893a1ba None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:00.970872 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-0a53a12a-4cd7-49ee-a35e-c6144893a1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:01.043234 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53a12a-4cd7-49ee-a35e-c6144893a1ba None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:01.049437 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08620396-6751-4c67-abc3-795e54cb0145 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:01.050369 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08620396-6751-4c67-abc3-795e54cb0145 service nova] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:01.050369 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08620396-6751-4c67-abc3-795e54cb0145 service nova] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:01.050574 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08620396-6751-4c67-abc3-795e54cb0145 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:01.060615 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08620396-6751-4c67-abc3-795e54cb0145 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:01.063126 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08620396-6751-4c67-abc3-795e54cb0145 service nova] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:01.076325 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1350/2707] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:56:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:56:10.949528 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=55,keystone:INSERT=5 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:11.071593 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=71 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:14.151530 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f442a8c-8f61-4128-99ec-b66bbed65b47 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:14.153832 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-8f442a8c-8f61-4128-99ec-b66bbed65b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:14.217542 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f442a8c-8f61-4128-99ec-b66bbed65b47 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:14.221562 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4c66f-f1ef-45c7-87e6-7c8d1051c3ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:14.222247 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4c66f-f1ef-45c7-87e6-7c8d1051c3ef service cinder] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:14.222522 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4c66f-f1ef-45c7-87e6-7c8d1051c3ef service cinder] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:14.222789 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4c66f-f1ef-45c7-87e6-7c8d1051c3ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:14.235996 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d4c66f-f1ef-45c7-87e6-7c8d1051c3ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:14.237447 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d4c66f-f1ef-45c7-87e6-7c8d1051c3ef service cinder] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:14.247468 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1358/2708] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:56:14 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:56:24.244924 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=26 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:33.458534 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08620396-6751-4c67-abc3-795e54cb0145 service nova] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:33.460098 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-08620396-6751-4c67-abc3-795e54cb0145 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:33.535992 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08620396-6751-4c67-abc3-795e54cb0145 service nova] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:33.542724 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54943259-5d16-4811-ae54-4d6cacdf84fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16662dd5e2e74163b6aa2e1e7ef07524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:33.543400 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54943259-5d16-4811-ae54-4d6cacdf84fe service placement] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:33.543684 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54943259-5d16-4811-ae54-4d6cacdf84fe service placement] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:33.543979 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54943259-5d16-4811-ae54-4d6cacdf84fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:33.546224 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-54943259-5d16-4811-ae54-4d6cacdf84fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:33.558605 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54943259-5d16-4811-ae54-4d6cacdf84fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:33.560276 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54943259-5d16-4811-ae54-4d6cacdf84fe service placement] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:33.570606 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1351/2709] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:56:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:56:34.050548 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4c66f-f1ef-45c7-87e6-7c8d1051c3ef service cinder] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:34.121948 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4c66f-f1ef-45c7-87e6-7c8d1051c3ef service cinder] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:34.126887 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b1ab4-d939-4385-b64d-744406a395ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:34.127753 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b1ab4-d939-4385-b64d-744406a395ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:34.128028 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b1ab4-d939-4385-b64d-744406a395ae admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:34.128269 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b1ab4-d939-4385-b64d-744406a395ae admin admin] PATH_INFO: `/v3/users/f099dedb88aa4e2b9bb414d4f308ba1f` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:34.129491 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b1ab4-d939-4385-b64d-744406a395ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=f099dedb88aa4e2b9bb414d4f308ba1f)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:34.131437 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b1ab4-d939-4385-b64d-744406a395ae admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:34.181630 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-8c1b1ab4-d939-4385-b64d-744406a395ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f099dedb88aa4e2b9bb414d4f308ba1f'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:34.193656 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-8c1b1ab4-d939-4385-b64d-744406a395ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f099dedb88aa4e2b9bb414d4f308ba1f'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:34.200502 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-8c1b1ab4-d939-4385-b64d-744406a395ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f099dedb88aa4e2b9bb414d4f308ba1f'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:34.201545 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-8c1b1ab4-d939-4385-b64d-744406a395ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f099dedb88aa4e2b9bb414d4f308ba1f'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:34.202336 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-8c1b1ab4-d939-4385-b64d-744406a395ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f099dedb88aa4e2b9bb414d4f308ba1f'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:34.218517 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1359/2710] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:56:34 2022] DELETE /identity/v3/users/f099dedb88aa4e2b9bb414d4f308ba1f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:56:34.428227 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54943259-5d16-4811-ae54-4d6cacdf84fe service placement] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:34.441561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54943259-5d16-4811-ae54-4d6cacdf84fe service placement] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:34.515338 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7942e-c578-45e2-94bd-548e2c96fd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:34.516264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7942e-c578-45e2-94bd-548e2c96fd29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:34.516544 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7942e-c578-45e2-94bd-548e2c96fd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:34.516820 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7942e-c578-45e2-94bd-548e2c96fd29 admin admin] PATH_INFO: `/v3/projects/777e53152e364aca9322559fe7edf945` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:34.518052 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7942e-c578-45e2-94bd-548e2c96fd29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=777e53152e364aca9322559fe7edf945)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:34.520013 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7942e-c578-45e2-94bd-548e2c96fd29 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:34.570654 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-d1c7942e-c578-45e2-94bd-548e2c96fd29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '777e53152e364aca9322559fe7edf945', 'request_id': 'req-d1c7942e-c578-45e2-94bd-548e2c96fd29'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:34.576651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-d1c7942e-c578-45e2-94bd-548e2c96fd29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '777e53152e364aca9322559fe7edf945', 'request_id': 'req-d1c7942e-c578-45e2-94bd-548e2c96fd29'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:34.585637 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-d1c7942e-c578-45e2-94bd-548e2c96fd29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '777e53152e364aca9322559fe7edf945', 'request_id': 'req-d1c7942e-c578-45e2-94bd-548e2c96fd29'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:34.597065 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-d1c7942e-c578-45e2-94bd-548e2c96fd29 admin admin] The token cache is being invalidate because project 777e53152e364aca9322559fe7edf945 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:56:34.597350 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-d1c7942e-c578-45e2-94bd-548e2c96fd29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:34.598019 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-d1c7942e-c578-45e2-94bd-548e2c96fd29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:34.599581 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1352/2711] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:56:34 2022] DELETE /identity/v3/projects/777e53152e364aca9322559fe7edf945 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:56:34.603712 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b1ab4-d939-4385-b64d-744406a395ae admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:34.605173 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-8c1b1ab4-d939-4385-b64d-744406a395ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:34.618637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b1ab4-d939-4385-b64d-744406a395ae admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:34.676597 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d439ae3-2b99-4393-9e6c-77319d5a35a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:34.677505 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d439ae3-2b99-4393-9e6c-77319d5a35a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:34.677779 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d439ae3-2b99-4393-9e6c-77319d5a35a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:34.678091 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d439ae3-2b99-4393-9e6c-77319d5a35a7 admin admin] PATH_INFO: `/v3/users/87e2afedf91641ac9312793bfbadb9b6` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:34.679298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d439ae3-2b99-4393-9e6c-77319d5a35a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87e2afedf91641ac9312793bfbadb9b6)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:34.681244 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d439ae3-2b99-4393-9e6c-77319d5a35a7 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:34.704056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:34.732603 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-5d439ae3-2b99-4393-9e6c-77319d5a35a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87e2afedf91641ac9312793bfbadb9b6'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:34.746710 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-5d439ae3-2b99-4393-9e6c-77319d5a35a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87e2afedf91641ac9312793bfbadb9b6'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:34.754057 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-5d439ae3-2b99-4393-9e6c-77319d5a35a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87e2afedf91641ac9312793bfbadb9b6'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:34.754784 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-5d439ae3-2b99-4393-9e6c-77319d5a35a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87e2afedf91641ac9312793bfbadb9b6'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:34.755383 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-5d439ae3-2b99-4393-9e6c-77319d5a35a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87e2afedf91641ac9312793bfbadb9b6'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:34.769298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1360/2712] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:56:34 2022] DELETE /identity/v3/users/87e2afedf91641ac9312793bfbadb9b6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:56:34.940981 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7942e-c578-45e2-94bd-548e2c96fd29 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:34.943385 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-d1c7942e-c578-45e2-94bd-548e2c96fd29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:34.958281 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7942e-c578-45e2-94bd-548e2c96fd29 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:34.977524 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:35.021153 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c7b58-df5c-4ef4-9515-fef90ae19aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:35.022170 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c7b58-df5c-4ef4-9515-fef90ae19aac admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:35.022448 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c7b58-df5c-4ef4-9515-fef90ae19aac admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:35.022746 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c7b58-df5c-4ef4-9515-fef90ae19aac admin admin] PATH_INFO: `/v3/projects/c29c5ee007c84223ae571959177ea9f7` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:35.023931 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c7b58-df5c-4ef4-9515-fef90ae19aac admin admin] RBAC: Authorizing `identity:delete_project(project_id=c29c5ee007c84223ae571959177ea9f7)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:35.026277 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c7b58-df5c-4ef4-9515-fef90ae19aac admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:35.073385 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-444c7b58-df5c-4ef4-9515-fef90ae19aac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c29c5ee007c84223ae571959177ea9f7', 'request_id': 'req-444c7b58-df5c-4ef4-9515-fef90ae19aac'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:35.079108 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-444c7b58-df5c-4ef4-9515-fef90ae19aac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c29c5ee007c84223ae571959177ea9f7', 'request_id': 'req-444c7b58-df5c-4ef4-9515-fef90ae19aac'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:35.087486 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-444c7b58-df5c-4ef4-9515-fef90ae19aac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c29c5ee007c84223ae571959177ea9f7', 'request_id': 'req-444c7b58-df5c-4ef4-9515-fef90ae19aac'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:35.099830 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-444c7b58-df5c-4ef4-9515-fef90ae19aac admin admin] The token cache is being invalidate because project c29c5ee007c84223ae571959177ea9f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:56:35.100118 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-444c7b58-df5c-4ef4-9515-fef90ae19aac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:35.100744 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-444c7b58-df5c-4ef4-9515-fef90ae19aac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:35.102333 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1353/2713] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:56:34 2022] DELETE /identity/v3/projects/c29c5ee007c84223ae571959177ea9f7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:56:35.107283 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba04be-64ab-4b20-a2e8-3fe8f4515b0a None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:35.107941 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba04be-64ab-4b20-a2e8-3fe8f4515b0a None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:35.107941 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba04be-64ab-4b20-a2e8-3fe8f4515b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:35.125519 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-87ba04be-64ab-4b20-a2e8-3fe8f4515b0a None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:35.126843 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-87ba04be-64ab-4b20-a2e8-3fe8f4515b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:35.191767 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1361/2714] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:56:35.260428 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981395b-3df3-4d99-a417-0962cdd2a0a3 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:35.260743 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981395b-3df3-4d99-a417-0962cdd2a0a3 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:35.261011 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981395b-3df3-4d99-a417-0962cdd2a0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:35.280395 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-0981395b-3df3-4d99-a417-0962cdd2a0a3 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:35.281614 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-0981395b-3df3-4d99-a417-0962cdd2a0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:35.290810 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1354/2715] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:56:35.295507 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba04be-64ab-4b20-a2e8-3fe8f4515b0a None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:35.305295 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba04be-64ab-4b20-a2e8-3fe8f4515b0a None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:35.309920 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e603329-18a7-4cb4-bda9-85e311f9bb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:35.310582 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e603329-18a7-4cb4-bda9-85e311f9bb66 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:35.310933 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e603329-18a7-4cb4-bda9-85e311f9bb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:35.311222 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e603329-18a7-4cb4-bda9-85e311f9bb66 admin admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:35.311956 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e603329-18a7-4cb4-bda9-85e311f9bb66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:56:35.312261 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e603329-18a7-4cb4-bda9-85e311f9bb66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:35.313908 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e603329-18a7-4cb4-bda9-85e311f9bb66 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:35.329453 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1362/2716] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:56:35.330782 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981395b-3df3-4d99-a417-0962cdd2a0a3 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:35.340507 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981395b-3df3-4d99-a417-0962cdd2a0a3 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:35.346053 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc7257-9162-4937-8445-9f6f9bf68bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:35.346718 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc7257-9162-4937-8445-9f6f9bf68bcc admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:35.346998 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc7257-9162-4937-8445-9f6f9bf68bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:35.347269 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc7257-9162-4937-8445-9f6f9bf68bcc admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:35.347962 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc7257-9162-4937-8445-9f6f9bf68bcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:35.349917 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc7257-9162-4937-8445-9f6f9bf68bcc admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:35.377067 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1355/2717] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:56:35 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:56:35.381344 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e603329-18a7-4cb4-bda9-85e311f9bb66 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:35.391930 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e603329-18a7-4cb4-bda9-85e311f9bb66 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:35.453467 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb2d43-e727-4575-903e-e28e17fe89f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:35.454195 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb2d43-e727-4575-903e-e28e17fe89f4 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:35.454476 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb2d43-e727-4575-903e-e28e17fe89f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:35.454735 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb2d43-e727-4575-903e-e28e17fe89f4 admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:35.455441 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb2d43-e727-4575-903e-e28e17fe89f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:35.461122 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb2d43-e727-4575-903e-e28e17fe89f4 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:35.491285 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1363/2718] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:56:35 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:56:35.492616 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc7257-9162-4937-8445-9f6f9bf68bcc admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:35.503540 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc7257-9162-4937-8445-9f6f9bf68bcc admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:35.508277 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8391b-feb1-4129-88da-150778e7c7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:35.508948 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8391b-feb1-4129-88da-150778e7c7fc admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:35.509224 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8391b-feb1-4129-88da-150778e7c7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:35.509498 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8391b-feb1-4129-88da-150778e7c7fc admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:35.510270 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c8391b-feb1-4129-88da-150778e7c7fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:35.514100 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c8391b-feb1-4129-88da-150778e7c7fc admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:35.536953 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1356/2719] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:56:35.538114 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb2d43-e727-4575-903e-e28e17fe89f4 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:35.553055 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb2d43-e727-4575-903e-e28e17fe89f4 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:35.562725 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8497b4-dfee-4980-b1e7-a5b07059be70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:35.563719 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8497b4-dfee-4980-b1e7-a5b07059be70 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:35.564006 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8497b4-dfee-4980-b1e7-a5b07059be70 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:35.564287 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8497b4-dfee-4980-b1e7-a5b07059be70 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:35.565220 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8497b4-dfee-4980-b1e7-a5b07059be70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:35.567150 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8497b4-dfee-4980-b1e7-a5b07059be70 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:35.580790 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1364/2720] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:56:35.585017 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8391b-feb1-4129-88da-150778e7c7fc admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:35.609896 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8391b-feb1-4129-88da-150778e7c7fc admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:35.637198 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ccec7-225e-46e1-8675-b636da9bf475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:35.640223 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ccec7-225e-46e1-8675-b636da9bf475 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:35.646234 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ccec7-225e-46e1-8675-b636da9bf475 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:35.650297 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ccec7-225e-46e1-8675-b636da9bf475 admin admin] PATH_INFO: `/v3/projects/97dd2257afc84445ba2cddd9121eb42d/users/a87c102c9ed748789fe92b759b301f8a/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:35.687390 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ccec7-225e-46e1-8675-b636da9bf475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97dd2257afc84445ba2cddd9121eb42d, user_id=a87c102c9ed748789fe92b759b301f8a, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:35.690347 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ccec7-225e-46e1-8675-b636da9bf475 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:35.717658 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1357/2721] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:56:35 2022] PUT /identity/v3/projects/97dd2257afc84445ba2cddd9121eb42d/users/a87c102c9ed748789fe92b759b301f8a/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:56:35.720097 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05bd74-0a0e-4cd2-b6b1-0c27f7974b40 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:35.720391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05bd74-0a0e-4cd2-b6b1-0c27f7974b40 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:35.720671 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05bd74-0a0e-4cd2-b6b1-0c27f7974b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:35.728750 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:35.757196 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-bf05bd74-0a0e-4cd2-b6b1-0c27f7974b40 None None] MFA Rules not processed for user `a87c102c9ed748789fe92b759b301f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:35.758439 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-bf05bd74-0a0e-4cd2-b6b1-0c27f7974b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:35.838865 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1365/2722] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:56:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:56:35.843484 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ccec7-225e-46e1-8675-b636da9bf475 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:35.891054 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:35.907786 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ccec7-225e-46e1-8675-b636da9bf475 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:35.912390 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f4015-eb86-4c96-92c9-3308351a0989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:35.913052 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f4015-eb86-4c96-92c9-3308351a0989 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:35.913330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f4015-eb86-4c96-92c9-3308351a0989 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:35.913600 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f4015-eb86-4c96-92c9-3308351a0989 admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:35.914332 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f4015-eb86-4c96-92c9-3308351a0989 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:35.916234 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f4015-eb86-4c96-92c9-3308351a0989 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:35.942620 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1358/2723] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:56:35 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:56:35.946855 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05bd74-0a0e-4cd2-b6b1-0c27f7974b40 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:35.958790 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05bd74-0a0e-4cd2-b6b1-0c27f7974b40 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:36.024404 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f7c9c-8a3e-488f-bffc-e225a6304821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:36.025165 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f7c9c-8a3e-488f-bffc-e225a6304821 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:36.025511 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f7c9c-8a3e-488f-bffc-e225a6304821 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:36.026234 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f7c9c-8a3e-488f-bffc-e225a6304821 admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:36.026980 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f7c9c-8a3e-488f-bffc-e225a6304821 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:36.028965 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f7c9c-8a3e-488f-bffc-e225a6304821 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:36.053916 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1366/2724] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:56:35 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:56:36.055104 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f4015-eb86-4c96-92c9-3308351a0989 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:36.067068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f4015-eb86-4c96-92c9-3308351a0989 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:36.071806 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1160de5-aab7-4004-ba07-899d1dcec0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:36.072480 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1160de5-aab7-4004-ba07-899d1dcec0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:36.072756 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1160de5-aab7-4004-ba07-899d1dcec0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:36.073028 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1160de5-aab7-4004-ba07-899d1dcec0a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:36.073762 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1160de5-aab7-4004-ba07-899d1dcec0a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:36.075427 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1160de5-aab7-4004-ba07-899d1dcec0a7 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:36.087157 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1359/2725] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:56:36.091265 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f7c9c-8a3e-488f-bffc-e225a6304821 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:36.102515 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f7c9c-8a3e-488f-bffc-e225a6304821 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:36.108039 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5171c-4e4e-4463-86ba-12daffe6c13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:36.109556 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5171c-4e4e-4463-86ba-12daffe6c13b admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:36.110168 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5171c-4e4e-4463-86ba-12daffe6c13b admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:36.110448 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5171c-4e4e-4463-86ba-12daffe6c13b admin admin] PATH_INFO: `/v3/projects/054d5b1fbf32463da64f0d8103516eda/users/da1c051a775e47a7a11a4446c899f113/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:36.133163 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d5171c-4e4e-4463-86ba-12daffe6c13b admin admin] RBAC: Authorizing `identity:create_grant(project_id=054d5b1fbf32463da64f0d8103516eda, user_id=da1c051a775e47a7a11a4446c899f113, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:36.136287 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d5171c-4e4e-4463-86ba-12daffe6c13b admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:36.163600 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1367/2726] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:56:36 2022] PUT /identity/v3/projects/054d5b1fbf32463da64f0d8103516eda/users/da1c051a775e47a7a11a4446c899f113/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:56:36.167607 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1160de5-aab7-4004-ba07-899d1dcec0a7 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:36.178235 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1160de5-aab7-4004-ba07-899d1dcec0a7 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:36.238469 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5c7a1-7eb5-47d7-8417-1f4fc1d9a98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:36.239345 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5c7a1-7eb5-47d7-8417-1f4fc1d9a98e admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:36.239687 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5c7a1-7eb5-47d7-8417-1f4fc1d9a98e admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:36.240031 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5c7a1-7eb5-47d7-8417-1f4fc1d9a98e admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:36.240832 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5c7a1-7eb5-47d7-8417-1f4fc1d9a98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:36.242662 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5c7a1-7eb5-47d7-8417-1f4fc1d9a98e admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:36.253055 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1360/2727] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:56:36.257332 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5171c-4e4e-4463-86ba-12daffe6c13b admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:36.268222 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5171c-4e4e-4463-86ba-12daffe6c13b admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:36.273755 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee18f8-5e9e-4ac3-832f-e4362c3f8363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:36.274792 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee18f8-5e9e-4ac3-832f-e4362c3f8363 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:36.275137 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee18f8-5e9e-4ac3-832f-e4362c3f8363 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:36.275413 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee18f8-5e9e-4ac3-832f-e4362c3f8363 admin admin] PATH_INFO: `/v3/projects/054d5b1fbf32463da64f0d8103516eda/users/da1c051a775e47a7a11a4446c899f113/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:36.277987 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee18f8-5e9e-4ac3-832f-e4362c3f8363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=054d5b1fbf32463da64f0d8103516eda, user_id=da1c051a775e47a7a11a4446c899f113, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:36.280778 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee18f8-5e9e-4ac3-832f-e4362c3f8363 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:36.292275 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1368/2728] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:56:36 2022] PUT /identity/v3/projects/054d5b1fbf32463da64f0d8103516eda/users/da1c051a775e47a7a11a4446c899f113/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:56:36.302897 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3cb82-5d75-4a4a-b184-796843229e1e None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:36.303275 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3cb82-5d75-4a4a-b184-796843229e1e None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:36.303636 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3cb82-5d75-4a4a-b184-796843229e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:36.332241 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-99b3cb82-5d75-4a4a-b184-796843229e1e None None] MFA Rules not processed for user `da1c051a775e47a7a11a4446c899f113`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:36.333466 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-99b3cb82-5d75-4a4a-b184-796843229e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:36.405316 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1361/2729] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:56:36 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:56:36.418899 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee18f8-5e9e-4ac3-832f-e4362c3f8363 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:36.421109 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-c6ee18f8-5e9e-4ac3-832f-e4362c3f8363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:36.479479 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:36.485175 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee18f8-5e9e-4ac3-832f-e4362c3f8363 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:36.489934 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78c090-bb85-4791-86d4-d69267f2183c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:36.490644 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78c090-bb85-4791-86d4-d69267f2183c service cinder] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:36.490934 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78c090-bb85-4791-86d4-d69267f2183c service cinder] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:36.491216 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78c090-bb85-4791-86d4-d69267f2183c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:36.550568 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa78c090-bb85-4791-86d4-d69267f2183c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:36.551936 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa78c090-bb85-4791-86d4-d69267f2183c service cinder] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:36.561060 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1369/2730] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:56:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:56:39.121219 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3cb82-5d75-4a4a-b184-796843229e1e None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:39.171189 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:39.189763 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3cb82-5d75-4a4a-b184-796843229e1e None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:39.194306 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0521dd-0e32-4244-88e1-f8babf847811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:39.195194 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0521dd-0e32-4244-88e1-f8babf847811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:39.195464 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0521dd-0e32-4244-88e1-f8babf847811 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:39.195740 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0521dd-0e32-4244-88e1-f8babf847811 admin admin] PATH_INFO: `/v3/users/a87c102c9ed748789fe92b759b301f8a` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:39.196942 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0521dd-0e32-4244-88e1-f8babf847811 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a87c102c9ed748789fe92b759b301f8a)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:39.198922 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0521dd-0e32-4244-88e1-f8babf847811 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:39.247691 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-6b0521dd-0e32-4244-88e1-f8babf847811 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a87c102c9ed748789fe92b759b301f8a'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:39.254420 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-6b0521dd-0e32-4244-88e1-f8babf847811 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a87c102c9ed748789fe92b759b301f8a'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:39.265904 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-6b0521dd-0e32-4244-88e1-f8babf847811 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a87c102c9ed748789fe92b759b301f8a'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:39.266561 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-6b0521dd-0e32-4244-88e1-f8babf847811 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a87c102c9ed748789fe92b759b301f8a'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:39.267191 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-6b0521dd-0e32-4244-88e1-f8babf847811 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a87c102c9ed748789fe92b759b301f8a'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:39.281809 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1362/2731] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:56:39 2022] DELETE /identity/v3/users/a87c102c9ed748789fe92b759b301f8a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:56:39.287272 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73155cb7-2be5-4b67-8a76-0e30f581dece None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:39.287789 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73155cb7-2be5-4b67-8a76-0e30f581dece None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:39.287920 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73155cb7-2be5-4b67-8a76-0e30f581dece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:39.305251 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-73155cb7-2be5-4b67-8a76-0e30f581dece None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:39.306470 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-73155cb7-2be5-4b67-8a76-0e30f581dece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:39.365920 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1370/2732] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:56:39.375797 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0521dd-0e32-4244-88e1-f8babf847811 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:39.377352 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-6b0521dd-0e32-4244-88e1-f8babf847811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:39.437091 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0521dd-0e32-4244-88e1-f8babf847811 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:39.441023 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f19a99-93a7-402c-83c9-9ae8c8cc3784 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:39.441600 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f19a99-93a7-402c-83c9-9ae8c8cc3784 service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:39.441875 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f19a99-93a7-402c-83c9-9ae8c8cc3784 service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:39.442180 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f19a99-93a7-402c-83c9-9ae8c8cc3784 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:39.451514 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f19a99-93a7-402c-83c9-9ae8c8cc3784 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:39.452952 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f19a99-93a7-402c-83c9-9ae8c8cc3784 service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:39.462580 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1363/2733] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:56:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:56:39.727639 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73155cb7-2be5-4b67-8a76-0e30f581dece None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:39.729104 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-73155cb7-2be5-4b67-8a76-0e30f581dece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:39.743854 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73155cb7-2be5-4b67-8a76-0e30f581dece None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:39.749553 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c9b04-39f6-4646-b0e9-7cff3a03f170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:39.750552 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c9b04-39f6-4646-b0e9-7cff3a03f170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:39.750830 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c9b04-39f6-4646-b0e9-7cff3a03f170 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:39.751091 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c9b04-39f6-4646-b0e9-7cff3a03f170 admin admin] PATH_INFO: `/v3/projects/97dd2257afc84445ba2cddd9121eb42d` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:39.752318 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c9b04-39f6-4646-b0e9-7cff3a03f170 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97dd2257afc84445ba2cddd9121eb42d)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:39.754423 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c9b04-39f6-4646-b0e9-7cff3a03f170 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:39.802509 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-401c9b04-39f6-4646-b0e9-7cff3a03f170 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97dd2257afc84445ba2cddd9121eb42d', 'request_id': 'req-401c9b04-39f6-4646-b0e9-7cff3a03f170'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:39.807963 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-401c9b04-39f6-4646-b0e9-7cff3a03f170 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97dd2257afc84445ba2cddd9121eb42d', 'request_id': 'req-401c9b04-39f6-4646-b0e9-7cff3a03f170'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:39.816494 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-401c9b04-39f6-4646-b0e9-7cff3a03f170 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97dd2257afc84445ba2cddd9121eb42d', 'request_id': 'req-401c9b04-39f6-4646-b0e9-7cff3a03f170'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:39.827880 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-401c9b04-39f6-4646-b0e9-7cff3a03f170 admin admin] The token cache is being invalidate because project 97dd2257afc84445ba2cddd9121eb42d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:56:39.828172 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-401c9b04-39f6-4646-b0e9-7cff3a03f170 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:39.828882 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-401c9b04-39f6-4646-b0e9-7cff3a03f170 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:39.830573 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1371/2734] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:56:39 2022] DELETE /identity/v3/projects/97dd2257afc84445ba2cddd9121eb42d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:56:39.834684 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f19a99-93a7-402c-83c9-9ae8c8cc3784 service neutron] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:39.845116 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f19a99-93a7-402c-83c9-9ae8c8cc3784 service neutron] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:39.905755 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8091d18d-f6bf-4d85-a2d8-f289ac7b0b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:39.906752 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091d18d-f6bf-4d85-a2d8-f289ac7b0b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:39.907033 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091d18d-f6bf-4d85-a2d8-f289ac7b0b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:39.907346 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091d18d-f6bf-4d85-a2d8-f289ac7b0b9f admin admin] PATH_INFO: `/v3/users/da1c051a775e47a7a11a4446c899f113` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:39.908664 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8091d18d-f6bf-4d85-a2d8-f289ac7b0b9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=da1c051a775e47a7a11a4446c899f113)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:39.910664 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8091d18d-f6bf-4d85-a2d8-f289ac7b0b9f admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:39.915943 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:39.967233 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-8091d18d-f6bf-4d85-a2d8-f289ac7b0b9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da1c051a775e47a7a11a4446c899f113'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:39.975258 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-8091d18d-f6bf-4d85-a2d8-f289ac7b0b9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da1c051a775e47a7a11a4446c899f113'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:39.987476 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-8091d18d-f6bf-4d85-a2d8-f289ac7b0b9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da1c051a775e47a7a11a4446c899f113'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:39.988162 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-8091d18d-f6bf-4d85-a2d8-f289ac7b0b9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da1c051a775e47a7a11a4446c899f113'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:39.988821 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-8091d18d-f6bf-4d85-a2d8-f289ac7b0b9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da1c051a775e47a7a11a4446c899f113'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:40.004756 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1364/2735] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:56:39 2022] DELETE /identity/v3/users/da1c051a775e47a7a11a4446c899f113 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:56:40.282650 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c9b04-39f6-4646-b0e9-7cff3a03f170 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:56:40.284115 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-401c9b04-39f6-4646-b0e9-7cff3a03f170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:40.307366 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c9b04-39f6-4646-b0e9-7cff3a03f170 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:56:40.327780 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:40.376400 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d4cb8-ac4d-4c50-acfc-0cdbdd3cefbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:56:40.377283 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d4cb8-ac4d-4c50-acfc-0cdbdd3cefbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:40.378112 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d4cb8-ac4d-4c50-acfc-0cdbdd3cefbe admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:40.378421 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d4cb8-ac4d-4c50-acfc-0cdbdd3cefbe admin admin] PATH_INFO: `/v3/projects/054d5b1fbf32463da64f0d8103516eda` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:40.379632 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d4cb8-ac4d-4c50-acfc-0cdbdd3cefbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=054d5b1fbf32463da64f0d8103516eda)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:56:40.381557 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864d4cb8-ac4d-4c50-acfc-0cdbdd3cefbe admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:56:40.433628 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-864d4cb8-ac4d-4c50-acfc-0cdbdd3cefbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '054d5b1fbf32463da64f0d8103516eda', 'request_id': 'req-864d4cb8-ac4d-4c50-acfc-0cdbdd3cefbe'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:40.440722 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-864d4cb8-ac4d-4c50-acfc-0cdbdd3cefbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '054d5b1fbf32463da64f0d8103516eda', 'request_id': 'req-864d4cb8-ac4d-4c50-acfc-0cdbdd3cefbe'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:40.449800 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-864d4cb8-ac4d-4c50-acfc-0cdbdd3cefbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '054d5b1fbf32463da64f0d8103516eda', 'request_id': 'req-864d4cb8-ac4d-4c50-acfc-0cdbdd3cefbe'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:40.461078 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-864d4cb8-ac4d-4c50-acfc-0cdbdd3cefbe admin admin] The token cache is being invalidate because project 054d5b1fbf32463da64f0d8103516eda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:56:40.461359 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-864d4cb8-ac4d-4c50-acfc-0cdbdd3cefbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:40.462001 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-864d4cb8-ac4d-4c50-acfc-0cdbdd3cefbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:56:40.463560 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1372/2736] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:56:40 2022] DELETE /identity/v3/projects/054d5b1fbf32463da64f0d8103516eda => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:56:44.605448 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc20870-7b48-4945-a3e2-571688cd0c25 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:56:44.605958 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc20870-7b48-4945-a3e2-571688cd0c25 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:56:44.606069 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc20870-7b48-4945-a3e2-571688cd0c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:56:44.624019 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-7cc20870-7b48-4945-a3e2-571688cd0c25 None None] MFA Rules not processed for user `0fc065a56e5f499ababfb5272ef309c9`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:56:44.625208 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-7cc20870-7b48-4945-a3e2-571688cd0c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:56:44.684637 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1365/2737] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:56:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:56:50.458355 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:56:54.677323 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:57:37.806353 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d4cb8-ac4d-4c50-acfc-0cdbdd3cefbe admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:57:37.807830 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-864d4cb8-ac4d-4c50-acfc-0cdbdd3cefbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:57:37.882280 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d4cb8-ac4d-4c50-acfc-0cdbdd3cefbe admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:57:37.887372 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdae17e-4753-4392-aa87-8f353c54b2e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16662dd5e2e74163b6aa2e1e7ef07524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:57:37.888033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdae17e-4753-4392-aa87-8f353c54b2e8 service placement] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:37.888335 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdae17e-4753-4392-aa87-8f353c54b2e8 service placement] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:37.888722 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdae17e-4753-4392-aa87-8f353c54b2e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:37.890613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-bcdae17e-4753-4392-aa87-8f353c54b2e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:57:37.902806 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdae17e-4753-4392-aa87-8f353c54b2e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:57:37.904387 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdae17e-4753-4392-aa87-8f353c54b2e8 service placement] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:57:37.914810 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1373/2738] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:57:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:57:40.511791 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df094f4-9128-4933-ad53-a1a057ce7dbc None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:40.512319 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df094f4-9128-4933-ad53-a1a057ce7dbc None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:40.512444 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df094f4-9128-4933-ad53-a1a057ce7dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:40.530411 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-7df094f4-9128-4933-ad53-a1a057ce7dbc None None] MFA Rules not processed for user `0fc065a56e5f499ababfb5272ef309c9`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:57:40.531624 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-7df094f4-9128-4933-ad53-a1a057ce7dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:57:40.539074 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1366/2739] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:57:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:57:47.910593 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=32 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:57:50.525229 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:57:53.082852 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdae17e-4753-4392-aa87-8f353c54b2e8 service placement] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:57:53.084382 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-bcdae17e-4753-4392-aa87-8f353c54b2e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:57:53.162466 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdae17e-4753-4392-aa87-8f353c54b2e8 service placement] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:57:53.168224 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f9eb6-a5e1-401a-8c26-aaa55d2b5a33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:57:53.168910 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f9eb6-a5e1-401a-8c26-aaa55d2b5a33 service nova] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:57:53.169197 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f9eb6-a5e1-401a-8c26-aaa55d2b5a33 service nova] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:57:53.169472 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f9eb6-a5e1-401a-8c26-aaa55d2b5a33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:57:53.171389 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-f92f9eb6-a5e1-401a-8c26-aaa55d2b5a33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:57:53.184158 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f9eb6-a5e1-401a-8c26-aaa55d2b5a33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:57:53.185693 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f9eb6-a5e1-401a-8c26-aaa55d2b5a33 service nova] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:57:53.196966 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1374/2740] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:57:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:58:03.193205 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=34 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:58:44.097136 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df094f4-9128-4933-ad53-a1a057ce7dbc None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:44.098664 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-7df094f4-9128-4933-ad53-a1a057ce7dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:58:44.168330 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df094f4-9128-4933-ad53-a1a057ce7dbc None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:44.173471 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df361a-ed01-4a8e-be79-8ebfea58af3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:44.174419 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df361a-ed01-4a8e-be79-8ebfea58af3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:44.174701 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df361a-ed01-4a8e-be79-8ebfea58af3e admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:44.174977 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df361a-ed01-4a8e-be79-8ebfea58af3e admin admin] PATH_INFO: `/v3/users/0fc065a56e5f499ababfb5272ef309c9` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:44.176186 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9df361a-ed01-4a8e-be79-8ebfea58af3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fc065a56e5f499ababfb5272ef309c9)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:44.178200 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9df361a-ed01-4a8e-be79-8ebfea58af3e admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:44.227076 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-b9df361a-ed01-4a8e-be79-8ebfea58af3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fc065a56e5f499ababfb5272ef309c9'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:44.234092 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-b9df361a-ed01-4a8e-be79-8ebfea58af3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fc065a56e5f499ababfb5272ef309c9'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:44.246588 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-b9df361a-ed01-4a8e-be79-8ebfea58af3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fc065a56e5f499ababfb5272ef309c9'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:44.247264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-b9df361a-ed01-4a8e-be79-8ebfea58af3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fc065a56e5f499ababfb5272ef309c9'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:44.247886 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-b9df361a-ed01-4a8e-be79-8ebfea58af3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fc065a56e5f499ababfb5272ef309c9'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:44.261634 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1367/2741] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:58:44 2022] DELETE /identity/v3/users/0fc065a56e5f499ababfb5272ef309c9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:58:44.458713 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f9eb6-a5e1-401a-8c26-aaa55d2b5a33 service nova] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:44.470176 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f9eb6-a5e1-401a-8c26-aaa55d2b5a33 service nova] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:44.527663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79271ae7-dbb4-4f9c-a220-5f27f0fc6750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:44.528549 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79271ae7-dbb4-4f9c-a220-5f27f0fc6750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:44.528827 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79271ae7-dbb4-4f9c-a220-5f27f0fc6750 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:44.529095 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79271ae7-dbb4-4f9c-a220-5f27f0fc6750 admin admin] PATH_INFO: `/v3/projects/ef39352fe7714fac9d2235fb556c0531` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:44.530437 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79271ae7-dbb4-4f9c-a220-5f27f0fc6750 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef39352fe7714fac9d2235fb556c0531)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:44.532360 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79271ae7-dbb4-4f9c-a220-5f27f0fc6750 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:44.595925 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-79271ae7-dbb4-4f9c-a220-5f27f0fc6750 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef39352fe7714fac9d2235fb556c0531', 'request_id': 'req-79271ae7-dbb4-4f9c-a220-5f27f0fc6750'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:44.603698 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-79271ae7-dbb4-4f9c-a220-5f27f0fc6750 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef39352fe7714fac9d2235fb556c0531', 'request_id': 'req-79271ae7-dbb4-4f9c-a220-5f27f0fc6750'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:44.612175 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-79271ae7-dbb4-4f9c-a220-5f27f0fc6750 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef39352fe7714fac9d2235fb556c0531', 'request_id': 'req-79271ae7-dbb4-4f9c-a220-5f27f0fc6750'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:44.624770 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-79271ae7-dbb4-4f9c-a220-5f27f0fc6750 admin admin] The token cache is being invalidate because project ef39352fe7714fac9d2235fb556c0531 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:58:44.624950 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-79271ae7-dbb4-4f9c-a220-5f27f0fc6750 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:44.625606 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-79271ae7-dbb4-4f9c-a220-5f27f0fc6750 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:44.627219 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1375/2742] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:58:44 2022] DELETE /identity/v3/projects/ef39352fe7714fac9d2235fb556c0531 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:58:44.633770 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6da64f-f25c-4e1e-9f3f-4d88fe43df5a None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:44.634168 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6da64f-f25c-4e1e-9f3f-4d88fe43df5a None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:44.634445 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6da64f-f25c-4e1e-9f3f-4d88fe43df5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:44.654046 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-dd6da64f-f25c-4e1e-9f3f-4d88fe43df5a None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:58:44.655488 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-dd6da64f-f25c-4e1e-9f3f-4d88fe43df5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:58:44.720686 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1368/2743] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:58:44.728717 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7648b6-ff32-4c04-b24f-ec3484d63140 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:44.729002 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7648b6-ff32-4c04-b24f-ec3484d63140 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:44.729270 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7648b6-ff32-4c04-b24f-ec3484d63140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:44.748374 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-6a7648b6-ff32-4c04-b24f-ec3484d63140 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:58:44.749669 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-6a7648b6-ff32-4c04-b24f-ec3484d63140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:58:44.758255 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1376/2744] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:58:44.762563 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6da64f-f25c-4e1e-9f3f-4d88fe43df5a None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:44.772687 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6da64f-f25c-4e1e-9f3f-4d88fe43df5a None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:44.778946 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b1fa2-e00b-458d-ac1f-a5645eda37ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:44.779597 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b1fa2-e00b-458d-ac1f-a5645eda37ef admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:44.779878 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b1fa2-e00b-458d-ac1f-a5645eda37ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:44.780151 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b1fa2-e00b-458d-ac1f-a5645eda37ef admin admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:44.780964 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b1fa2-e00b-458d-ac1f-a5645eda37ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:58:44.781266 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b1fa2-e00b-458d-ac1f-a5645eda37ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:44.782939 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b1fa2-e00b-458d-ac1f-a5645eda37ef admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:44.794984 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1369/2745] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:58:44.799136 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7648b6-ff32-4c04-b24f-ec3484d63140 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:44.808563 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7648b6-ff32-4c04-b24f-ec3484d63140 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:44.813621 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e37481-f4d0-4024-9f66-f6544e57bf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:44.814294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e37481-f4d0-4024-9f66-f6544e57bf2b admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:44.814552 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e37481-f4d0-4024-9f66-f6544e57bf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:44.814817 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e37481-f4d0-4024-9f66-f6544e57bf2b admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:44.815496 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e37481-f4d0-4024-9f66-f6544e57bf2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:44.817376 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e37481-f4d0-4024-9f66-f6544e57bf2b admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:44.848542 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1377/2746] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:58:44 2022] POST /identity/v3/projects => generated 405 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:58:44.853351 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b1fa2-e00b-458d-ac1f-a5645eda37ef admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:44.868388 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b1fa2-e00b-458d-ac1f-a5645eda37ef admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:44.872997 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:58:44.931028 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b58ea1-afc8-431b-881d-6a759513eeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:44.931619 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b58ea1-afc8-431b-881d-6a759513eeaa admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:44.931895 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b58ea1-afc8-431b-881d-6a759513eeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:44.932166 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b58ea1-afc8-431b-881d-6a759513eeaa admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:44.932866 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b58ea1-afc8-431b-881d-6a759513eeaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:44.934846 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b58ea1-afc8-431b-881d-6a759513eeaa admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:44.958651 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1370/2747] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:58:44 2022] POST /identity/v3/users => generated 303 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:58:44.963514 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e37481-f4d0-4024-9f66-f6544e57bf2b admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:44.980348 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e37481-f4d0-4024-9f66-f6544e57bf2b admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:44.987289 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d74e2c-3cb6-4295-9fe6-3b9a38ab156d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:44.987971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d74e2c-3cb6-4295-9fe6-3b9a38ab156d admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:44.988226 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d74e2c-3cb6-4295-9fe6-3b9a38ab156d admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:44.988520 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d74e2c-3cb6-4295-9fe6-3b9a38ab156d admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:44.989241 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d74e2c-3cb6-4295-9fe6-3b9a38ab156d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:44.990888 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d74e2c-3cb6-4295-9fe6-3b9a38ab156d admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:45.001701 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1378/2748] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:58:45.005688 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b58ea1-afc8-431b-881d-6a759513eeaa admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:45.016347 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b58ea1-afc8-431b-881d-6a759513eeaa admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:45.021960 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3185c-d94c-4b63-9366-be4f04ac3313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:45.022616 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3185c-d94c-4b63-9366-be4f04ac3313 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:45.022890 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3185c-d94c-4b63-9366-be4f04ac3313 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:45.023161 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3185c-d94c-4b63-9366-be4f04ac3313 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:45.024260 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3185c-d94c-4b63-9366-be4f04ac3313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:45.025948 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3185c-d94c-4b63-9366-be4f04ac3313 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:45.036687 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1371/2749] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:58:45.040873 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d74e2c-3cb6-4295-9fe6-3b9a38ab156d admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:45.051231 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d74e2c-3cb6-4295-9fe6-3b9a38ab156d admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:45.056570 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bcdf29-9639-4c6f-9a69-28a3a18ee659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:45.057448 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcdf29-9639-4c6f-9a69-28a3a18ee659 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:45.057721 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcdf29-9639-4c6f-9a69-28a3a18ee659 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:45.058011 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcdf29-9639-4c6f-9a69-28a3a18ee659 admin admin] PATH_INFO: `/v3/projects/c95ef2de3b9049aab1e61928bcc03681/users/d9ef2500f0b74eb4938d3964b82c772f/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:45.074460 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bcdf29-9639-4c6f-9a69-28a3a18ee659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c95ef2de3b9049aab1e61928bcc03681, user_id=d9ef2500f0b74eb4938d3964b82c772f, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:45.078369 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bcdf29-9639-4c6f-9a69-28a3a18ee659 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:45.093056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1379/2750] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:58:45 2022] PUT /identity/v3/projects/c95ef2de3b9049aab1e61928bcc03681/users/d9ef2500f0b74eb4938d3964b82c772f/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:58:45.098380 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdfa13-27c5-4d2c-a4a1-5a35d441ccbf None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:45.098873 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdfa13-27c5-4d2c-a4a1-5a35d441ccbf None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:45.098994 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdfa13-27c5-4d2c-a4a1-5a35d441ccbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:45.116729 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-4dcdfa13-27c5-4d2c-a4a1-5a35d441ccbf None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:58:45.118020 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-4dcdfa13-27c5-4d2c-a4a1-5a35d441ccbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:58:45.179933 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1372/2751] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:58:45.189939 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bcdf29-9639-4c6f-9a69-28a3a18ee659 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:45.191921 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-85bcdf29-9639-4c6f-9a69-28a3a18ee659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:58:45.225690 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:58:45.258682 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bcdf29-9639-4c6f-9a69-28a3a18ee659 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:45.262560 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa5ed1-3510-4598-b0c1-2c7c0e85cc62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:45.263201 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa5ed1-3510-4598-b0c1-2c7c0e85cc62 service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:45.263482 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa5ed1-3510-4598-b0c1-2c7c0e85cc62 service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:45.263749 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa5ed1-3510-4598-b0c1-2c7c0e85cc62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:45.273076 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa5ed1-3510-4598-b0c1-2c7c0e85cc62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:45.275238 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa5ed1-3510-4598-b0c1-2c7c0e85cc62 service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:45.285516 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1380/2752] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:58:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:58:45.891098 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5e2e5-0220-46a4-9af9-471ccbca64e6 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:45.891363 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5e2e5-0220-46a4-9af9-471ccbca64e6 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:45.891656 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5e2e5-0220-46a4-9af9-471ccbca64e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:45.919671 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-8fd5e2e5-0220-46a4-9af9-471ccbca64e6 None None] MFA Rules not processed for user `d9ef2500f0b74eb4938d3964b82c772f`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:58:45.921234 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-8fd5e2e5-0220-46a4-9af9-471ccbca64e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:58:45.991692 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1373/2753] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:58:45 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:58:45.996436 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa5ed1-3510-4598-b0c1-2c7c0e85cc62 service neutron] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:46.006431 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa5ed1-3510-4598-b0c1-2c7c0e85cc62 service neutron] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:46.011138 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94364a-e997-4ad2-beb7-8f4d9cf7d89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:46.011743 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94364a-e997-4ad2-beb7-8f4d9cf7d89f admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:46.012025 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94364a-e997-4ad2-beb7-8f4d9cf7d89f admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:46.012304 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94364a-e997-4ad2-beb7-8f4d9cf7d89f admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:46.012998 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f94364a-e997-4ad2-beb7-8f4d9cf7d89f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:46.014958 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f94364a-e997-4ad2-beb7-8f4d9cf7d89f admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:46.043271 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1381/2754] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:58:45 2022] POST /identity/v3/projects => generated 403 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:58:46.047418 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5e2e5-0220-46a4-9af9-471ccbca64e6 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:46.058510 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5e2e5-0220-46a4-9af9-471ccbca64e6 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:46.070086 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:58:46.117141 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f2144-5b3a-4307-a5c2-d31fc0eee75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:46.117836 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f2144-5b3a-4307-a5c2-d31fc0eee75e admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:46.118121 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f2144-5b3a-4307-a5c2-d31fc0eee75e admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:46.118395 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f2144-5b3a-4307-a5c2-d31fc0eee75e admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:46.119082 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f2144-5b3a-4307-a5c2-d31fc0eee75e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:46.121069 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f2144-5b3a-4307-a5c2-d31fc0eee75e admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:46.142364 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1374/2755] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:58:46 2022] POST /identity/v3/users => generated 308 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:58:46.146619 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94364a-e997-4ad2-beb7-8f4d9cf7d89f admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:46.157910 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94364a-e997-4ad2-beb7-8f4d9cf7d89f admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:46.163451 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae7936-eea1-4cd4-86f1-448b07cbb785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:46.164122 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae7936-eea1-4cd4-86f1-448b07cbb785 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:46.164431 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae7936-eea1-4cd4-86f1-448b07cbb785 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:46.164693 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae7936-eea1-4cd4-86f1-448b07cbb785 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:46.165420 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae7936-eea1-4cd4-86f1-448b07cbb785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:46.167106 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae7936-eea1-4cd4-86f1-448b07cbb785 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:46.178079 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1382/2756] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:58:46.182451 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f2144-5b3a-4307-a5c2-d31fc0eee75e admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:46.192639 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f2144-5b3a-4307-a5c2-d31fc0eee75e admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:46.197507 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdfdd3-a43f-470c-a246-766d90974ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:46.198437 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdfdd3-a43f-470c-a246-766d90974ff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:46.198722 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdfdd3-a43f-470c-a246-766d90974ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:46.199032 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdfdd3-a43f-470c-a246-766d90974ff3 admin admin] PATH_INFO: `/v3/projects/f52ace5e45b94cbaab9635a953bf65e7/users/5f809b79d696486995ba5a9bba20a291/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:46.215575 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bdfdd3-a43f-470c-a246-766d90974ff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f52ace5e45b94cbaab9635a953bf65e7, user_id=5f809b79d696486995ba5a9bba20a291, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:46.218333 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bdfdd3-a43f-470c-a246-766d90974ff3 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:46.236095 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1375/2757] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:58:46 2022] PUT /identity/v3/projects/f52ace5e45b94cbaab9635a953bf65e7/users/5f809b79d696486995ba5a9bba20a291/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:58:46.240119 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae7936-eea1-4cd4-86f1-448b07cbb785 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:46.250426 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae7936-eea1-4cd4-86f1-448b07cbb785 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:46.314199 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f18982-507e-439a-af08-41de99b3d454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:46.314783 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f18982-507e-439a-af08-41de99b3d454 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:46.315058 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f18982-507e-439a-af08-41de99b3d454 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:46.315311 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f18982-507e-439a-af08-41de99b3d454 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:46.316032 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f18982-507e-439a-af08-41de99b3d454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:46.317707 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f18982-507e-439a-af08-41de99b3d454 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:46.328423 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1383/2758] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:58:46.332768 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdfdd3-a43f-470c-a246-766d90974ff3 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:46.344292 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdfdd3-a43f-470c-a246-766d90974ff3 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:46.349372 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d5ed8-5680-447b-84a2-a270134d0cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:46.350898 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d5ed8-5680-447b-84a2-a270134d0cd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:46.351175 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d5ed8-5680-447b-84a2-a270134d0cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:46.351449 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d5ed8-5680-447b-84a2-a270134d0cd9 admin admin] PATH_INFO: `/v3/projects/f52ace5e45b94cbaab9635a953bf65e7/users/5f809b79d696486995ba5a9bba20a291/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:46.353691 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d5ed8-5680-447b-84a2-a270134d0cd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f52ace5e45b94cbaab9635a953bf65e7, user_id=5f809b79d696486995ba5a9bba20a291, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:46.356398 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d5ed8-5680-447b-84a2-a270134d0cd9 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:46.367079 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1376/2759] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:58:46 2022] PUT /identity/v3/projects/f52ace5e45b94cbaab9635a953bf65e7/users/5f809b79d696486995ba5a9bba20a291/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:58:47.011045 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a302a-526a-4ebd-bc0c-d779354e2339 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:47.011596 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a302a-526a-4ebd-bc0c-d779354e2339 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:47.011596 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a302a-526a-4ebd-bc0c-d779354e2339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:47.040672 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-777a302a-526a-4ebd-bc0c-d779354e2339 None None] MFA Rules not processed for user `5f809b79d696486995ba5a9bba20a291`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:58:47.042038 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-777a302a-526a-4ebd-bc0c-d779354e2339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:58:47.117903 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1384/2760] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:58:47 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:58:48.157182 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d5ed8-5680-447b-84a2-a270134d0cd9 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:48.219847 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d5ed8-5680-447b-84a2-a270134d0cd9 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:48.225198 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31877d7a-e317-4dc8-8ef9-e267d9fcdced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:48.226090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31877d7a-e317-4dc8-8ef9-e267d9fcdced admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:48.226370 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31877d7a-e317-4dc8-8ef9-e267d9fcdced admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:48.226640 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31877d7a-e317-4dc8-8ef9-e267d9fcdced admin admin] PATH_INFO: `/v3/users/d9ef2500f0b74eb4938d3964b82c772f` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:48.227830 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31877d7a-e317-4dc8-8ef9-e267d9fcdced admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9ef2500f0b74eb4938d3964b82c772f)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:48.229785 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31877d7a-e317-4dc8-8ef9-e267d9fcdced admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:48.285250 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-31877d7a-e317-4dc8-8ef9-e267d9fcdced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9ef2500f0b74eb4938d3964b82c772f'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:48.292254 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-31877d7a-e317-4dc8-8ef9-e267d9fcdced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9ef2500f0b74eb4938d3964b82c772f'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:48.303207 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:58:48.305775 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-31877d7a-e317-4dc8-8ef9-e267d9fcdced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9ef2500f0b74eb4938d3964b82c772f'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:48.306612 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-31877d7a-e317-4dc8-8ef9-e267d9fcdced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9ef2500f0b74eb4938d3964b82c772f'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:48.307523 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-31877d7a-e317-4dc8-8ef9-e267d9fcdced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9ef2500f0b74eb4938d3964b82c772f'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:48.322426 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1377/2761] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:58:48 2022] DELETE /identity/v3/users/d9ef2500f0b74eb4938d3964b82c772f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:58:48.509378 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a302a-526a-4ebd-bc0c-d779354e2339 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:48.522576 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a302a-526a-4ebd-bc0c-d779354e2339 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:48.536703 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:58:48.583878 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3661dd5-527c-4d65-b342-e239fbb43d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:48.584757 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3661dd5-527c-4d65-b342-e239fbb43d18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:48.585028 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3661dd5-527c-4d65-b342-e239fbb43d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:48.585289 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3661dd5-527c-4d65-b342-e239fbb43d18 admin admin] PATH_INFO: `/v3/projects/c95ef2de3b9049aab1e61928bcc03681` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:48.586508 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3661dd5-527c-4d65-b342-e239fbb43d18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c95ef2de3b9049aab1e61928bcc03681)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:48.588454 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3661dd5-527c-4d65-b342-e239fbb43d18 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:48.644044 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-e3661dd5-527c-4d65-b342-e239fbb43d18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c95ef2de3b9049aab1e61928bcc03681', 'request_id': 'req-e3661dd5-527c-4d65-b342-e239fbb43d18'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:48.649979 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-e3661dd5-527c-4d65-b342-e239fbb43d18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c95ef2de3b9049aab1e61928bcc03681', 'request_id': 'req-e3661dd5-527c-4d65-b342-e239fbb43d18'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:48.658999 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-e3661dd5-527c-4d65-b342-e239fbb43d18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c95ef2de3b9049aab1e61928bcc03681', 'request_id': 'req-e3661dd5-527c-4d65-b342-e239fbb43d18'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:48.670336 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-e3661dd5-527c-4d65-b342-e239fbb43d18 admin admin] The token cache is being invalidate because project c95ef2de3b9049aab1e61928bcc03681 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:58:48.670616 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-e3661dd5-527c-4d65-b342-e239fbb43d18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:48.671319 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-e3661dd5-527c-4d65-b342-e239fbb43d18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:48.672948 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1385/2762] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:58:48 2022] DELETE /identity/v3/projects/c95ef2de3b9049aab1e61928bcc03681 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:58:48.677161 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31877d7a-e317-4dc8-8ef9-e267d9fcdced admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:48.678790 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-31877d7a-e317-4dc8-8ef9-e267d9fcdced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:58:48.692753 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31877d7a-e317-4dc8-8ef9-e267d9fcdced admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:48.750625 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02ec8b-2a60-4c68-a6e3-42327baa021c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:48.751404 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02ec8b-2a60-4c68-a6e3-42327baa021c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:48.751689 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02ec8b-2a60-4c68-a6e3-42327baa021c admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:48.751989 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02ec8b-2a60-4c68-a6e3-42327baa021c admin admin] PATH_INFO: `/v3/users/5f809b79d696486995ba5a9bba20a291` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:48.753202 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02ec8b-2a60-4c68-a6e3-42327baa021c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f809b79d696486995ba5a9bba20a291)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:48.755189 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02ec8b-2a60-4c68-a6e3-42327baa021c admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:48.812423 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-ae02ec8b-2a60-4c68-a6e3-42327baa021c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f809b79d696486995ba5a9bba20a291'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:48.819425 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-ae02ec8b-2a60-4c68-a6e3-42327baa021c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f809b79d696486995ba5a9bba20a291'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:48.831550 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-ae02ec8b-2a60-4c68-a6e3-42327baa021c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f809b79d696486995ba5a9bba20a291'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:48.832197 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-ae02ec8b-2a60-4c68-a6e3-42327baa021c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f809b79d696486995ba5a9bba20a291'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:48.832788 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-ae02ec8b-2a60-4c68-a6e3-42327baa021c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f809b79d696486995ba5a9bba20a291'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:48.845470 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1378/2763] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:58:48 2022] DELETE /identity/v3/users/5f809b79d696486995ba5a9bba20a291 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:58:49.031541 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3661dd5-527c-4d65-b342-e239fbb43d18 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:49.033215 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-e3661dd5-527c-4d65-b342-e239fbb43d18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:58:49.048232 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3661dd5-527c-4d65-b342-e239fbb43d18 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:49.109978 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d1f57-c21f-4367-ba67-11f87e27537f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:49.110848 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d1f57-c21f-4367-ba67-11f87e27537f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:49.111123 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d1f57-c21f-4367-ba67-11f87e27537f admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:49.111391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d1f57-c21f-4367-ba67-11f87e27537f admin admin] PATH_INFO: `/v3/projects/f52ace5e45b94cbaab9635a953bf65e7` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:49.112672 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d1f57-c21f-4367-ba67-11f87e27537f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f52ace5e45b94cbaab9635a953bf65e7)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:49.114681 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d1f57-c21f-4367-ba67-11f87e27537f admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:49.164324 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-796d1f57-c21f-4367-ba67-11f87e27537f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f52ace5e45b94cbaab9635a953bf65e7', 'request_id': 'req-796d1f57-c21f-4367-ba67-11f87e27537f'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:49.165512 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:58:49.172242 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-796d1f57-c21f-4367-ba67-11f87e27537f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f52ace5e45b94cbaab9635a953bf65e7', 'request_id': 'req-796d1f57-c21f-4367-ba67-11f87e27537f'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:49.180200 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-796d1f57-c21f-4367-ba67-11f87e27537f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f52ace5e45b94cbaab9635a953bf65e7', 'request_id': 'req-796d1f57-c21f-4367-ba67-11f87e27537f'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:49.191668 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-796d1f57-c21f-4367-ba67-11f87e27537f admin admin] The token cache is being invalidate because project f52ace5e45b94cbaab9635a953bf65e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:58:49.191948 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-796d1f57-c21f-4367-ba67-11f87e27537f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:49.192571 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-796d1f57-c21f-4367-ba67-11f87e27537f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:49.194159 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1386/2764] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:58:49 2022] DELETE /identity/v3/projects/f52ace5e45b94cbaab9635a953bf65e7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:58:49.199286 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3acea-cb57-44d6-90e2-4dbe6a2cad55 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:49.199766 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3acea-cb57-44d6-90e2-4dbe6a2cad55 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:49.199958 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3acea-cb57-44d6-90e2-4dbe6a2cad55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:49.219309 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-45d3acea-cb57-44d6-90e2-4dbe6a2cad55 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:58:49.220515 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-45d3acea-cb57-44d6-90e2-4dbe6a2cad55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:58:49.284292 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1379/2765] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:58:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:58:49.295308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15344de0-8180-41b7-8498-24624d7e3d1c None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:49.295596 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15344de0-8180-41b7-8498-24624d7e3d1c None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:49.295876 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15344de0-8180-41b7-8498-24624d7e3d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:49.315227 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-15344de0-8180-41b7-8498-24624d7e3d1c None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:58:49.316448 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-15344de0-8180-41b7-8498-24624d7e3d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:58:49.325186 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1387/2766] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:58:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:58:49.329626 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3acea-cb57-44d6-90e2-4dbe6a2cad55 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:49.340221 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3acea-cb57-44d6-90e2-4dbe6a2cad55 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:49.345763 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b571c-e3e4-410e-8c3c-a40aea8bb577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:49.346459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b571c-e3e4-410e-8c3c-a40aea8bb577 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:49.346725 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b571c-e3e4-410e-8c3c-a40aea8bb577 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:49.346996 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b571c-e3e4-410e-8c3c-a40aea8bb577 admin admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:49.347730 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b571c-e3e4-410e-8c3c-a40aea8bb577 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:58:49.348031 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b571c-e3e4-410e-8c3c-a40aea8bb577 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:49.349638 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b571c-e3e4-410e-8c3c-a40aea8bb577 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:49.351127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:58:49.364329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1380/2767] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:58:49.368533 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15344de0-8180-41b7-8498-24624d7e3d1c None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:49.378176 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15344de0-8180-41b7-8498-24624d7e3d1c None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:49.383934 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a9211-99cf-4531-bca7-a016924c70ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:49.384584 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a9211-99cf-4531-bca7-a016924c70ea admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:49.384859 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a9211-99cf-4531-bca7-a016924c70ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:49.385127 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a9211-99cf-4531-bca7-a016924c70ea admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:49.385809 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a9211-99cf-4531-bca7-a016924c70ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:49.387747 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a9211-99cf-4531-bca7-a016924c70ea admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:49.416558 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1388/2768] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:58:49 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:58:49.420787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b571c-e3e4-410e-8c3c-a40aea8bb577 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:49.431600 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b571c-e3e4-410e-8c3c-a40aea8bb577 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:49.488930 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576087e8-788a-4c23-8b28-16b1b4b5f861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:49.489592 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576087e8-788a-4c23-8b28-16b1b4b5f861 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:49.489868 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576087e8-788a-4c23-8b28-16b1b4b5f861 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:49.490163 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576087e8-788a-4c23-8b28-16b1b4b5f861 admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:49.490850 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576087e8-788a-4c23-8b28-16b1b4b5f861 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:49.492774 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576087e8-788a-4c23-8b28-16b1b4b5f861 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:49.516950 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1381/2769] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:58:49 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:58:49.519791 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a9211-99cf-4531-bca7-a016924c70ea admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:49.530764 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a9211-99cf-4531-bca7-a016924c70ea admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:49.535478 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4ebe3-c387-4a68-8165-edbbc8757824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:49.536078 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4ebe3-c387-4a68-8165-edbbc8757824 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:49.536353 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4ebe3-c387-4a68-8165-edbbc8757824 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:49.536620 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4ebe3-c387-4a68-8165-edbbc8757824 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:49.537335 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4ebe3-c387-4a68-8165-edbbc8757824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:49.538978 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4ebe3-c387-4a68-8165-edbbc8757824 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:49.549317 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1389/2770] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:58:49.553426 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576087e8-788a-4c23-8b28-16b1b4b5f861 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:49.563602 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576087e8-788a-4c23-8b28-16b1b4b5f861 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:49.568584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04397ca-10ae-44d2-a123-48d0e1e261fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:49.569232 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04397ca-10ae-44d2-a123-48d0e1e261fe admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:49.569508 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04397ca-10ae-44d2-a123-48d0e1e261fe admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:49.569775 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04397ca-10ae-44d2-a123-48d0e1e261fe admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:49.570514 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04397ca-10ae-44d2-a123-48d0e1e261fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:49.572106 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04397ca-10ae-44d2-a123-48d0e1e261fe admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:49.582563 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1382/2771] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:58:49.587298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4ebe3-c387-4a68-8165-edbbc8757824 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:49.601557 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4ebe3-c387-4a68-8165-edbbc8757824 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:49.610364 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48af9a5-b276-46b7-8b5a-b56032b49309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:49.611561 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48af9a5-b276-46b7-8b5a-b56032b49309 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:49.611930 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48af9a5-b276-46b7-8b5a-b56032b49309 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:49.612261 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48af9a5-b276-46b7-8b5a-b56032b49309 admin admin] PATH_INFO: `/v3/projects/bf59a5f57a76499ab3a0e43dd300c26c/users/7d00f974dffa417e905e4706646aea71/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:49.632893 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48af9a5-b276-46b7-8b5a-b56032b49309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf59a5f57a76499ab3a0e43dd300c26c, user_id=7d00f974dffa417e905e4706646aea71, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:49.635633 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48af9a5-b276-46b7-8b5a-b56032b49309 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:49.656233 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1390/2772] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:58:49 2022] PUT /identity/v3/projects/bf59a5f57a76499ab3a0e43dd300c26c/users/7d00f974dffa417e905e4706646aea71/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:58:49.667761 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cde774-af32-478a-9722-2f21fb037f5e None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:49.668048 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cde774-af32-478a-9722-2f21fb037f5e None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:49.668325 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cde774-af32-478a-9722-2f21fb037f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:49.696031 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-79cde774-af32-478a-9722-2f21fb037f5e None None] MFA Rules not processed for user `7d00f974dffa417e905e4706646aea71`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:58:49.697247 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-79cde774-af32-478a-9722-2f21fb037f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:58:49.760510 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1383/2773] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:58:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:58:49.765104 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48af9a5-b276-46b7-8b5a-b56032b49309 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:49.829318 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48af9a5-b276-46b7-8b5a-b56032b49309 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:49.835100 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896bf2b7-e38b-4488-b418-10ba187bfc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:49.835756 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896bf2b7-e38b-4488-b418-10ba187bfc49 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:49.836032 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896bf2b7-e38b-4488-b418-10ba187bfc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:49.836303 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896bf2b7-e38b-4488-b418-10ba187bfc49 admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:49.836996 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896bf2b7-e38b-4488-b418-10ba187bfc49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:49.838940 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896bf2b7-e38b-4488-b418-10ba187bfc49 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:49.867870 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1391/2774] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:58:49 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:58:49.871897 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cde774-af32-478a-9722-2f21fb037f5e None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:49.882587 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cde774-af32-478a-9722-2f21fb037f5e None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:49.942578 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537739ca-93b3-4a6e-a546-b64d5a1b9d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:49.943251 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537739ca-93b3-4a6e-a546-b64d5a1b9d6a admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:49.943533 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537739ca-93b3-4a6e-a546-b64d5a1b9d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:49.943806 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537739ca-93b3-4a6e-a546-b64d5a1b9d6a admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:49.944491 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537739ca-93b3-4a6e-a546-b64d5a1b9d6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:49.946463 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537739ca-93b3-4a6e-a546-b64d5a1b9d6a admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:49.954211 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:58:49.968100 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1384/2775] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:58:49 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:58:49.973636 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896bf2b7-e38b-4488-b418-10ba187bfc49 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:49.985033 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896bf2b7-e38b-4488-b418-10ba187bfc49 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:49.989664 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90574b6-4217-4359-8a9b-2dcc64857707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:49.990399 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90574b6-4217-4359-8a9b-2dcc64857707 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:49.990678 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90574b6-4217-4359-8a9b-2dcc64857707 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:49.990953 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90574b6-4217-4359-8a9b-2dcc64857707 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:49.991675 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90574b6-4217-4359-8a9b-2dcc64857707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:49.993279 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90574b6-4217-4359-8a9b-2dcc64857707 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:50.004040 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1392/2776] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:58:50.008714 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537739ca-93b3-4a6e-a546-b64d5a1b9d6a admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:50.022993 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537739ca-93b3-4a6e-a546-b64d5a1b9d6a admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:50.031866 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93680dd2-3892-4501-b9c1-c279f9821405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:50.032784 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93680dd2-3892-4501-b9c1-c279f9821405 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:50.033066 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93680dd2-3892-4501-b9c1-c279f9821405 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:50.033344 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93680dd2-3892-4501-b9c1-c279f9821405 admin admin] PATH_INFO: `/v3/projects/ac64d9959a8f4b55b909f77c55f50d0c/users/ef78b68808044cb5aa8663f60bb9847a/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:50.054085 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93680dd2-3892-4501-b9c1-c279f9821405 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac64d9959a8f4b55b909f77c55f50d0c, user_id=ef78b68808044cb5aa8663f60bb9847a, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:50.056881 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93680dd2-3892-4501-b9c1-c279f9821405 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:50.079597 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1385/2777] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:58:50 2022] PUT /identity/v3/projects/ac64d9959a8f4b55b909f77c55f50d0c/users/ef78b68808044cb5aa8663f60bb9847a/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:58:50.083876 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90574b6-4217-4359-8a9b-2dcc64857707 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:50.094787 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90574b6-4217-4359-8a9b-2dcc64857707 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:50.142107 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:58:50.157534 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923aab6-221b-4c69-aa15-db08a07e04d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:50.158298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923aab6-221b-4c69-aa15-db08a07e04d2 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:50.158574 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923aab6-221b-4c69-aa15-db08a07e04d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:50.158846 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923aab6-221b-4c69-aa15-db08a07e04d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:50.159575 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2923aab6-221b-4c69-aa15-db08a07e04d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:50.161176 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2923aab6-221b-4c69-aa15-db08a07e04d2 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:50.171657 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1393/2778] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:58:50.175678 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93680dd2-3892-4501-b9c1-c279f9821405 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:50.186643 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93680dd2-3892-4501-b9c1-c279f9821405 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:50.192385 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72251ae-f211-4204-b162-acde93faff1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:50.193280 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72251ae-f211-4204-b162-acde93faff1d admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:50.193557 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72251ae-f211-4204-b162-acde93faff1d admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:50.193834 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72251ae-f211-4204-b162-acde93faff1d admin admin] PATH_INFO: `/v3/projects/ac64d9959a8f4b55b909f77c55f50d0c/users/ef78b68808044cb5aa8663f60bb9847a/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:50.195950 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72251ae-f211-4204-b162-acde93faff1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac64d9959a8f4b55b909f77c55f50d0c, user_id=ef78b68808044cb5aa8663f60bb9847a, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:50.198673 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72251ae-f211-4204-b162-acde93faff1d admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:50.208978 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1386/2779] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:58:50 2022] PUT /identity/v3/projects/ac64d9959a8f4b55b909f77c55f50d0c/users/ef78b68808044cb5aa8663f60bb9847a/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:58:50.218937 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec230c-1bb6-4425-b66c-fb0f82a74beb None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:50.219228 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec230c-1bb6-4425-b66c-fb0f82a74beb None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:50.219507 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec230c-1bb6-4425-b66c-fb0f82a74beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:50.248708 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-efec230c-1bb6-4425-b66c-fb0f82a74beb None None] MFA Rules not processed for user `ef78b68808044cb5aa8663f60bb9847a`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:58:50.250058 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-efec230c-1bb6-4425-b66c-fb0f82a74beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:58:50.330048 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1394/2780] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:58:50 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:58:50.341446 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72251ae-f211-4204-b162-acde93faff1d admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:50.343383 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-e72251ae-f211-4204-b162-acde93faff1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:58:50.402534 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72251ae-f211-4204-b162-acde93faff1d admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:50.406623 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae389ea0-09d1-49e4-a824-f31734ecfdd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:50.407250 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae389ea0-09d1-49e4-a824-f31734ecfdd1 service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:50.407530 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae389ea0-09d1-49e4-a824-f31734ecfdd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:50.407803 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae389ea0-09d1-49e4-a824-f31734ecfdd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:50.417279 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae389ea0-09d1-49e4-a824-f31734ecfdd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:50.418746 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae389ea0-09d1-49e4-a824-f31734ecfdd1 service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:50.428776 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1387/2781] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:58:50 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:58:50.829286 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec230c-1bb6-4425-b66c-fb0f82a74beb None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:50.897777 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec230c-1bb6-4425-b66c-fb0f82a74beb None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:50.903208 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9553b-aefe-4d7f-b690-a48294150be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:50.904090 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9553b-aefe-4d7f-b690-a48294150be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:50.904366 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9553b-aefe-4d7f-b690-a48294150be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:50.904645 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9553b-aefe-4d7f-b690-a48294150be2 admin admin] PATH_INFO: `/v3/users/7d00f974dffa417e905e4706646aea71` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:50.905872 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9553b-aefe-4d7f-b690-a48294150be2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d00f974dffa417e905e4706646aea71)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:50.907906 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9553b-aefe-4d7f-b690-a48294150be2 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:50.959045 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-0ab9553b-aefe-4d7f-b690-a48294150be2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d00f974dffa417e905e4706646aea71'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:50.971005 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-0ab9553b-aefe-4d7f-b690-a48294150be2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d00f974dffa417e905e4706646aea71'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:50.976249 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:58:50.978375 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-0ab9553b-aefe-4d7f-b690-a48294150be2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d00f974dffa417e905e4706646aea71'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:50.979195 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-0ab9553b-aefe-4d7f-b690-a48294150be2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d00f974dffa417e905e4706646aea71'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:50.979923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-0ab9553b-aefe-4d7f-b690-a48294150be2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d00f974dffa417e905e4706646aea71'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:50.994278 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1395/2782] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:58:50 2022] DELETE /identity/v3/users/7d00f974dffa417e905e4706646aea71 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:58:50.999001 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b307c7-3d10-4875-96bb-55e2a6eb15d8 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:50.999293 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b307c7-3d10-4875-96bb-55e2a6eb15d8 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:50.999574 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b307c7-3d10-4875-96bb-55e2a6eb15d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:51.017221 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-c9b307c7-3d10-4875-96bb-55e2a6eb15d8 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:58:51.018451 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-c9b307c7-3d10-4875-96bb-55e2a6eb15d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:58:51.088316 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1388/2783] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:58:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:58:51.098288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9553b-aefe-4d7f-b690-a48294150be2 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:51.099976 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-0ab9553b-aefe-4d7f-b690-a48294150be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:58:51.162760 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9553b-aefe-4d7f-b690-a48294150be2 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:51.166578 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a1194-4342-4682-8afd-44dfac2b49bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:51.167235 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a1194-4342-4682-8afd-44dfac2b49bf service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:51.167521 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a1194-4342-4682-8afd-44dfac2b49bf service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:51.167798 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a1194-4342-4682-8afd-44dfac2b49bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:51.177354 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a1194-4342-4682-8afd-44dfac2b49bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:51.178857 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a1194-4342-4682-8afd-44dfac2b49bf service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:51.188978 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1396/2784] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:58:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:58:51.462560 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b307c7-3d10-4875-96bb-55e2a6eb15d8 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:51.464149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-c9b307c7-3d10-4875-96bb-55e2a6eb15d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:58:51.477076 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b307c7-3d10-4875-96bb-55e2a6eb15d8 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:51.483154 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a59e94-b527-4339-8405-8aa19f8c25ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:51.484240 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a59e94-b527-4339-8405-8aa19f8c25ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:51.484606 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a59e94-b527-4339-8405-8aa19f8c25ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:51.484796 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a59e94-b527-4339-8405-8aa19f8c25ba admin admin] PATH_INFO: `/v3/projects/bf59a5f57a76499ab3a0e43dd300c26c` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:51.486231 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a59e94-b527-4339-8405-8aa19f8c25ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf59a5f57a76499ab3a0e43dd300c26c)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:51.488107 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a59e94-b527-4339-8405-8aa19f8c25ba admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:51.537406 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-e5a59e94-b527-4339-8405-8aa19f8c25ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf59a5f57a76499ab3a0e43dd300c26c', 'request_id': 'req-e5a59e94-b527-4339-8405-8aa19f8c25ba'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:51.539451 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:INSERT=4,keystone:SELECT=91,keystone:DELETE=5 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:58:51.544996 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-e5a59e94-b527-4339-8405-8aa19f8c25ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf59a5f57a76499ab3a0e43dd300c26c', 'request_id': 'req-e5a59e94-b527-4339-8405-8aa19f8c25ba'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:51.555125 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-e5a59e94-b527-4339-8405-8aa19f8c25ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf59a5f57a76499ab3a0e43dd300c26c', 'request_id': 'req-e5a59e94-b527-4339-8405-8aa19f8c25ba'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:51.566499 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-e5a59e94-b527-4339-8405-8aa19f8c25ba admin admin] The token cache is being invalidate because project bf59a5f57a76499ab3a0e43dd300c26c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:58:51.566786 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-e5a59e94-b527-4339-8405-8aa19f8c25ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:51.567432 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-e5a59e94-b527-4339-8405-8aa19f8c25ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:51.569153 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1389/2785] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:58:51 2022] DELETE /identity/v3/projects/bf59a5f57a76499ab3a0e43dd300c26c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:58:51.573392 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a1194-4342-4682-8afd-44dfac2b49bf service neutron] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:51.584891 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a1194-4342-4682-8afd-44dfac2b49bf service neutron] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:51.645796 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc881fd-94d5-49ad-be94-44e52ff910b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:51.646698 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc881fd-94d5-49ad-be94-44e52ff910b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:51.646985 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc881fd-94d5-49ad-be94-44e52ff910b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:51.647260 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc881fd-94d5-49ad-be94-44e52ff910b2 admin admin] PATH_INFO: `/v3/users/ef78b68808044cb5aa8663f60bb9847a` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:51.648490 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc881fd-94d5-49ad-be94-44e52ff910b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef78b68808044cb5aa8663f60bb9847a)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:51.650844 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc881fd-94d5-49ad-be94-44e52ff910b2 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:51.700956 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-2fc881fd-94d5-49ad-be94-44e52ff910b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef78b68808044cb5aa8663f60bb9847a'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:51.713011 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-2fc881fd-94d5-49ad-be94-44e52ff910b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef78b68808044cb5aa8663f60bb9847a'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:51.719975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-2fc881fd-94d5-49ad-be94-44e52ff910b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef78b68808044cb5aa8663f60bb9847a'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:51.720630 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-2fc881fd-94d5-49ad-be94-44e52ff910b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef78b68808044cb5aa8663f60bb9847a'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:51.721227 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-2fc881fd-94d5-49ad-be94-44e52ff910b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef78b68808044cb5aa8663f60bb9847a'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:51.739170 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1397/2786] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:58:51 2022] DELETE /identity/v3/users/ef78b68808044cb5aa8663f60bb9847a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:58:52.032110 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a59e94-b527-4339-8405-8aa19f8c25ba admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:52.033736 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-e5a59e94-b527-4339-8405-8aa19f8c25ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:58:52.048019 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a59e94-b527-4339-8405-8aa19f8c25ba admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:52.110781 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98cb01b-c19e-4092-a541-13111fd7900a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:52.111643 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98cb01b-c19e-4092-a541-13111fd7900a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:52.111920 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98cb01b-c19e-4092-a541-13111fd7900a admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:52.112200 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98cb01b-c19e-4092-a541-13111fd7900a admin admin] PATH_INFO: `/v3/projects/ac64d9959a8f4b55b909f77c55f50d0c` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:52.113401 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98cb01b-c19e-4092-a541-13111fd7900a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac64d9959a8f4b55b909f77c55f50d0c)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:52.115387 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98cb01b-c19e-4092-a541-13111fd7900a admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:52.167821 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c98cb01b-c19e-4092-a541-13111fd7900a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac64d9959a8f4b55b909f77c55f50d0c', 'request_id': 'req-c98cb01b-c19e-4092-a541-13111fd7900a'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:52.173529 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c98cb01b-c19e-4092-a541-13111fd7900a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac64d9959a8f4b55b909f77c55f50d0c', 'request_id': 'req-c98cb01b-c19e-4092-a541-13111fd7900a'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:52.181979 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c98cb01b-c19e-4092-a541-13111fd7900a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac64d9959a8f4b55b909f77c55f50d0c', 'request_id': 'req-c98cb01b-c19e-4092-a541-13111fd7900a'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:52.199120 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c98cb01b-c19e-4092-a541-13111fd7900a admin admin] The token cache is being invalidate because project ac64d9959a8f4b55b909f77c55f50d0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:58:52.199545 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c98cb01b-c19e-4092-a541-13111fd7900a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:52.200617 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-c98cb01b-c19e-4092-a541-13111fd7900a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:52.203108 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1390/2787] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:58:52 2022] DELETE /identity/v3/projects/ac64d9959a8f4b55b909f77c55f50d0c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:58:52.208384 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7442f-e441-453a-a0de-dc5afafc2ca9 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:52.208886 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7442f-e441-453a-a0de-dc5afafc2ca9 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:52.209001 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7442f-e441-453a-a0de-dc5afafc2ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:52.227661 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-52f7442f-e441-453a-a0de-dc5afafc2ca9 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:58:52.228831 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-52f7442f-e441-453a-a0de-dc5afafc2ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:58:52.235091 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:58:52.290120 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1398/2788] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:58:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:58:52.299691 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198722c-5a94-4356-8012-76562330edd2 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:52.300068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198722c-5a94-4356-8012-76562330edd2 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:52.300249 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198722c-5a94-4356-8012-76562330edd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:52.322774 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-c198722c-5a94-4356-8012-76562330edd2 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:58:52.324148 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-c198722c-5a94-4356-8012-76562330edd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:58:52.332521 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1391/2789] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:58:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:58:52.336977 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7442f-e441-453a-a0de-dc5afafc2ca9 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:52.347286 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7442f-e441-453a-a0de-dc5afafc2ca9 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:52.352536 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22624609-395b-4da1-a031-0046677754c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:52.353209 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22624609-395b-4da1-a031-0046677754c4 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:52.353473 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22624609-395b-4da1-a031-0046677754c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:52.353795 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22624609-395b-4da1-a031-0046677754c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:52.354555 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22624609-395b-4da1-a031-0046677754c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:58:52.354862 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22624609-395b-4da1-a031-0046677754c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:52.356475 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22624609-395b-4da1-a031-0046677754c4 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:52.368564 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1399/2790] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:58:52.372753 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198722c-5a94-4356-8012-76562330edd2 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:52.383071 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198722c-5a94-4356-8012-76562330edd2 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:52.388753 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a24e2-7498-4fd2-b629-6ef50f8e4a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:52.389416 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a24e2-7498-4fd2-b629-6ef50f8e4a38 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:52.389697 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a24e2-7498-4fd2-b629-6ef50f8e4a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:52.389997 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a24e2-7498-4fd2-b629-6ef50f8e4a38 admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:52.390739 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a24e2-7498-4fd2-b629-6ef50f8e4a38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:52.392653 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a24e2-7498-4fd2-b629-6ef50f8e4a38 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:52.422720 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1392/2791] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:58:52 2022] POST /identity/v3/projects => generated 407 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:58:52.427014 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22624609-395b-4da1-a031-0046677754c4 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:52.437117 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22624609-395b-4da1-a031-0046677754c4 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:52.496533 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c9e4c-a82a-4633-bbe5-b7b65431ec01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:52.497369 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c9e4c-a82a-4633-bbe5-b7b65431ec01 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:52.497740 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c9e4c-a82a-4633-bbe5-b7b65431ec01 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:52.498169 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c9e4c-a82a-4633-bbe5-b7b65431ec01 admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:52.499026 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c9e4c-a82a-4633-bbe5-b7b65431ec01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:52.501205 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c9e4c-a82a-4633-bbe5-b7b65431ec01 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:52.524656 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1400/2792] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:58:52 2022] POST /identity/v3/users => generated 304 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:58:52.528844 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a24e2-7498-4fd2-b629-6ef50f8e4a38 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:52.539450 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a24e2-7498-4fd2-b629-6ef50f8e4a38 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:52.544790 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1e43a-b04f-44c4-8fb3-0fe09b55aaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:52.545449 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1e43a-b04f-44c4-8fb3-0fe09b55aaab admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:52.545877 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1e43a-b04f-44c4-8fb3-0fe09b55aaab admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:52.546163 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1e43a-b04f-44c4-8fb3-0fe09b55aaab admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:52.546896 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db1e43a-b04f-44c4-8fb3-0fe09b55aaab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:52.548520 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db1e43a-b04f-44c4-8fb3-0fe09b55aaab admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:52.559493 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1393/2793] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:58:52.564140 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c9e4c-a82a-4633-bbe5-b7b65431ec01 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:52.579203 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c9e4c-a82a-4633-bbe5-b7b65431ec01 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:52.587260 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c39b9-dc85-4987-87b5-47bd760b89da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:52.588178 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c39b9-dc85-4987-87b5-47bd760b89da admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:52.588530 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c39b9-dc85-4987-87b5-47bd760b89da admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:52.588889 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c39b9-dc85-4987-87b5-47bd760b89da admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:52.589961 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c39b9-dc85-4987-87b5-47bd760b89da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:52.592373 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c39b9-dc85-4987-87b5-47bd760b89da admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:52.606864 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1401/2794] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:58:52.611331 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1e43a-b04f-44c4-8fb3-0fe09b55aaab admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:52.623417 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1e43a-b04f-44c4-8fb3-0fe09b55aaab admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:52.629705 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031b82a-2905-4881-aa75-e6d86adf270e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:52.630629 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031b82a-2905-4881-aa75-e6d86adf270e admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:52.630908 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031b82a-2905-4881-aa75-e6d86adf270e admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:52.631182 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031b82a-2905-4881-aa75-e6d86adf270e admin admin] PATH_INFO: `/v3/projects/61a2627cb0ec4ede82124930012e6873/users/05e7396bcff54cfaad71e8b5ad1f8148/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:52.646703 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031b82a-2905-4881-aa75-e6d86adf270e admin admin] RBAC: Authorizing `identity:create_grant(project_id=61a2627cb0ec4ede82124930012e6873, user_id=05e7396bcff54cfaad71e8b5ad1f8148, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:52.649822 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031b82a-2905-4881-aa75-e6d86adf270e admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:52.665046 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1394/2795] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:58:52 2022] PUT /identity/v3/projects/61a2627cb0ec4ede82124930012e6873/users/05e7396bcff54cfaad71e8b5ad1f8148/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:58:52.675496 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fca80-69ac-4b5a-9785-8211456fb1a2 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:52.675784 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fca80-69ac-4b5a-9785-8211456fb1a2 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:52.676058 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fca80-69ac-4b5a-9785-8211456fb1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:52.702440 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-803fca80-69ac-4b5a-9785-8211456fb1a2 None None] MFA Rules not processed for user `05e7396bcff54cfaad71e8b5ad1f8148`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:58:52.703655 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-803fca80-69ac-4b5a-9785-8211456fb1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:58:52.770573 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1402/2796] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:58:52 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:58:52.775507 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031b82a-2905-4881-aa75-e6d86adf270e admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:52.785298 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:58:52.841247 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031b82a-2905-4881-aa75-e6d86adf270e admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:52.846573 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d37d6-fc02-4bc6-98b1-cbfb73863387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:52.847231 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d37d6-fc02-4bc6-98b1-cbfb73863387 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:52.847525 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d37d6-fc02-4bc6-98b1-cbfb73863387 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:52.847794 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d37d6-fc02-4bc6-98b1-cbfb73863387 admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:52.848480 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d37d6-fc02-4bc6-98b1-cbfb73863387 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:52.850479 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d37d6-fc02-4bc6-98b1-cbfb73863387 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:52.883123 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1395/2797] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:58:52 2022] POST /identity/v3/projects => generated 407 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:58:52.888702 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803fca80-69ac-4b5a-9785-8211456fb1a2 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:52.902348 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803fca80-69ac-4b5a-9785-8211456fb1a2 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:52.906637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:58:52.972333 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780c6ae-33aa-48a0-b533-c099f177a308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:52.972998 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780c6ae-33aa-48a0-b533-c099f177a308 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:52.973274 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780c6ae-33aa-48a0-b533-c099f177a308 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:52.973542 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780c6ae-33aa-48a0-b533-c099f177a308 admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:52.974270 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780c6ae-33aa-48a0-b533-c099f177a308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:52.976247 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780c6ae-33aa-48a0-b533-c099f177a308 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:53.000415 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1403/2798] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:58:52 2022] POST /identity/v3/users => generated 310 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:58:53.006854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d37d6-fc02-4bc6-98b1-cbfb73863387 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:53.020313 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d37d6-fc02-4bc6-98b1-cbfb73863387 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:53.026683 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c22a44-97a7-4a0e-91e5-bb277f86f610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:53.027307 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c22a44-97a7-4a0e-91e5-bb277f86f610 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:53.027603 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c22a44-97a7-4a0e-91e5-bb277f86f610 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:53.027874 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c22a44-97a7-4a0e-91e5-bb277f86f610 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:53.028602 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c22a44-97a7-4a0e-91e5-bb277f86f610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:53.030539 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c22a44-97a7-4a0e-91e5-bb277f86f610 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:53.041665 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1396/2799] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:58:53.045795 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780c6ae-33aa-48a0-b533-c099f177a308 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:53.056358 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780c6ae-33aa-48a0-b533-c099f177a308 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:53.061890 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc46c4-823c-4266-bc1e-63f027726d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:53.062783 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc46c4-823c-4266-bc1e-63f027726d7f admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:53.063059 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc46c4-823c-4266-bc1e-63f027726d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:53.063324 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc46c4-823c-4266-bc1e-63f027726d7f admin admin] PATH_INFO: `/v3/projects/421bacf1189944e991803f2510a980db/users/2e8ae792b1ec40b4bb1f078ad14a7ad0/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:53.080087 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc46c4-823c-4266-bc1e-63f027726d7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=421bacf1189944e991803f2510a980db, user_id=2e8ae792b1ec40b4bb1f078ad14a7ad0, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:53.083538 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc46c4-823c-4266-bc1e-63f027726d7f admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:53.097774 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1404/2800] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:58:53 2022] PUT /identity/v3/projects/421bacf1189944e991803f2510a980db/users/2e8ae792b1ec40b4bb1f078ad14a7ad0/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:58:53.101798 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c22a44-97a7-4a0e-91e5-bb277f86f610 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:53.115065 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c22a44-97a7-4a0e-91e5-bb277f86f610 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:53.176150 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84de844-5fea-4e21-b76a-5a62b1719277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:53.176854 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84de844-5fea-4e21-b76a-5a62b1719277 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:53.177112 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84de844-5fea-4e21-b76a-5a62b1719277 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:53.177387 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84de844-5fea-4e21-b76a-5a62b1719277 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:53.178156 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84de844-5fea-4e21-b76a-5a62b1719277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:53.179778 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84de844-5fea-4e21-b76a-5a62b1719277 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:53.189604 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1397/2801] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:58:53.194106 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc46c4-823c-4266-bc1e-63f027726d7f admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:53.204621 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc46c4-823c-4266-bc1e-63f027726d7f admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:53.209654 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ec385-97a8-4af8-8c26-5983f09cb05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:53.210561 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ec385-97a8-4af8-8c26-5983f09cb05a admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:53.210847 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ec385-97a8-4af8-8c26-5983f09cb05a admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:53.211113 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ec385-97a8-4af8-8c26-5983f09cb05a admin admin] PATH_INFO: `/v3/projects/421bacf1189944e991803f2510a980db/users/2e8ae792b1ec40b4bb1f078ad14a7ad0/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:53.213116 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ec385-97a8-4af8-8c26-5983f09cb05a admin admin] RBAC: Authorizing `identity:create_grant(project_id=421bacf1189944e991803f2510a980db, user_id=2e8ae792b1ec40b4bb1f078ad14a7ad0, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:53.215795 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ec385-97a8-4af8-8c26-5983f09cb05a admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:53.226496 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1405/2802] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:58:53 2022] PUT /identity/v3/projects/421bacf1189944e991803f2510a980db/users/2e8ae792b1ec40b4bb1f078ad14a7ad0/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:58:53.236571 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03c06f-7dde-4399-857b-777dc59bdc94 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:53.236888 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03c06f-7dde-4399-857b-777dc59bdc94 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:53.237172 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03c06f-7dde-4399-857b-777dc59bdc94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:53.264347 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-fa03c06f-7dde-4399-857b-777dc59bdc94 None None] MFA Rules not processed for user `2e8ae792b1ec40b4bb1f078ad14a7ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:58:53.265566 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-fa03c06f-7dde-4399-857b-777dc59bdc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:58:53.338169 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1398/2803] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:58:53 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:58:53.348977 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ec385-97a8-4af8-8c26-5983f09cb05a admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:53.350934 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-162ec385-97a8-4af8-8c26-5983f09cb05a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:58:53.419525 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ec385-97a8-4af8-8c26-5983f09cb05a admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:53.426666 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9a500-d56a-4bf0-8124-3b655600d11e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:53.427545 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9a500-d56a-4bf0-8124-3b655600d11e service cinder] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:53.427838 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9a500-d56a-4bf0-8124-3b655600d11e service cinder] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:53.428193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9a500-d56a-4bf0-8124-3b655600d11e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:53.444200 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9a500-d56a-4bf0-8124-3b655600d11e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:53.444200 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9a500-d56a-4bf0-8124-3b655600d11e service cinder] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:53.453471 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1406/2804] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:58:53 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:58:53.619098 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03c06f-7dde-4399-857b-777dc59bdc94 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:53.623975 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:58:53.630266 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03c06f-7dde-4399-857b-777dc59bdc94 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:53.634638 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f026576-09f1-4d16-8c8b-a8e0b19a89de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:53.635289 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f026576-09f1-4d16-8c8b-a8e0b19a89de service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:53.635570 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f026576-09f1-4d16-8c8b-a8e0b19a89de service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:53.635848 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f026576-09f1-4d16-8c8b-a8e0b19a89de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:53.696686 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f026576-09f1-4d16-8c8b-a8e0b19a89de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:53.698174 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f026576-09f1-4d16-8c8b-a8e0b19a89de service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:53.707284 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1399/2805] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:58:53 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:58:59.055264 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9a500-d56a-4bf0-8124-3b655600d11e service cinder] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:59.127375 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9a500-d56a-4bf0-8124-3b655600d11e service cinder] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:59.132088 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a47ba-25ea-468e-b8eb-ef117038fbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:59.132986 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a47ba-25ea-468e-b8eb-ef117038fbe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:59.133268 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a47ba-25ea-468e-b8eb-ef117038fbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:59.133538 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a47ba-25ea-468e-b8eb-ef117038fbe5 admin admin] PATH_INFO: `/v3/users/05e7396bcff54cfaad71e8b5ad1f8148` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:59.134747 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a47ba-25ea-468e-b8eb-ef117038fbe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05e7396bcff54cfaad71e8b5ad1f8148)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:59.136717 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a47ba-25ea-468e-b8eb-ef117038fbe5 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:59.139257 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:58:59.191387 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-d93a47ba-25ea-468e-b8eb-ef117038fbe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05e7396bcff54cfaad71e8b5ad1f8148'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:59.203442 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-d93a47ba-25ea-468e-b8eb-ef117038fbe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05e7396bcff54cfaad71e8b5ad1f8148'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:59.211482 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-d93a47ba-25ea-468e-b8eb-ef117038fbe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05e7396bcff54cfaad71e8b5ad1f8148'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:59.212292 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-d93a47ba-25ea-468e-b8eb-ef117038fbe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05e7396bcff54cfaad71e8b5ad1f8148'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:59.213008 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-d93a47ba-25ea-468e-b8eb-ef117038fbe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05e7396bcff54cfaad71e8b5ad1f8148'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:59.231020 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1407/2806] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:58:59 2022] DELETE /identity/v3/users/05e7396bcff54cfaad71e8b5ad1f8148 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:58:59.236169 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48069436-209e-494e-86f8-dc121f1e5635 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:59.236667 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48069436-209e-494e-86f8-dc121f1e5635 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:59.236781 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48069436-209e-494e-86f8-dc121f1e5635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:59.256013 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-48069436-209e-494e-86f8-dc121f1e5635 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:58:59.257292 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-48069436-209e-494e-86f8-dc121f1e5635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:58:59.326103 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1400/2807] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:58:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:58:59.335994 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a47ba-25ea-468e-b8eb-ef117038fbe5 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:59.337536 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-d93a47ba-25ea-468e-b8eb-ef117038fbe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:58:59.398027 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a47ba-25ea-468e-b8eb-ef117038fbe5 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:59.402642 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba1708-c7ba-4e0b-a8a2-d9f38307f27a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:59.403323 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba1708-c7ba-4e0b-a8a2-d9f38307f27a service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:59.403587 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba1708-c7ba-4e0b-a8a2-d9f38307f27a service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:59.403861 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba1708-c7ba-4e0b-a8a2-d9f38307f27a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:59.413650 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba1708-c7ba-4e0b-a8a2-d9f38307f27a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:59.415074 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba1708-c7ba-4e0b-a8a2-d9f38307f27a service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:59.425038 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1408/2808] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:58:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:58:59.693866 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48069436-209e-494e-86f8-dc121f1e5635 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:59.695564 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-48069436-209e-494e-86f8-dc121f1e5635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:58:59.711368 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48069436-209e-494e-86f8-dc121f1e5635 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:59.716827 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ce349-13f4-4d4e-b2f7-16b699bb09e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:59.717688 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ce349-13f4-4d4e-b2f7-16b699bb09e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:59.718004 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ce349-13f4-4d4e-b2f7-16b699bb09e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:59.718283 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ce349-13f4-4d4e-b2f7-16b699bb09e3 admin admin] PATH_INFO: `/v3/projects/61a2627cb0ec4ede82124930012e6873` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:59.719572 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ce349-13f4-4d4e-b2f7-16b699bb09e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61a2627cb0ec4ede82124930012e6873)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:59.721528 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ce349-13f4-4d4e-b2f7-16b699bb09e3 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:59.769238 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-896ce349-13f4-4d4e-b2f7-16b699bb09e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61a2627cb0ec4ede82124930012e6873', 'request_id': 'req-896ce349-13f4-4d4e-b2f7-16b699bb09e3'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:59.776169 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-896ce349-13f4-4d4e-b2f7-16b699bb09e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61a2627cb0ec4ede82124930012e6873', 'request_id': 'req-896ce349-13f4-4d4e-b2f7-16b699bb09e3'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:59.788355 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-896ce349-13f4-4d4e-b2f7-16b699bb09e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61a2627cb0ec4ede82124930012e6873', 'request_id': 'req-896ce349-13f4-4d4e-b2f7-16b699bb09e3'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:59.799429 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-896ce349-13f4-4d4e-b2f7-16b699bb09e3 admin admin] The token cache is being invalidate because project 61a2627cb0ec4ede82124930012e6873 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:58:59.799717 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-896ce349-13f4-4d4e-b2f7-16b699bb09e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:59.800354 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-896ce349-13f4-4d4e-b2f7-16b699bb09e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:59.801930 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1401/2809] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:58:59 2022] DELETE /identity/v3/projects/61a2627cb0ec4ede82124930012e6873 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:58:59.806017 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba1708-c7ba-4e0b-a8a2-d9f38307f27a service neutron] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:58:59.815868 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba1708-c7ba-4e0b-a8a2-d9f38307f27a service neutron] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:58:59.873562 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9b4d7-789a-494c-bbe1-6d52409fefd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:58:59.874470 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9b4d7-789a-494c-bbe1-6d52409fefd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:58:59.874743 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9b4d7-789a-494c-bbe1-6d52409fefd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:58:59.875010 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9b4d7-789a-494c-bbe1-6d52409fefd8 admin admin] PATH_INFO: `/v3/users/2e8ae792b1ec40b4bb1f078ad14a7ad0` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:58:59.876220 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9b4d7-789a-494c-bbe1-6d52409fefd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e8ae792b1ec40b4bb1f078ad14a7ad0)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:58:59.878173 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9b4d7-789a-494c-bbe1-6d52409fefd8 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:58:59.907009 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:58:59.927676 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-36f9b4d7-789a-494c-bbe1-6d52409fefd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e8ae792b1ec40b4bb1f078ad14a7ad0'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:59.939731 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-36f9b4d7-789a-494c-bbe1-6d52409fefd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e8ae792b1ec40b4bb1f078ad14a7ad0'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:59.946973 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-36f9b4d7-789a-494c-bbe1-6d52409fefd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e8ae792b1ec40b4bb1f078ad14a7ad0'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:59.947646 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-36f9b4d7-789a-494c-bbe1-6d52409fefd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e8ae792b1ec40b4bb1f078ad14a7ad0'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:59.948259 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-36f9b4d7-789a-494c-bbe1-6d52409fefd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e8ae792b1ec40b4bb1f078ad14a7ad0'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:58:59.961627 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1409/2810] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:58:59 2022] DELETE /identity/v3/users/2e8ae792b1ec40b4bb1f078ad14a7ad0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:59:00.240425 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ce349-13f4-4d4e-b2f7-16b699bb09e3 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:00.242007 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-896ce349-13f4-4d4e-b2f7-16b699bb09e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:00.257353 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ce349-13f4-4d4e-b2f7-16b699bb09e3 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:00.280259 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:00.319156 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0162bf-53ca-4215-8e5d-c9359936c9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:00.320020 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0162bf-53ca-4215-8e5d-c9359936c9f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:00.320300 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0162bf-53ca-4215-8e5d-c9359936c9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:00.320568 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0162bf-53ca-4215-8e5d-c9359936c9f7 admin admin] PATH_INFO: `/v3/projects/421bacf1189944e991803f2510a980db` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:00.321736 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0162bf-53ca-4215-8e5d-c9359936c9f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=421bacf1189944e991803f2510a980db)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:00.323690 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0162bf-53ca-4215-8e5d-c9359936c9f7 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:00.372456 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-dd0162bf-53ca-4215-8e5d-c9359936c9f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '421bacf1189944e991803f2510a980db', 'request_id': 'req-dd0162bf-53ca-4215-8e5d-c9359936c9f7'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:00.378107 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-dd0162bf-53ca-4215-8e5d-c9359936c9f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '421bacf1189944e991803f2510a980db', 'request_id': 'req-dd0162bf-53ca-4215-8e5d-c9359936c9f7'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:00.386060 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-dd0162bf-53ca-4215-8e5d-c9359936c9f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '421bacf1189944e991803f2510a980db', 'request_id': 'req-dd0162bf-53ca-4215-8e5d-c9359936c9f7'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:00.397935 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-dd0162bf-53ca-4215-8e5d-c9359936c9f7 admin admin] The token cache is being invalidate because project 421bacf1189944e991803f2510a980db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:59:00.398225 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-dd0162bf-53ca-4215-8e5d-c9359936c9f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:00.398933 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-dd0162bf-53ca-4215-8e5d-c9359936c9f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:00.400968 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1402/2811] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:59:00 2022] DELETE /identity/v3/projects/421bacf1189944e991803f2510a980db => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:59:00.407225 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9664d-3707-4710-ac50-688587355f7e None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:00.407744 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9664d-3707-4710-ac50-688587355f7e None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:00.407744 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9664d-3707-4710-ac50-688587355f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:00.426394 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-e5c9664d-3707-4710-ac50-688587355f7e None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:59:00.427547 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-e5c9664d-3707-4710-ac50-688587355f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:00.489792 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1410/2812] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:59:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:59:00.553029 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca6e12-d737-4d8c-8537-e6d0ec2c92b8 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:00.553311 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca6e12-d737-4d8c-8537-e6d0ec2c92b8 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:00.553593 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca6e12-d737-4d8c-8537-e6d0ec2c92b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:00.574512 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-30ca6e12-d737-4d8c-8537-e6d0ec2c92b8 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:59:00.575735 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-30ca6e12-d737-4d8c-8537-e6d0ec2c92b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:00.585689 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1403/2813] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:59:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:59:00.590716 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9664d-3707-4710-ac50-688587355f7e None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:00.604407 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9664d-3707-4710-ac50-688587355f7e None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:00.610739 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0b979-1e76-4f44-9c47-8cfb7a0178a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:00.611401 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0b979-1e76-4f44-9c47-8cfb7a0178a8 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:00.611673 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0b979-1e76-4f44-9c47-8cfb7a0178a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:00.611940 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0b979-1e76-4f44-9c47-8cfb7a0178a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:00.612669 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf0b979-1e76-4f44-9c47-8cfb7a0178a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:59:00.612971 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf0b979-1e76-4f44-9c47-8cfb7a0178a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:00.614627 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf0b979-1e76-4f44-9c47-8cfb7a0178a8 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:00.628006 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1411/2814] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:59:00.636571 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca6e12-d737-4d8c-8537-e6d0ec2c92b8 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:00.652215 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca6e12-d737-4d8c-8537-e6d0ec2c92b8 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:00.661560 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e30826-eeba-432b-981e-4da8b9d8e59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:00.662679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e30826-eeba-432b-981e-4da8b9d8e59a admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:00.663108 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e30826-eeba-432b-981e-4da8b9d8e59a admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:00.663376 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e30826-eeba-432b-981e-4da8b9d8e59a admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:00.664058 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e30826-eeba-432b-981e-4da8b9d8e59a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:00.666048 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e30826-eeba-432b-981e-4da8b9d8e59a admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:00.695249 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1404/2815] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:59:00 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:59:00.699684 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0b979-1e76-4f44-9c47-8cfb7a0178a8 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:00.711454 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0b979-1e76-4f44-9c47-8cfb7a0178a8 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:00.777868 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5dbba-6c42-4268-a21f-ef48e327adc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:00.778773 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5dbba-6c42-4268-a21f-ef48e327adc5 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:00.779061 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5dbba-6c42-4268-a21f-ef48e327adc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:00.779387 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5dbba-6c42-4268-a21f-ef48e327adc5 admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:00.782786 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5dbba-6c42-4268-a21f-ef48e327adc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:00.785836 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5dbba-6c42-4268-a21f-ef48e327adc5 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:00.809389 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1412/2816] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:59:00 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:59:00.813770 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e30826-eeba-432b-981e-4da8b9d8e59a admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:00.824477 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e30826-eeba-432b-981e-4da8b9d8e59a admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:00.829703 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3819630-ebcf-48e5-8065-5cabef9488eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:00.830384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3819630-ebcf-48e5-8065-5cabef9488eb admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:00.830660 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3819630-ebcf-48e5-8065-5cabef9488eb admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:00.830907 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3819630-ebcf-48e5-8065-5cabef9488eb admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:00.831775 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3819630-ebcf-48e5-8065-5cabef9488eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:00.833376 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3819630-ebcf-48e5-8065-5cabef9488eb admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:00.844100 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1405/2817] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:59:00.848207 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5dbba-6c42-4268-a21f-ef48e327adc5 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:00.858538 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5dbba-6c42-4268-a21f-ef48e327adc5 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:00.863219 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ba7eb-7dab-45b1-8de9-1776d6284b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:00.863870 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ba7eb-7dab-45b1-8de9-1776d6284b1f admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:00.864148 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ba7eb-7dab-45b1-8de9-1776d6284b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:00.864421 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ba7eb-7dab-45b1-8de9-1776d6284b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:00.865141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79ba7eb-7dab-45b1-8de9-1776d6284b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:00.866872 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79ba7eb-7dab-45b1-8de9-1776d6284b1f admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:00.876738 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1413/2818] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:59:00.881182 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3819630-ebcf-48e5-8065-5cabef9488eb admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:00.895315 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3819630-ebcf-48e5-8065-5cabef9488eb admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:00.900755 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0b1ed-f85e-4a1c-86cf-65d8ed9aabe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:00.901645 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0b1ed-f85e-4a1c-86cf-65d8ed9aabe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:00.901956 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0b1ed-f85e-4a1c-86cf-65d8ed9aabe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:00.902218 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0b1ed-f85e-4a1c-86cf-65d8ed9aabe3 admin admin] PATH_INFO: `/v3/projects/99f03838b99f408991a23cb57d4ab78e/users/f66d12b7cb3f4511ac42816d7d714f56/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:00.917206 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0b1ed-f85e-4a1c-86cf-65d8ed9aabe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99f03838b99f408991a23cb57d4ab78e, user_id=f66d12b7cb3f4511ac42816d7d714f56, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:00.919918 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0b1ed-f85e-4a1c-86cf-65d8ed9aabe3 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:00.934796 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1406/2819] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:59:00 2022] PUT /identity/v3/projects/99f03838b99f408991a23cb57d4ab78e/users/f66d12b7cb3f4511ac42816d7d714f56/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:59:00.946776 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc313d9-e84a-4ed7-bf7a-561495113538 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:00.946967 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc313d9-e84a-4ed7-bf7a-561495113538 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:00.947404 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc313d9-e84a-4ed7-bf7a-561495113538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:00.975074 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:00.986284 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-cdc313d9-e84a-4ed7-bf7a-561495113538 None None] MFA Rules not processed for user `f66d12b7cb3f4511ac42816d7d714f56`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:59:00.988176 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-cdc313d9-e84a-4ed7-bf7a-561495113538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:01.055673 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1414/2820] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:59:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:59:01.060373 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0b1ed-f85e-4a1c-86cf-65d8ed9aabe3 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:01.112914 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:01.129687 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0b1ed-f85e-4a1c-86cf-65d8ed9aabe3 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:01.135973 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ed6b8-83ad-4e47-a070-a92c29f25718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:01.136810 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ed6b8-83ad-4e47-a070-a92c29f25718 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:01.137278 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ed6b8-83ad-4e47-a070-a92c29f25718 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:01.137567 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ed6b8-83ad-4e47-a070-a92c29f25718 admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:01.138337 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ed6b8-83ad-4e47-a070-a92c29f25718 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:01.140316 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ed6b8-83ad-4e47-a070-a92c29f25718 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:01.168087 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1407/2821] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:59:01 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:59:01.172437 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc313d9-e84a-4ed7-bf7a-561495113538 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:01.183933 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc313d9-e84a-4ed7-bf7a-561495113538 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:01.249954 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b696e-0249-41cd-9b6d-e2af28c5967b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:01.250620 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b696e-0249-41cd-9b6d-e2af28c5967b admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:01.250893 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b696e-0249-41cd-9b6d-e2af28c5967b admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:01.251165 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b696e-0249-41cd-9b6d-e2af28c5967b admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:01.251824 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01b696e-0249-41cd-9b6d-e2af28c5967b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:01.253803 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01b696e-0249-41cd-9b6d-e2af28c5967b admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:01.274917 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1415/2822] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:59:01 2022] POST /identity/v3/users => generated 298 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:59:01.279574 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ed6b8-83ad-4e47-a070-a92c29f25718 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:01.293157 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ed6b8-83ad-4e47-a070-a92c29f25718 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:01.298266 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97553e97-334d-4cc8-8c12-1bb545a7a033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:01.298932 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97553e97-334d-4cc8-8c12-1bb545a7a033 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:01.299212 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97553e97-334d-4cc8-8c12-1bb545a7a033 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:01.299483 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97553e97-334d-4cc8-8c12-1bb545a7a033 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:01.300210 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97553e97-334d-4cc8-8c12-1bb545a7a033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:01.301860 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97553e97-334d-4cc8-8c12-1bb545a7a033 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:01.312700 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1408/2823] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:59:01.316944 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b696e-0249-41cd-9b6d-e2af28c5967b admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:01.327535 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b696e-0249-41cd-9b6d-e2af28c5967b admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:01.332830 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677994e-929d-4e09-a523-f037bd515c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:01.333726 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677994e-929d-4e09-a523-f037bd515c48 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:01.334041 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677994e-929d-4e09-a523-f037bd515c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:01.334310 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677994e-929d-4e09-a523-f037bd515c48 admin admin] PATH_INFO: `/v3/projects/e4a7447fda1c46e89e970d1d8556c77f/users/24d12b1997fd4831982bd53f24ab20fc/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:01.350625 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677994e-929d-4e09-a523-f037bd515c48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4a7447fda1c46e89e970d1d8556c77f, user_id=24d12b1997fd4831982bd53f24ab20fc, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:01.353319 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677994e-929d-4e09-a523-f037bd515c48 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:01.366935 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1416/2824] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:59:01 2022] PUT /identity/v3/projects/e4a7447fda1c46e89e970d1d8556c77f/users/24d12b1997fd4831982bd53f24ab20fc/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:59:01.370983 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97553e97-334d-4cc8-8c12-1bb545a7a033 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:01.381163 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97553e97-334d-4cc8-8c12-1bb545a7a033 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:01.438911 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77cb7db-f2a5-43bb-8003-a7eb629f4fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:01.439604 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cb7db-f2a5-43bb-8003-a7eb629f4fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:01.439882 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cb7db-f2a5-43bb-8003-a7eb629f4fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:01.440146 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cb7db-f2a5-43bb-8003-a7eb629f4fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:01.440870 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77cb7db-f2a5-43bb-8003-a7eb629f4fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:01.442535 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77cb7db-f2a5-43bb-8003-a7eb629f4fe8 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:01.452958 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1409/2825] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:59:01.457238 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677994e-929d-4e09-a523-f037bd515c48 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:01.467904 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677994e-929d-4e09-a523-f037bd515c48 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:01.472707 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3386d-7519-4f36-a991-1dcd87aec6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:01.473577 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3386d-7519-4f36-a991-1dcd87aec6cd admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:01.473879 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3386d-7519-4f36-a991-1dcd87aec6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:01.474173 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3386d-7519-4f36-a991-1dcd87aec6cd admin admin] PATH_INFO: `/v3/projects/e4a7447fda1c46e89e970d1d8556c77f/users/24d12b1997fd4831982bd53f24ab20fc/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:01.476241 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a3386d-7519-4f36-a991-1dcd87aec6cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4a7447fda1c46e89e970d1d8556c77f, user_id=24d12b1997fd4831982bd53f24ab20fc, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:01.478981 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a3386d-7519-4f36-a991-1dcd87aec6cd admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:01.489765 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1417/2826] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:59:01 2022] PUT /identity/v3/projects/e4a7447fda1c46e89e970d1d8556c77f/users/24d12b1997fd4831982bd53f24ab20fc/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:59:01.499953 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43b26a-cc28-45c9-a76d-05a9f000bf91 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:01.500237 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43b26a-cc28-45c9-a76d-05a9f000bf91 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:01.500509 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43b26a-cc28-45c9-a76d-05a9f000bf91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:01.527610 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-0e43b26a-cc28-45c9-a76d-05a9f000bf91 None None] MFA Rules not processed for user `24d12b1997fd4831982bd53f24ab20fc`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:59:01.528909 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-0e43b26a-cc28-45c9-a76d-05a9f000bf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:01.608221 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1410/2827] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:59:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:59:01.620897 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3386d-7519-4f36-a991-1dcd87aec6cd admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:01.623007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-f4a3386d-7519-4f36-a991-1dcd87aec6cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:01.683459 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3386d-7519-4f36-a991-1dcd87aec6cd admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:01.687483 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee51026-5156-47ba-886f-3645703fceb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:01.688116 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee51026-5156-47ba-886f-3645703fceb4 service cinder] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:01.688397 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee51026-5156-47ba-886f-3645703fceb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:01.688673 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee51026-5156-47ba-886f-3645703fceb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:01.693062 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:01.746948 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee51026-5156-47ba-886f-3645703fceb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:01.748331 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee51026-5156-47ba-886f-3645703fceb4 service cinder] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:01.757807 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1418/2828] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:59:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:59:05.983753 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43b26a-cc28-45c9-a76d-05a9f000bf91 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:05.985419 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-0e43b26a-cc28-45c9-a76d-05a9f000bf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:05.998197 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43b26a-cc28-45c9-a76d-05a9f000bf91 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:06.002210 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984362e-ac12-4dd0-9c49-23a37c9e661c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:06.002848 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984362e-ac12-4dd0-9c49-23a37c9e661c service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:06.003149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984362e-ac12-4dd0-9c49-23a37c9e661c service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:06.003415 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984362e-ac12-4dd0-9c49-23a37c9e661c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:06.012958 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984362e-ac12-4dd0-9c49-23a37c9e661c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:06.014455 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984362e-ac12-4dd0-9c49-23a37c9e661c service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:06.024096 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1411/2829] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:59:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:59:10.963574 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee51026-5156-47ba-886f-3645703fceb4 service cinder] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:11.028306 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee51026-5156-47ba-886f-3645703fceb4 service cinder] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:11.033702 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fe96f-0481-47bc-9507-c345461a7788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:11.034590 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fe96f-0481-47bc-9507-c345461a7788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:11.034862 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fe96f-0481-47bc-9507-c345461a7788 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:11.035146 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fe96f-0481-47bc-9507-c345461a7788 admin admin] PATH_INFO: `/v3/users/f66d12b7cb3f4511ac42816d7d714f56` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:11.036435 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394fe96f-0481-47bc-9507-c345461a7788 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f66d12b7cb3f4511ac42816d7d714f56)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:11.038394 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394fe96f-0481-47bc-9507-c345461a7788 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:11.098725 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-394fe96f-0481-47bc-9507-c345461a7788 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f66d12b7cb3f4511ac42816d7d714f56'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:11.111066 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-394fe96f-0481-47bc-9507-c345461a7788 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f66d12b7cb3f4511ac42816d7d714f56'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:11.118834 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-394fe96f-0481-47bc-9507-c345461a7788 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f66d12b7cb3f4511ac42816d7d714f56'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:11.119705 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-394fe96f-0481-47bc-9507-c345461a7788 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f66d12b7cb3f4511ac42816d7d714f56'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:11.120402 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-394fe96f-0481-47bc-9507-c345461a7788 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f66d12b7cb3f4511ac42816d7d714f56'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:11.135508 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1419/2830] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:59:10 2022] DELETE /identity/v3/users/f66d12b7cb3f4511ac42816d7d714f56 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:59:11.140333 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b9e27-5305-406f-b61f-7e09aee134e0 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:11.140793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b9e27-5305-406f-b61f-7e09aee134e0 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:11.141033 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b9e27-5305-406f-b61f-7e09aee134e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:11.160766 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-cf8b9e27-5305-406f-b61f-7e09aee134e0 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:59:11.162018 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-cf8b9e27-5305-406f-b61f-7e09aee134e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:11.193089 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:11.233194 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1412/2831] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:59:11.243315 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fe96f-0481-47bc-9507-c345461a7788 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:11.244997 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-394fe96f-0481-47bc-9507-c345461a7788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:11.277767 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:11.309172 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fe96f-0481-47bc-9507-c345461a7788 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:11.313132 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ff374-3fb9-41bb-8a24-a421cea19c44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:11.313776 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ff374-3fb9-41bb-8a24-a421cea19c44 service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:11.314082 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ff374-3fb9-41bb-8a24-a421cea19c44 service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:11.314416 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ff374-3fb9-41bb-8a24-a421cea19c44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:11.323799 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ff374-3fb9-41bb-8a24-a421cea19c44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:11.325240 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ff374-3fb9-41bb-8a24-a421cea19c44 service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:11.334886 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1420/2832] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:59:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:59:11.634489 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b9e27-5305-406f-b61f-7e09aee134e0 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:11.635988 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-cf8b9e27-5305-406f-b61f-7e09aee134e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:11.652621 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b9e27-5305-406f-b61f-7e09aee134e0 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:11.658236 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe755c8d-de62-40e9-a94b-4dd92bfa4229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:11.659132 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe755c8d-de62-40e9-a94b-4dd92bfa4229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:11.659390 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe755c8d-de62-40e9-a94b-4dd92bfa4229 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:11.659688 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe755c8d-de62-40e9-a94b-4dd92bfa4229 admin admin] PATH_INFO: `/v3/projects/99f03838b99f408991a23cb57d4ab78e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:11.660975 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe755c8d-de62-40e9-a94b-4dd92bfa4229 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99f03838b99f408991a23cb57d4ab78e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:11.663000 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe755c8d-de62-40e9-a94b-4dd92bfa4229 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:11.713512 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-fe755c8d-de62-40e9-a94b-4dd92bfa4229 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99f03838b99f408991a23cb57d4ab78e', 'request_id': 'req-fe755c8d-de62-40e9-a94b-4dd92bfa4229'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:11.720139 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-fe755c8d-de62-40e9-a94b-4dd92bfa4229 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99f03838b99f408991a23cb57d4ab78e', 'request_id': 'req-fe755c8d-de62-40e9-a94b-4dd92bfa4229'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:11.728501 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-fe755c8d-de62-40e9-a94b-4dd92bfa4229 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99f03838b99f408991a23cb57d4ab78e', 'request_id': 'req-fe755c8d-de62-40e9-a94b-4dd92bfa4229'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:11.740066 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-fe755c8d-de62-40e9-a94b-4dd92bfa4229 admin admin] The token cache is being invalidate because project 99f03838b99f408991a23cb57d4ab78e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:59:11.740352 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-fe755c8d-de62-40e9-a94b-4dd92bfa4229 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:11.741000 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-fe755c8d-de62-40e9-a94b-4dd92bfa4229 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:11.742609 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1413/2833] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:59:11 2022] DELETE /identity/v3/projects/99f03838b99f408991a23cb57d4ab78e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:59:11.746772 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ff374-3fb9-41bb-8a24-a421cea19c44 service neutron] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:11.756849 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ff374-3fb9-41bb-8a24-a421cea19c44 service neutron] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:11.816169 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570f62c-c15d-4cb0-b14f-28278bc35df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:11.817054 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570f62c-c15d-4cb0-b14f-28278bc35df5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:11.817339 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570f62c-c15d-4cb0-b14f-28278bc35df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:11.817617 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570f62c-c15d-4cb0-b14f-28278bc35df5 admin admin] PATH_INFO: `/v3/users/24d12b1997fd4831982bd53f24ab20fc` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:11.818904 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c570f62c-c15d-4cb0-b14f-28278bc35df5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24d12b1997fd4831982bd53f24ab20fc)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:11.820898 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c570f62c-c15d-4cb0-b14f-28278bc35df5 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:11.868901 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c570f62c-c15d-4cb0-b14f-28278bc35df5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24d12b1997fd4831982bd53f24ab20fc'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:11.882250 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c570f62c-c15d-4cb0-b14f-28278bc35df5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24d12b1997fd4831982bd53f24ab20fc'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:11.890517 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c570f62c-c15d-4cb0-b14f-28278bc35df5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24d12b1997fd4831982bd53f24ab20fc'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:11.891178 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c570f62c-c15d-4cb0-b14f-28278bc35df5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24d12b1997fd4831982bd53f24ab20fc'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:11.891907 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-c570f62c-c15d-4cb0-b14f-28278bc35df5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24d12b1997fd4831982bd53f24ab20fc'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:11.909270 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1421/2834] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:59:11 2022] DELETE /identity/v3/users/24d12b1997fd4831982bd53f24ab20fc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:59:12.197395 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe755c8d-de62-40e9-a94b-4dd92bfa4229 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:12.199269 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-fe755c8d-de62-40e9-a94b-4dd92bfa4229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:12.216313 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe755c8d-de62-40e9-a94b-4dd92bfa4229 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:12.277347 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a654e-c9dd-46e9-9d5d-2a073508f8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:12.278172 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a654e-c9dd-46e9-9d5d-2a073508f8d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:12.278456 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a654e-c9dd-46e9-9d5d-2a073508f8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:12.278728 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a654e-c9dd-46e9-9d5d-2a073508f8d9 admin admin] PATH_INFO: `/v3/projects/e4a7447fda1c46e89e970d1d8556c77f` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:12.280280 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a654e-c9dd-46e9-9d5d-2a073508f8d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4a7447fda1c46e89e970d1d8556c77f)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:12.282278 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a654e-c9dd-46e9-9d5d-2a073508f8d9 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:12.338252 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-3d0a654e-c9dd-46e9-9d5d-2a073508f8d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4a7447fda1c46e89e970d1d8556c77f', 'request_id': 'req-3d0a654e-c9dd-46e9-9d5d-2a073508f8d9'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:12.343793 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-3d0a654e-c9dd-46e9-9d5d-2a073508f8d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4a7447fda1c46e89e970d1d8556c77f', 'request_id': 'req-3d0a654e-c9dd-46e9-9d5d-2a073508f8d9'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:12.345457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:12.353784 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-3d0a654e-c9dd-46e9-9d5d-2a073508f8d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4a7447fda1c46e89e970d1d8556c77f', 'request_id': 'req-3d0a654e-c9dd-46e9-9d5d-2a073508f8d9'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:12.366395 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-3d0a654e-c9dd-46e9-9d5d-2a073508f8d9 admin admin] The token cache is being invalidate because project e4a7447fda1c46e89e970d1d8556c77f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87151) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:59:12.366684 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-3d0a654e-c9dd-46e9-9d5d-2a073508f8d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:12.367342 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-3d0a654e-c9dd-46e9-9d5d-2a073508f8d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:12.368896 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1414/2835] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:59:12 2022] DELETE /identity/v3/projects/e4a7447fda1c46e89e970d1d8556c77f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:59:12.375181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa80c6b-b7d7-44e4-b553-177aa003019a None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:12.375694 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa80c6b-b7d7-44e4-b553-177aa003019a None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:12.375694 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa80c6b-b7d7-44e4-b553-177aa003019a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:12.394040 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-3aa80c6b-b7d7-44e4-b553-177aa003019a None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:59:12.395258 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-3aa80c6b-b7d7-44e4-b553-177aa003019a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:12.447197 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:12.468884 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1422/2836] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:59:12.477457 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa23e12-32d9-4ecb-aaeb-e2447caf26c1 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:12.477780 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa23e12-32d9-4ecb-aaeb-e2447caf26c1 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:12.478079 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa23e12-32d9-4ecb-aaeb-e2447caf26c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:12.496724 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-5aa23e12-32d9-4ecb-aaeb-e2447caf26c1 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:59:12.497953 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-5aa23e12-32d9-4ecb-aaeb-e2447caf26c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:12.505734 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1415/2837] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:59:12.509949 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa80c6b-b7d7-44e4-b553-177aa003019a None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:12.519955 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa80c6b-b7d7-44e4-b553-177aa003019a None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:12.525633 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea22b9-501c-4b04-847e-f0a3df6b0751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:12.526484 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea22b9-501c-4b04-847e-f0a3df6b0751 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:12.526760 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea22b9-501c-4b04-847e-f0a3df6b0751 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:12.527031 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea22b9-501c-4b04-847e-f0a3df6b0751 admin admin] PATH_INFO: `/v3/domains` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:12.527849 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea22b9-501c-4b04-847e-f0a3df6b0751 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87152) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:59:12.528047 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea22b9-501c-4b04-847e-f0a3df6b0751 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:12.529663 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea22b9-501c-4b04-847e-f0a3df6b0751 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:12.541999 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1423/2838] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:59:12.546722 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa23e12-32d9-4ecb-aaeb-e2447caf26c1 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:12.556156 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa23e12-32d9-4ecb-aaeb-e2447caf26c1 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:12.561208 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6116142-1ade-46ea-84d9-f02f0f193b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:12.561872 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6116142-1ade-46ea-84d9-f02f0f193b7d admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:12.562154 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6116142-1ade-46ea-84d9-f02f0f193b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:12.562425 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6116142-1ade-46ea-84d9-f02f0f193b7d admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:12.563110 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6116142-1ade-46ea-84d9-f02f0f193b7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:12.565006 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6116142-1ade-46ea-84d9-f02f0f193b7d admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:12.595747 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1416/2839] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:59:12 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 05 20:59:12.600838 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea22b9-501c-4b04-847e-f0a3df6b0751 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:12.615591 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea22b9-501c-4b04-847e-f0a3df6b0751 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:12.675320 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0fa7c-3d18-40d2-9ca9-38d8a948904e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:12.675992 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0fa7c-3d18-40d2-9ca9-38d8a948904e admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:12.676274 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0fa7c-3d18-40d2-9ca9-38d8a948904e admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:12.676553 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0fa7c-3d18-40d2-9ca9-38d8a948904e admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:12.677238 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a0fa7c-3d18-40d2-9ca9-38d8a948904e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:12.679212 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a0fa7c-3d18-40d2-9ca9-38d8a948904e admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:12.705417 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1424/2840] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:59:12 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:59:12.709780 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6116142-1ade-46ea-84d9-f02f0f193b7d admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:12.721701 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6116142-1ade-46ea-84d9-f02f0f193b7d admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:12.727587 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f3abb-ed35-4b64-968d-7f21b0153335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:12.728246 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f3abb-ed35-4b64-968d-7f21b0153335 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:12.728525 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f3abb-ed35-4b64-968d-7f21b0153335 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:12.728796 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f3abb-ed35-4b64-968d-7f21b0153335 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:12.729492 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f3abb-ed35-4b64-968d-7f21b0153335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:12.731150 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f3abb-ed35-4b64-968d-7f21b0153335 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:12.742020 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1417/2841] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:59:12.746250 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0fa7c-3d18-40d2-9ca9-38d8a948904e admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:12.757157 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0fa7c-3d18-40d2-9ca9-38d8a948904e admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:12.762975 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb2a05-420e-4533-a80f-0a844101a11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:12.763645 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb2a05-420e-4533-a80f-0a844101a11c admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:12.764014 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb2a05-420e-4533-a80f-0a844101a11c admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:12.764301 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb2a05-420e-4533-a80f-0a844101a11c admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:12.765090 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb2a05-420e-4533-a80f-0a844101a11c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:12.766755 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb2a05-420e-4533-a80f-0a844101a11c admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:12.777416 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1425/2842] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:59:12.781584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f3abb-ed35-4b64-968d-7f21b0153335 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:12.791517 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f3abb-ed35-4b64-968d-7f21b0153335 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:12.796528 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0266eae-6f18-4bf3-a686-7e33732108be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:12.797403 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0266eae-6f18-4bf3-a686-7e33732108be admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:12.797679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0266eae-6f18-4bf3-a686-7e33732108be admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:12.797976 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0266eae-6f18-4bf3-a686-7e33732108be admin admin] PATH_INFO: `/v3/projects/6420052275dd47e1aaaa98cb8dd6ac6e/users/63c48707ef0e4ae0a23d4c5f7ff2cd29/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:12.813100 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0266eae-6f18-4bf3-a686-7e33732108be admin admin] RBAC: Authorizing `identity:create_grant(project_id=6420052275dd47e1aaaa98cb8dd6ac6e, user_id=63c48707ef0e4ae0a23d4c5f7ff2cd29, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:12.815887 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0266eae-6f18-4bf3-a686-7e33732108be admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:12.830680 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1418/2843] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:59:12 2022] PUT /identity/v3/projects/6420052275dd47e1aaaa98cb8dd6ac6e/users/63c48707ef0e4ae0a23d4c5f7ff2cd29/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:59:12.841976 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d094075-b4cb-4097-b48c-729f3c9e5e21 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:12.842292 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d094075-b4cb-4097-b48c-729f3c9e5e21 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:12.842551 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d094075-b4cb-4097-b48c-729f3c9e5e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:12.868416 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-3d094075-b4cb-4097-b48c-729f3c9e5e21 None None] MFA Rules not processed for user `63c48707ef0e4ae0a23d4c5f7ff2cd29`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:59:12.869625 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-3d094075-b4cb-4097-b48c-729f3c9e5e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:12.942098 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1426/2844] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:59:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:59:12.946864 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0266eae-6f18-4bf3-a686-7e33732108be admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:13.022090 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0266eae-6f18-4bf3-a686-7e33732108be admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:13.028403 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3998e-f0da-4455-a88f-af240ac89f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:13.029052 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3998e-f0da-4455-a88f-af240ac89f82 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:13.029337 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3998e-f0da-4455-a88f-af240ac89f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:13.029615 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3998e-f0da-4455-a88f-af240ac89f82 admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:13.030333 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3998e-f0da-4455-a88f-af240ac89f82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:13.032329 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3998e-f0da-4455-a88f-af240ac89f82 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:13.060404 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1419/2845] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:59:12 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:59:13.064955 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d094075-b4cb-4097-b48c-729f3c9e5e21 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:13.078807 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d094075-b4cb-4097-b48c-729f3c9e5e21 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:13.123626 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:13.148176 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145c39c-2437-427c-9c49-138e20f18a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:13.149007 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145c39c-2437-427c-9c49-138e20f18a51 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:13.149391 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145c39c-2437-427c-9c49-138e20f18a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:13.150523 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145c39c-2437-427c-9c49-138e20f18a51 admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:13.150987 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5145c39c-2437-427c-9c49-138e20f18a51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:13.153325 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5145c39c-2437-427c-9c49-138e20f18a51 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:13.175388 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1427/2846] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:59:13 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:59:13.179688 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3998e-f0da-4455-a88f-af240ac89f82 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:13.190178 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3998e-f0da-4455-a88f-af240ac89f82 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:13.194942 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350852e-8ab6-4303-b092-43210f7dc2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:13.195596 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350852e-8ab6-4303-b092-43210f7dc2ea admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:13.195882 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350852e-8ab6-4303-b092-43210f7dc2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:13.196162 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350852e-8ab6-4303-b092-43210f7dc2ea admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:13.196894 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350852e-8ab6-4303-b092-43210f7dc2ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:13.198558 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350852e-8ab6-4303-b092-43210f7dc2ea admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:13.209226 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1420/2847] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 05 20:59:13.213294 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145c39c-2437-427c-9c49-138e20f18a51 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:13.223892 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145c39c-2437-427c-9c49-138e20f18a51 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:13.229788 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9290f8-f3a6-494c-bc17-4699f5d83f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:13.230447 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9290f8-f3a6-494c-bc17-4699f5d83f9b admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:13.230721 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9290f8-f3a6-494c-bc17-4699f5d83f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:13.230986 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9290f8-f3a6-494c-bc17-4699f5d83f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:13.231701 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9290f8-f3a6-494c-bc17-4699f5d83f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:13.233330 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9290f8-f3a6-494c-bc17-4699f5d83f9b admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:13.243984 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1428/2848] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:59:13.248371 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350852e-8ab6-4303-b092-43210f7dc2ea admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:13.259013 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350852e-8ab6-4303-b092-43210f7dc2ea admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:13.264387 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479b376-983b-4536-8cc4-012fbb7e0b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:13.265279 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479b376-983b-4536-8cc4-012fbb7e0b0b admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:13.265557 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479b376-983b-4536-8cc4-012fbb7e0b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:13.265858 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479b376-983b-4536-8cc4-012fbb7e0b0b admin admin] PATH_INFO: `/v3/projects/f80a4dca1beb42d5b2f74ab487b8fdbe/users/31e452dceab54c9787ebc0e30974c107/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:13.280946 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479b376-983b-4536-8cc4-012fbb7e0b0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f80a4dca1beb42d5b2f74ab487b8fdbe, user_id=31e452dceab54c9787ebc0e30974c107, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:13.283760 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479b376-983b-4536-8cc4-012fbb7e0b0b admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:13.297864 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1421/2849] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:59:13 2022] PUT /identity/v3/projects/f80a4dca1beb42d5b2f74ab487b8fdbe/users/31e452dceab54c9787ebc0e30974c107/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:59:13.309073 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d442b-a6d8-4cc9-bd4f-317b17290eac None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:13.309363 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d442b-a6d8-4cc9-bd4f-317b17290eac None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:13.309642 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d442b-a6d8-4cc9-bd4f-317b17290eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:13.336834 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-5c0d442b-a6d8-4cc9-bd4f-317b17290eac None None] MFA Rules not processed for user `31e452dceab54c9787ebc0e30974c107`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:59:13.338115 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-5c0d442b-a6d8-4cc9-bd4f-317b17290eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:13.403193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1429/2850] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:59:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:59:13.407973 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479b376-983b-4536-8cc4-012fbb7e0b0b admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:13.445712 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:13.476939 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479b376-983b-4536-8cc4-012fbb7e0b0b admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:13.482404 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da6991-ba32-4de3-8b13-657e9c98ed52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:13.483068 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da6991-ba32-4de3-8b13-657e9c98ed52 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:13.483350 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da6991-ba32-4de3-8b13-657e9c98ed52 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:13.483626 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da6991-ba32-4de3-8b13-657e9c98ed52 admin admin] PATH_INFO: `/v3/projects` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:13.484314 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da6991-ba32-4de3-8b13-657e9c98ed52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:13.486300 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da6991-ba32-4de3-8b13-657e9c98ed52 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:13.519494 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1422/2851] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:59:13 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:59:13.526389 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d442b-a6d8-4cc9-bd4f-317b17290eac None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:13.539807 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d442b-a6d8-4cc9-bd4f-317b17290eac None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:13.596863 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e1d5a-548a-4de4-9ee8-5b8d86e141f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:13.597552 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e1d5a-548a-4de4-9ee8-5b8d86e141f9 admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:13.597831 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e1d5a-548a-4de4-9ee8-5b8d86e141f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:13.598129 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e1d5a-548a-4de4-9ee8-5b8d86e141f9 admin admin] PATH_INFO: `/v3/users` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:13.598858 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e1d5a-548a-4de4-9ee8-5b8d86e141f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:13.600854 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e1d5a-548a-4de4-9ee8-5b8d86e141f9 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:13.622423 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1430/2852] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:59:13 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:59:13.626580 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da6991-ba32-4de3-8b13-657e9c98ed52 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:13.637623 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da6991-ba32-4de3-8b13-657e9c98ed52 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:13.642647 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acda8b-9691-481e-b119-b10dee489a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:13.643306 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acda8b-9691-481e-b119-b10dee489a7f admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:13.643584 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acda8b-9691-481e-b119-b10dee489a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:13.643887 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acda8b-9691-481e-b119-b10dee489a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:13.644601 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3acda8b-9691-481e-b119-b10dee489a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:13.646268 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3acda8b-9691-481e-b119-b10dee489a7f admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:13.658032 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1423/2853] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:59:13.662247 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e1d5a-548a-4de4-9ee8-5b8d86e141f9 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:13.672405 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e1d5a-548a-4de4-9ee8-5b8d86e141f9 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:13.677440 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94449c5-1d7d-4559-bb53-7c3dd1027297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:13.678346 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94449c5-1d7d-4559-bb53-7c3dd1027297 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:13.678624 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94449c5-1d7d-4559-bb53-7c3dd1027297 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:13.678891 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94449c5-1d7d-4559-bb53-7c3dd1027297 admin admin] PATH_INFO: `/v3/projects/44989f32decb44828a384ceb684bbbaf/users/813c7c28e2a84ed7b00aa43e0d6cf3cb/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:13.693980 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94449c5-1d7d-4559-bb53-7c3dd1027297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44989f32decb44828a384ceb684bbbaf, user_id=813c7c28e2a84ed7b00aa43e0d6cf3cb, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:13.696640 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94449c5-1d7d-4559-bb53-7c3dd1027297 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:13.711690 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1431/2854] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:59:13 2022] PUT /identity/v3/projects/44989f32decb44828a384ceb684bbbaf/users/813c7c28e2a84ed7b00aa43e0d6cf3cb/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:59:13.715762 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acda8b-9691-481e-b119-b10dee489a7f admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:13.726075 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acda8b-9691-481e-b119-b10dee489a7f admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:13.787162 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501c890-0cb5-4130-ba99-c4b8f48004ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:13.787832 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501c890-0cb5-4130-ba99-c4b8f48004ec admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:13.788111 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501c890-0cb5-4130-ba99-c4b8f48004ec admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:13.788384 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501c890-0cb5-4130-ba99-c4b8f48004ec admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:13.789108 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501c890-0cb5-4130-ba99-c4b8f48004ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:13.790829 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501c890-0cb5-4130-ba99-c4b8f48004ec admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:13.802035 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1424/2855] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:59:13.806289 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94449c5-1d7d-4559-bb53-7c3dd1027297 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:13.816844 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94449c5-1d7d-4559-bb53-7c3dd1027297 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:13.821955 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3d182-489f-4343-822e-3820488c23cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:13.822837 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3d182-489f-4343-822e-3820488c23cb admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:13.823114 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3d182-489f-4343-822e-3820488c23cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:13.823369 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3d182-489f-4343-822e-3820488c23cb admin admin] PATH_INFO: `/v3/projects/44989f32decb44828a384ceb684bbbaf/users/813c7c28e2a84ed7b00aa43e0d6cf3cb/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:13.825418 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e3d182-489f-4343-822e-3820488c23cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=44989f32decb44828a384ceb684bbbaf, user_id=813c7c28e2a84ed7b00aa43e0d6cf3cb, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:13.828141 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e3d182-489f-4343-822e-3820488c23cb admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:13.838821 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1432/2856] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:59:13 2022] PUT /identity/v3/projects/44989f32decb44828a384ceb684bbbaf/users/813c7c28e2a84ed7b00aa43e0d6cf3cb/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:59:13.848760 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727101d5-2a5d-43c5-b7b3-7494c5ff182e None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:13.849029 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727101d5-2a5d-43c5-b7b3-7494c5ff182e None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:13.849305 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727101d5-2a5d-43c5-b7b3-7494c5ff182e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:13.876757 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-727101d5-2a5d-43c5-b7b3-7494c5ff182e None None] MFA Rules not processed for user `813c7c28e2a84ed7b00aa43e0d6cf3cb`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:59:13.878022 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-727101d5-2a5d-43c5-b7b3-7494c5ff182e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:13.948102 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1425/2857] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:59:13 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:59:13.960181 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3d182-489f-4343-822e-3820488c23cb admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:13.962146 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-e8e3d182-489f-4343-822e-3820488c23cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:13.967795 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:14.021859 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3d182-489f-4343-822e-3820488c23cb admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:14.026556 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193384a-846f-4324-a42b-f65044f4fd35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:14.027186 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193384a-846f-4324-a42b-f65044f4fd35 service cinder] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:14.027434 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193384a-846f-4324-a42b-f65044f4fd35 service cinder] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:14.027736 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193384a-846f-4324-a42b-f65044f4fd35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:14.086397 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193384a-846f-4324-a42b-f65044f4fd35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:14.088006 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193384a-846f-4324-a42b-f65044f4fd35 service cinder] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:14.097368 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1433/2858] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:59:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:59:15.610926 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727101d5-2a5d-43c5-b7b3-7494c5ff182e None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:15.612719 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-727101d5-2a5d-43c5-b7b3-7494c5ff182e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:15.625351 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727101d5-2a5d-43c5-b7b3-7494c5ff182e None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:15.629155 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660c08b-38f8-43bd-9c38-c1a160c8b822 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:15.629792 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660c08b-38f8-43bd-9c38-c1a160c8b822 service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:15.630103 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660c08b-38f8-43bd-9c38-c1a160c8b822 service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:15.630375 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660c08b-38f8-43bd-9c38-c1a160c8b822 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:15.659348 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:15.691532 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0660c08b-38f8-43bd-9c38-c1a160c8b822 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:15.692996 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0660c08b-38f8-43bd-9c38-c1a160c8b822 service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:15.702263 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1426/2859] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:59:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:59:16.230606 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193384a-846f-4324-a42b-f65044f4fd35 service cinder] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:16.241968 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193384a-846f-4324-a42b-f65044f4fd35 service cinder] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:16.246527 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d9a60-fc11-49a4-87f8-2d9d8b74e60b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:16.247166 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d9a60-fc11-49a4-87f8-2d9d8b74e60b service cinder] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:16.247441 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d9a60-fc11-49a4-87f8-2d9d8b74e60b service cinder] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:16.247708 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d9a60-fc11-49a4-87f8-2d9d8b74e60b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:16.257648 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7d9a60-fc11-49a4-87f8-2d9d8b74e60b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:16.259116 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7d9a60-fc11-49a4-87f8-2d9d8b74e60b service cinder] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:16.268871 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1434/2860] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:59:16 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:59:20.188072 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660c08b-38f8-43bd-9c38-c1a160c8b822 service cinder] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:20.250958 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660c08b-38f8-43bd-9c38-c1a160c8b822 service cinder] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:20.256080 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577d0c5-de1f-4d4d-a66b-f13c8a1e4265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:20.256948 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577d0c5-de1f-4d4d-a66b-f13c8a1e4265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:20.257222 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577d0c5-de1f-4d4d-a66b-f13c8a1e4265 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:20.257492 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577d0c5-de1f-4d4d-a66b-f13c8a1e4265 admin admin] PATH_INFO: `/v3/users/63c48707ef0e4ae0a23d4c5f7ff2cd29` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:20.258741 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577d0c5-de1f-4d4d-a66b-f13c8a1e4265 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63c48707ef0e4ae0a23d4c5f7ff2cd29)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:20.260659 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577d0c5-de1f-4d4d-a66b-f13c8a1e4265 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:20.308753 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-e577d0c5-de1f-4d4d-a66b-f13c8a1e4265 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63c48707ef0e4ae0a23d4c5f7ff2cd29'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:20.315565 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-e577d0c5-de1f-4d4d-a66b-f13c8a1e4265 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63c48707ef0e4ae0a23d4c5f7ff2cd29'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:20.327579 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-e577d0c5-de1f-4d4d-a66b-f13c8a1e4265 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63c48707ef0e4ae0a23d4c5f7ff2cd29'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:20.328260 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-e577d0c5-de1f-4d4d-a66b-f13c8a1e4265 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63c48707ef0e4ae0a23d4c5f7ff2cd29'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:20.328895 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-e577d0c5-de1f-4d4d-a66b-f13c8a1e4265 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63c48707ef0e4ae0a23d4c5f7ff2cd29'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:20.342825 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1427/2861] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:59:20 2022] DELETE /identity/v3/users/63c48707ef0e4ae0a23d4c5f7ff2cd29 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:59:20.347478 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8720695-2b4e-49d9-af6c-a2c2dedb1bfd None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:20.347992 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8720695-2b4e-49d9-af6c-a2c2dedb1bfd None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:20.348099 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8720695-2b4e-49d9-af6c-a2c2dedb1bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:20.365278 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-a8720695-2b4e-49d9-af6c-a2c2dedb1bfd None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:59:20.366511 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-a8720695-2b4e-49d9-af6c-a2c2dedb1bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:20.434605 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1435/2862] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:59:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:59:20.447419 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577d0c5-de1f-4d4d-a66b-f13c8a1e4265 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:20.449820 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-e577d0c5-de1f-4d4d-a66b-f13c8a1e4265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:20.509605 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:20.515951 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577d0c5-de1f-4d4d-a66b-f13c8a1e4265 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:20.520861 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f43f6-f0ce-4c1b-bd31-eeff352b332b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:20.521679 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f43f6-f0ce-4c1b-bd31-eeff352b332b service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:20.522115 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f43f6-f0ce-4c1b-bd31-eeff352b332b service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:20.522629 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f43f6-f0ce-4c1b-bd31-eeff352b332b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:20.532606 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f43f6-f0ce-4c1b-bd31-eeff352b332b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:20.534102 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f43f6-f0ce-4c1b-bd31-eeff352b332b service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:20.544094 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1428/2863] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:59:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:59:20.829355 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8720695-2b4e-49d9-af6c-a2c2dedb1bfd None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:20.830895 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-a8720695-2b4e-49d9-af6c-a2c2dedb1bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:20.845393 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8720695-2b4e-49d9-af6c-a2c2dedb1bfd None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:20.851326 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61d3c9-1773-4457-9c39-96e79a0b5255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:20.852481 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61d3c9-1773-4457-9c39-96e79a0b5255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:20.852683 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61d3c9-1773-4457-9c39-96e79a0b5255 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:20.852978 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61d3c9-1773-4457-9c39-96e79a0b5255 admin admin] PATH_INFO: `/v3/projects/6420052275dd47e1aaaa98cb8dd6ac6e` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:20.854252 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba61d3c9-1773-4457-9c39-96e79a0b5255 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6420052275dd47e1aaaa98cb8dd6ac6e)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:20.856147 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba61d3c9-1773-4457-9c39-96e79a0b5255 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:20.898560 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:20.907470 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-ba61d3c9-1773-4457-9c39-96e79a0b5255 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6420052275dd47e1aaaa98cb8dd6ac6e', 'request_id': 'req-ba61d3c9-1773-4457-9c39-96e79a0b5255'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:20.913381 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-ba61d3c9-1773-4457-9c39-96e79a0b5255 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6420052275dd47e1aaaa98cb8dd6ac6e', 'request_id': 'req-ba61d3c9-1773-4457-9c39-96e79a0b5255'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:20.921153 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-ba61d3c9-1773-4457-9c39-96e79a0b5255 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6420052275dd47e1aaaa98cb8dd6ac6e', 'request_id': 'req-ba61d3c9-1773-4457-9c39-96e79a0b5255'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:20.933601 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-ba61d3c9-1773-4457-9c39-96e79a0b5255 admin admin] The token cache is being invalidate because project 6420052275dd47e1aaaa98cb8dd6ac6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:59:20.933911 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-ba61d3c9-1773-4457-9c39-96e79a0b5255 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:20.934642 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-ba61d3c9-1773-4457-9c39-96e79a0b5255 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:20.936333 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1436/2864] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:59:20 2022] DELETE /identity/v3/projects/6420052275dd47e1aaaa98cb8dd6ac6e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:59:20.941100 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f43f6-f0ce-4c1b-bd31-eeff352b332b service neutron] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:20.951454 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f43f6-f0ce-4c1b-bd31-eeff352b332b service neutron] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:21.008398 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae626e6-305c-4783-a6cf-8e99f8af4c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:21.009279 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae626e6-305c-4783-a6cf-8e99f8af4c3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:21.009556 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae626e6-305c-4783-a6cf-8e99f8af4c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:21.009827 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae626e6-305c-4783-a6cf-8e99f8af4c3b admin admin] PATH_INFO: `/v3/users/31e452dceab54c9787ebc0e30974c107` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:21.011020 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae626e6-305c-4783-a6cf-8e99f8af4c3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=31e452dceab54c9787ebc0e30974c107)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:21.012975 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae626e6-305c-4783-a6cf-8e99f8af4c3b admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:21.061116 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-5ae626e6-305c-4783-a6cf-8e99f8af4c3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31e452dceab54c9787ebc0e30974c107'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:21.068407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-5ae626e6-305c-4783-a6cf-8e99f8af4c3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31e452dceab54c9787ebc0e30974c107'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:21.079948 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-5ae626e6-305c-4783-a6cf-8e99f8af4c3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31e452dceab54c9787ebc0e30974c107'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:21.080591 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-5ae626e6-305c-4783-a6cf-8e99f8af4c3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31e452dceab54c9787ebc0e30974c107'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:21.081201 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-5ae626e6-305c-4783-a6cf-8e99f8af4c3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31e452dceab54c9787ebc0e30974c107'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:21.095140 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1429/2865] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:59:20 2022] DELETE /identity/v3/users/31e452dceab54c9787ebc0e30974c107 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:59:21.367674 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61d3c9-1773-4457-9c39-96e79a0b5255 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:21.369241 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-ba61d3c9-1773-4457-9c39-96e79a0b5255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:21.383584 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61d3c9-1773-4457-9c39-96e79a0b5255 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:21.443507 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6802c4e-2cd9-4b19-921c-aa56d922bb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:21.444302 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6802c4e-2cd9-4b19-921c-aa56d922bb14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:21.444577 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6802c4e-2cd9-4b19-921c-aa56d922bb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:21.444824 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6802c4e-2cd9-4b19-921c-aa56d922bb14 admin admin] PATH_INFO: `/v3/projects/f80a4dca1beb42d5b2f74ab487b8fdbe` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:21.446548 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6802c4e-2cd9-4b19-921c-aa56d922bb14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f80a4dca1beb42d5b2f74ab487b8fdbe)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:21.449397 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6802c4e-2cd9-4b19-921c-aa56d922bb14 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:21.504324 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-e6802c4e-2cd9-4b19-921c-aa56d922bb14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f80a4dca1beb42d5b2f74ab487b8fdbe', 'request_id': 'req-e6802c4e-2cd9-4b19-921c-aa56d922bb14'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:21.512934 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-e6802c4e-2cd9-4b19-921c-aa56d922bb14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f80a4dca1beb42d5b2f74ab487b8fdbe', 'request_id': 'req-e6802c4e-2cd9-4b19-921c-aa56d922bb14'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:21.524375 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-e6802c4e-2cd9-4b19-921c-aa56d922bb14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f80a4dca1beb42d5b2f74ab487b8fdbe', 'request_id': 'req-e6802c4e-2cd9-4b19-921c-aa56d922bb14'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:21.536834 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-e6802c4e-2cd9-4b19-921c-aa56d922bb14 admin admin] The token cache is being invalidate because project f80a4dca1beb42d5b2f74ab487b8fdbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:59:21.537120 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-e6802c4e-2cd9-4b19-921c-aa56d922bb14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:21.537787 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-e6802c4e-2cd9-4b19-921c-aa56d922bb14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:21.539422 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1437/2866] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:59:21 2022] DELETE /identity/v3/projects/f80a4dca1beb42d5b2f74ab487b8fdbe => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:59:21.543510 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae626e6-305c-4783-a6cf-8e99f8af4c3b admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:21.544995 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-5ae626e6-305c-4783-a6cf-8e99f8af4c3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:21.557869 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae626e6-305c-4783-a6cf-8e99f8af4c3b admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:21.628436 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f970e4-c274-45d9-bee5-5bbd7b025d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:21.629314 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f970e4-c274-45d9-bee5-5bbd7b025d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:21.629595 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f970e4-c274-45d9-bee5-5bbd7b025d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:21.629946 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f970e4-c274-45d9-bee5-5bbd7b025d5c admin admin] PATH_INFO: `/v3/users/813c7c28e2a84ed7b00aa43e0d6cf3cb` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:21.631207 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f970e4-c274-45d9-bee5-5bbd7b025d5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=813c7c28e2a84ed7b00aa43e0d6cf3cb)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:21.633177 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f970e4-c274-45d9-bee5-5bbd7b025d5c admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:21.643685 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:21.682219 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-49f970e4-c274-45d9-bee5-5bbd7b025d5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '813c7c28e2a84ed7b00aa43e0d6cf3cb'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:21.689109 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-49f970e4-c274-45d9-bee5-5bbd7b025d5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '813c7c28e2a84ed7b00aa43e0d6cf3cb'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:21.701648 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-49f970e4-c274-45d9-bee5-5bbd7b025d5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '813c7c28e2a84ed7b00aa43e0d6cf3cb'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:21.702390 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-49f970e4-c274-45d9-bee5-5bbd7b025d5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '813c7c28e2a84ed7b00aa43e0d6cf3cb'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:21.703099 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-49f970e4-c274-45d9-bee5-5bbd7b025d5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '813c7c28e2a84ed7b00aa43e0d6cf3cb'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:21.718580 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1430/2867] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:59:21 2022] DELETE /identity/v3/users/813c7c28e2a84ed7b00aa43e0d6cf3cb => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:59:21.999661 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6802c4e-2cd9-4b19-921c-aa56d922bb14 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:22.001238 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-e6802c4e-2cd9-4b19-921c-aa56d922bb14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:22.016644 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6802c4e-2cd9-4b19-921c-aa56d922bb14 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:22.070077 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:22.077648 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563619d-921d-48bb-94f5-bd0b87e2c7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:22.079113 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563619d-921d-48bb-94f5-bd0b87e2c7b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:22.079450 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563619d-921d-48bb-94f5-bd0b87e2c7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:22.079948 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563619d-921d-48bb-94f5-bd0b87e2c7b8 admin admin] PATH_INFO: `/v3/projects/44989f32decb44828a384ceb684bbbaf` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:22.081710 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a563619d-921d-48bb-94f5-bd0b87e2c7b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44989f32decb44828a384ceb684bbbaf)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:22.084311 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a563619d-921d-48bb-94f5-bd0b87e2c7b8 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:22.137942 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-a563619d-921d-48bb-94f5-bd0b87e2c7b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44989f32decb44828a384ceb684bbbaf', 'request_id': 'req-a563619d-921d-48bb-94f5-bd0b87e2c7b8'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:22.144175 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-a563619d-921d-48bb-94f5-bd0b87e2c7b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44989f32decb44828a384ceb684bbbaf', 'request_id': 'req-a563619d-921d-48bb-94f5-bd0b87e2c7b8'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:22.154091 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-a563619d-921d-48bb-94f5-bd0b87e2c7b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44989f32decb44828a384ceb684bbbaf', 'request_id': 'req-a563619d-921d-48bb-94f5-bd0b87e2c7b8'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:22.165366 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-a563619d-921d-48bb-94f5-bd0b87e2c7b8 admin admin] The token cache is being invalidate because project 44989f32decb44828a384ceb684bbbaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:59:22.165644 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-a563619d-921d-48bb-94f5-bd0b87e2c7b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:22.166289 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-a563619d-921d-48bb-94f5-bd0b87e2c7b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:22.167862 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1438/2868] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:59:21 2022] DELETE /identity/v3/projects/44989f32decb44828a384ceb684bbbaf => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:59:22.173245 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbef0d8-3f44-4f91-882f-edf833c9be30 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:22.173535 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbef0d8-3f44-4f91-882f-edf833c9be30 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:22.173809 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbef0d8-3f44-4f91-882f-edf833c9be30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:22.192231 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-3fbef0d8-3f44-4f91-882f-edf833c9be30 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:59:22.193447 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-3fbef0d8-3f44-4f91-882f-edf833c9be30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:22.253942 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1431/2869] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:59:22.262105 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37857bc9-1867-4d92-8ea5-03eefca2aa06 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:22.262385 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37857bc9-1867-4d92-8ea5-03eefca2aa06 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:22.262654 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37857bc9-1867-4d92-8ea5-03eefca2aa06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:22.282709 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-37857bc9-1867-4d92-8ea5-03eefca2aa06 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:59:22.283942 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-37857bc9-1867-4d92-8ea5-03eefca2aa06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:22.292851 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1439/2870] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:59:22.297239 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbef0d8-3f44-4f91-882f-edf833c9be30 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:22.308318 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbef0d8-3f44-4f91-882f-edf833c9be30 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:22.313786 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf2b70-76a9-4ee9-acaf-e5c4564aef57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:22.314543 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf2b70-76a9-4ee9-acaf-e5c4564aef57 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:22.315096 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf2b70-76a9-4ee9-acaf-e5c4564aef57 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:22.315264 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf2b70-76a9-4ee9-acaf-e5c4564aef57 admin admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:22.315933 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf2b70-76a9-4ee9-acaf-e5c4564aef57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:59:22.316249 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf2b70-76a9-4ee9-acaf-e5c4564aef57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:22.318103 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf2b70-76a9-4ee9-acaf-e5c4564aef57 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:22.330410 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1432/2871] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:59:22.334978 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37857bc9-1867-4d92-8ea5-03eefca2aa06 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:22.344521 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37857bc9-1867-4d92-8ea5-03eefca2aa06 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:22.349582 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7035c8-5fd0-4a5c-888b-604a66fdb74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:22.350264 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7035c8-5fd0-4a5c-888b-604a66fdb74b admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:22.350574 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7035c8-5fd0-4a5c-888b-604a66fdb74b admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:22.350846 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7035c8-5fd0-4a5c-888b-604a66fdb74b admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:22.351530 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7035c8-5fd0-4a5c-888b-604a66fdb74b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:22.353439 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7035c8-5fd0-4a5c-888b-604a66fdb74b admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:22.381180 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1440/2872] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:59:22 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:59:22.385527 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf2b70-76a9-4ee9-acaf-e5c4564aef57 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:22.395900 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf2b70-76a9-4ee9-acaf-e5c4564aef57 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:22.463808 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf26a8-1707-4c2b-8e5d-d714d5a1e44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:22.464482 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf26a8-1707-4c2b-8e5d-d714d5a1e44a admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:22.464760 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf26a8-1707-4c2b-8e5d-d714d5a1e44a admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:22.465031 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf26a8-1707-4c2b-8e5d-d714d5a1e44a admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:22.465753 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf26a8-1707-4c2b-8e5d-d714d5a1e44a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:22.467733 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf26a8-1707-4c2b-8e5d-d714d5a1e44a admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:22.488909 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1433/2873] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:59:22 2022] POST /identity/v3/users => generated 296 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:59:22.493564 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7035c8-5fd0-4a5c-888b-604a66fdb74b admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:22.504329 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7035c8-5fd0-4a5c-888b-604a66fdb74b admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:22.509339 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f10f2-a86b-48d7-8ead-e9785845fb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:22.510028 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f10f2-a86b-48d7-8ead-e9785845fb57 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:22.510308 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f10f2-a86b-48d7-8ead-e9785845fb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:22.510576 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f10f2-a86b-48d7-8ead-e9785845fb57 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:22.511302 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f10f2-a86b-48d7-8ead-e9785845fb57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:22.512915 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f10f2-a86b-48d7-8ead-e9785845fb57 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:22.523618 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1441/2874] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:59:22.527914 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf26a8-1707-4c2b-8e5d-d714d5a1e44a admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:22.534461 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:22.538374 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf26a8-1707-4c2b-8e5d-d714d5a1e44a admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:22.544482 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935baa5-6696-47c2-9b60-f5339c796f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:22.545115 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935baa5-6696-47c2-9b60-f5339c796f2d admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:22.545394 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935baa5-6696-47c2-9b60-f5339c796f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:22.545726 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935baa5-6696-47c2-9b60-f5339c796f2d admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:22.546486 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935baa5-6696-47c2-9b60-f5339c796f2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:22.548515 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935baa5-6696-47c2-9b60-f5339c796f2d admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:22.559510 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1434/2875] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:59:22.563816 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f10f2-a86b-48d7-8ead-e9785845fb57 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:22.574117 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f10f2-a86b-48d7-8ead-e9785845fb57 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:22.579189 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d4b84-f6b0-4d46-b4e0-069fcb745187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:22.580066 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d4b84-f6b0-4d46-b4e0-069fcb745187 admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:22.580343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d4b84-f6b0-4d46-b4e0-069fcb745187 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:22.580637 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d4b84-f6b0-4d46-b4e0-069fcb745187 admin admin] PATH_INFO: `/v3/projects/9a8e7f8c57fc4f4b9854c517d0c6e9f7/users/d88f1a64916045d4be8ed965f66378d1/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:22.595401 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d4b84-f6b0-4d46-b4e0-069fcb745187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a8e7f8c57fc4f4b9854c517d0c6e9f7, user_id=d88f1a64916045d4be8ed965f66378d1, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:22.598109 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2d4b84-f6b0-4d46-b4e0-069fcb745187 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:22.612135 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1442/2876] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:59:22 2022] PUT /identity/v3/projects/9a8e7f8c57fc4f4b9854c517d0c6e9f7/users/d88f1a64916045d4be8ed965f66378d1/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:59:22.623497 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8252e06-6bb7-4d1a-a79a-4364519ee047 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:22.623784 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8252e06-6bb7-4d1a-a79a-4364519ee047 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:22.624062 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8252e06-6bb7-4d1a-a79a-4364519ee047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:22.656798 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-e8252e06-6bb7-4d1a-a79a-4364519ee047 None None] MFA Rules not processed for user `d88f1a64916045d4be8ed965f66378d1`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:59:22.658034 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-e8252e06-6bb7-4d1a-a79a-4364519ee047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:22.728583 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1435/2877] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:59:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:59:22.739622 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d4b84-f6b0-4d46-b4e0-069fcb745187 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:22.741530 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-ad2d4b84-f6b0-4d46-b4e0-069fcb745187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:22.800641 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d4b84-f6b0-4d46-b4e0-069fcb745187 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:22.804547 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0050d7-8df8-492f-b8fd-59bc161de06c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:22.805191 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0050d7-8df8-492f-b8fd-59bc161de06c service cinder] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:22.805473 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0050d7-8df8-492f-b8fd-59bc161de06c service cinder] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:22.805746 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0050d7-8df8-492f-b8fd-59bc161de06c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:22.814498 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0050d7-8df8-492f-b8fd-59bc161de06c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:22.815953 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0050d7-8df8-492f-b8fd-59bc161de06c service cinder] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:22.825590 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1443/2878] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:59:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:59:32.725214 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=35 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:32.821225 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=78,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:32.942266 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8252e06-6bb7-4d1a-a79a-4364519ee047 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:33.012434 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8252e06-6bb7-4d1a-a79a-4364519ee047 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:33.020219 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dce6a6-f07d-4475-b860-f450643a8f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:33.021546 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dce6a6-f07d-4475-b860-f450643a8f9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:33.021909 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dce6a6-f07d-4475-b860-f450643a8f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:33.022305 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dce6a6-f07d-4475-b860-f450643a8f9d admin admin] PATH_INFO: `/v3/users/d88f1a64916045d4be8ed965f66378d1` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:33.024073 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dce6a6-f07d-4475-b860-f450643a8f9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d88f1a64916045d4be8ed965f66378d1)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:33.027213 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dce6a6-f07d-4475-b860-f450643a8f9d admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:33.085664 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-50dce6a6-f07d-4475-b860-f450643a8f9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd88f1a64916045d4be8ed965f66378d1'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:33.092717 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-50dce6a6-f07d-4475-b860-f450643a8f9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd88f1a64916045d4be8ed965f66378d1'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:33.104979 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-50dce6a6-f07d-4475-b860-f450643a8f9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd88f1a64916045d4be8ed965f66378d1'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:33.105773 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-50dce6a6-f07d-4475-b860-f450643a8f9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd88f1a64916045d4be8ed965f66378d1'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:33.106543 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-50dce6a6-f07d-4475-b860-f450643a8f9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd88f1a64916045d4be8ed965f66378d1'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:33.122640 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1436/2879] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 20:59:32 2022] DELETE /identity/v3/users/d88f1a64916045d4be8ed965f66378d1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:59:33.128610 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3049aa-dd25-4d17-9b10-01948d46a39e None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:33.129095 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3049aa-dd25-4d17-9b10-01948d46a39e None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:33.129527 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3049aa-dd25-4d17-9b10-01948d46a39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:33.150787 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-9d3049aa-dd25-4d17-9b10-01948d46a39e None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:59:33.152036 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-9d3049aa-dd25-4d17-9b10-01948d46a39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:33.216423 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1444/2880] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:59:33.229895 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dce6a6-f07d-4475-b860-f450643a8f9d admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:33.231642 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-50dce6a6-f07d-4475-b860-f450643a8f9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:33.312069 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dce6a6-f07d-4475-b860-f450643a8f9d admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:33.316643 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d42828-f771-407f-b848-eee64244de67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:33.317292 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d42828-f771-407f-b848-eee64244de67 service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:33.317569 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d42828-f771-407f-b848-eee64244de67 service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:33.317867 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d42828-f771-407f-b848-eee64244de67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:33.328493 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d42828-f771-407f-b848-eee64244de67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:33.330042 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d42828-f771-407f-b848-eee64244de67 service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:33.339779 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1437/2881] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:59:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:59:33.609323 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3049aa-dd25-4d17-9b10-01948d46a39e None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:33.610822 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-9d3049aa-dd25-4d17-9b10-01948d46a39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:33.623335 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3049aa-dd25-4d17-9b10-01948d46a39e None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:33.628175 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc1caa-b448-48c0-8a0f-7863fedf1ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:33.629049 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc1caa-b448-48c0-8a0f-7863fedf1ecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:33.629328 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc1caa-b448-48c0-8a0f-7863fedf1ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:33.629602 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc1caa-b448-48c0-8a0f-7863fedf1ecb admin admin] PATH_INFO: `/v3/projects/9a8e7f8c57fc4f4b9854c517d0c6e9f7` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:33.630829 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc1caa-b448-48c0-8a0f-7863fedf1ecb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a8e7f8c57fc4f4b9854c517d0c6e9f7)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:33.632771 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc1caa-b448-48c0-8a0f-7863fedf1ecb admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:33.682397 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-3adc1caa-b448-48c0-8a0f-7863fedf1ecb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a8e7f8c57fc4f4b9854c517d0c6e9f7', 'request_id': 'req-3adc1caa-b448-48c0-8a0f-7863fedf1ecb'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:33.689236 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-3adc1caa-b448-48c0-8a0f-7863fedf1ecb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a8e7f8c57fc4f4b9854c517d0c6e9f7', 'request_id': 'req-3adc1caa-b448-48c0-8a0f-7863fedf1ecb'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:33.700300 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-3adc1caa-b448-48c0-8a0f-7863fedf1ecb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a8e7f8c57fc4f4b9854c517d0c6e9f7', 'request_id': 'req-3adc1caa-b448-48c0-8a0f-7863fedf1ecb'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:33.713009 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-3adc1caa-b448-48c0-8a0f-7863fedf1ecb admin admin] The token cache is being invalidate because project 9a8e7f8c57fc4f4b9854c517d0c6e9f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 20:59:33.713290 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-3adc1caa-b448-48c0-8a0f-7863fedf1ecb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:33.714002 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-3adc1caa-b448-48c0-8a0f-7863fedf1ecb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 20:59:33.715548 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1445/2882] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 20:59:33 2022] DELETE /identity/v3/projects/9a8e7f8c57fc4f4b9854c517d0c6e9f7 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:59:33.721070 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553454c-6f45-42d6-89d2-989401ea3507 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:33.721358 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553454c-6f45-42d6-89d2-989401ea3507 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:33.721633 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553454c-6f45-42d6-89d2-989401ea3507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:33.740312 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-6553454c-6f45-42d6-89d2-989401ea3507 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:59:33.741517 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-6553454c-6f45-42d6-89d2-989401ea3507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:33.760158 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:33.806251 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1438/2883] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:59:33.819125 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72549c-146b-4905-b422-d5c16358d2e2 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:33.819517 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72549c-146b-4905-b422-d5c16358d2e2 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:33.819874 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72549c-146b-4905-b422-d5c16358d2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:33.839986 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-2d72549c-146b-4905-b422-d5c16358d2e2 None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:59:33.841193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-2d72549c-146b-4905-b422-d5c16358d2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:33.849799 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1446/2884] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:59:33.854138 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553454c-6f45-42d6-89d2-989401ea3507 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:33.863997 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553454c-6f45-42d6-89d2-989401ea3507 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:33.869870 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba23be2-1b85-4753-b68e-1e72879be167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:33.870554 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba23be2-1b85-4753-b68e-1e72879be167 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:33.870859 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba23be2-1b85-4753-b68e-1e72879be167 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:33.871160 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba23be2-1b85-4753-b68e-1e72879be167 admin admin] PATH_INFO: `/v3/domains` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:33.871919 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba23be2-1b85-4753-b68e-1e72879be167 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87151) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 05 20:59:33.872224 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba23be2-1b85-4753-b68e-1e72879be167 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:33.873881 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba23be2-1b85-4753-b68e-1e72879be167 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:33.886425 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1439/2885] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 5 20:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 05 20:59:33.890740 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72549c-146b-4905-b422-d5c16358d2e2 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:33.900396 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72549c-146b-4905-b422-d5c16358d2e2 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:33.906737 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc95c3-bbdc-4838-8d46-931945b0e4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:33.907377 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc95c3-bbdc-4838-8d46-931945b0e4ec admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:33.907661 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc95c3-bbdc-4838-8d46-931945b0e4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:33.907930 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc95c3-bbdc-4838-8d46-931945b0e4ec admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:33.908608 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc95c3-bbdc-4838-8d46-931945b0e4ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:33.910541 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc95c3-bbdc-4838-8d46-931945b0e4ec admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:33.939106 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1447/2886] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:59:33 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:59:33.943429 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba23be2-1b85-4753-b68e-1e72879be167 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:33.953892 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba23be2-1b85-4753-b68e-1e72879be167 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:34.017733 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd2e2e4-3f2e-4782-8e3d-1da9e1f8a2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:34.018433 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2e2e4-3f2e-4782-8e3d-1da9e1f8a2e3 admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:34.018717 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2e2e4-3f2e-4782-8e3d-1da9e1f8a2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:34.018991 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2e2e4-3f2e-4782-8e3d-1da9e1f8a2e3 admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:34.019677 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd2e2e4-3f2e-4782-8e3d-1da9e1f8a2e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:34.021637 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd2e2e4-3f2e-4782-8e3d-1da9e1f8a2e3 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:34.044495 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1440/2887] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:59:33 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:59:34.048852 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc95c3-bbdc-4838-8d46-931945b0e4ec admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:34.059473 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc95c3-bbdc-4838-8d46-931945b0e4ec admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:34.064544 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc069e-ac0f-42a8-9a98-a8e672b07867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:34.065193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc069e-ac0f-42a8-9a98-a8e672b07867 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:34.065469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc069e-ac0f-42a8-9a98-a8e672b07867 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:34.065738 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc069e-ac0f-42a8-9a98-a8e672b07867 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:34.066481 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc069e-ac0f-42a8-9a98-a8e672b07867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:34.068073 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc069e-ac0f-42a8-9a98-a8e672b07867 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:34.078737 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1448/2888] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:59:34.082703 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd2e2e4-3f2e-4782-8e3d-1da9e1f8a2e3 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:34.094478 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd2e2e4-3f2e-4782-8e3d-1da9e1f8a2e3 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:34.099529 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41280155-b210-4c48-b558-c3b530bf46a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:34.100187 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41280155-b210-4c48-b558-c3b530bf46a3 admin admin] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:34.100468 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41280155-b210-4c48-b558-c3b530bf46a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:34.100763 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41280155-b210-4c48-b558-c3b530bf46a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:34.101500 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41280155-b210-4c48-b558-c3b530bf46a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:34.103145 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41280155-b210-4c48-b558-c3b530bf46a3 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:34.113079 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1441/2889] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:59:34.117091 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc069e-ac0f-42a8-9a98-a8e672b07867 admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:34.127213 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc069e-ac0f-42a8-9a98-a8e672b07867 admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:34.132155 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2b1a0-6895-474a-a463-9307825da9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:34.133025 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2b1a0-6895-474a-a463-9307825da9ce admin admin] REQUEST_METHOD: `PUT` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:34.133296 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2b1a0-6895-474a-a463-9307825da9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:34.133562 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2b1a0-6895-474a-a463-9307825da9ce admin admin] PATH_INFO: `/v3/projects/9e269e6ae8c647ff83f7c6531912a393/users/70b8fc3a183a4861aff69d285701356c/roles/8dc2563a47c540cfa548eb210d02066e` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:34.148745 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f2b1a0-6895-474a-a463-9307825da9ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e269e6ae8c647ff83f7c6531912a393, user_id=70b8fc3a183a4861aff69d285701356c, role_id=8dc2563a47c540cfa548eb210d02066e)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:34.151901 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f2b1a0-6895-474a-a463-9307825da9ce admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:34.167353 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1449/2890] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:59:34 2022] PUT /identity/v3/projects/9e269e6ae8c647ff83f7c6531912a393/users/70b8fc3a183a4861aff69d285701356c/roles/8dc2563a47c540cfa548eb210d02066e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 05 20:59:34.172226 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132f998-a594-4902-8084-0d621fa5c14c None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:34.172506 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132f998-a594-4902-8084-0d621fa5c14c None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:34.172853 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132f998-a594-4902-8084-0d621fa5c14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:34.191154 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-9132f998-a594-4902-8084-0d621fa5c14c None None] MFA Rules not processed for user `0aa59f315d9f4ee3a1a7a51f7ef6b880`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:59:34.192380 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-9132f998-a594-4902-8084-0d621fa5c14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:34.253028 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1442/2891] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:59:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 05 20:59:34.262864 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2b1a0-6895-474a-a463-9307825da9ce admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:34.264802 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-22f2b1a0-6895-474a-a463-9307825da9ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:34.287406 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:34.325691 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2b1a0-6895-474a-a463-9307825da9ce admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:34.329889 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506346c-38b6-411e-b0d0-2f4c95887282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:34.330529 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506346c-38b6-411e-b0d0-2f4c95887282 service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:34.330788 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506346c-38b6-411e-b0d0-2f4c95887282 service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:34.331086 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506346c-38b6-411e-b0d0-2f4c95887282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:34.346592 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2506346c-38b6-411e-b0d0-2f4c95887282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:34.348722 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2506346c-38b6-411e-b0d0-2f4c95887282 service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:34.364557 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1450/2892] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:59:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:59:38.280150 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e99603-7b84-477b-9c65-f93a55f91489 None None] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:38.280680 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e99603-7b84-477b-9c65-f93a55f91489 None None] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:38.280792 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e99603-7b84-477b-9c65-f93a55f91489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:38.309363 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.auth.core [None req-c1e99603-7b84-477b-9c65-f93a55f91489 None None] MFA Rules not processed for user `70b8fc3a183a4861aff69d285701356c`. Rule list: `[]` (Enabled: `True`). {{(pid=87151) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:59:38.310635 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-c1e99603-7b84-477b-9c65-f93a55f91489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:38.330534 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:38.390592 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1443/2893] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:59:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:59:38.395220 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506346c-38b6-411e-b0d0-2f4c95887282 service neutron] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:38.405832 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506346c-38b6-411e-b0d0-2f4c95887282 service neutron] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:38.410441 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbdc603-20af-452b-9cf1-7691cc3ad44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:38.411131 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbdc603-20af-452b-9cf1-7691cc3ad44e admin admin] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:38.411383 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbdc603-20af-452b-9cf1-7691cc3ad44e admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:38.411658 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbdc603-20af-452b-9cf1-7691cc3ad44e admin admin] PATH_INFO: `/v3/projects` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:38.412345 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbdc603-20af-452b-9cf1-7691cc3ad44e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:38.414314 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbdc603-20af-452b-9cf1-7691cc3ad44e admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:38.443282 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1451/2894] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 5 20:59:38 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:59:38.447380 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e99603-7b84-477b-9c65-f93a55f91489 None None] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:38.461468 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e99603-7b84-477b-9c65-f93a55f91489 None None] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:38.521039 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f63b5-6258-41e6-bc37-4ef754badabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:38.521732 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f63b5-6258-41e6-bc37-4ef754badabc admin admin] REQUEST_METHOD: `POST` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:38.522059 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f63b5-6258-41e6-bc37-4ef754badabc admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:38.522318 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f63b5-6258-41e6-bc37-4ef754badabc admin admin] PATH_INFO: `/v3/users` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:38.523011 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f63b5-6258-41e6-bc37-4ef754badabc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:38.525015 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f63b5-6258-41e6-bc37-4ef754badabc admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:38.547229 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1444/2895] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 5 20:59:38 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 05 20:59:38.551560 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbdc603-20af-452b-9cf1-7691cc3ad44e admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:38.562431 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbdc603-20af-452b-9cf1-7691cc3ad44e admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:38.567118 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29181724-7b31-4c5c-82b1-c01423aeb78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:38.567794 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29181724-7b31-4c5c-82b1-c01423aeb78d admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:38.568079 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29181724-7b31-4c5c-82b1-c01423aeb78d admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:38.568353 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29181724-7b31-4c5c-82b1-c01423aeb78d admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:38.569085 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29181724-7b31-4c5c-82b1-c01423aeb78d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:38.570747 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29181724-7b31-4c5c-82b1-c01423aeb78d admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:38.583413 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1452/2896] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:59:38.588131 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f63b5-6258-41e6-bc37-4ef754badabc admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:38.599560 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f63b5-6258-41e6-bc37-4ef754badabc admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:38.604477 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bbbc00-fdd0-4674-98a1-9132ddb70f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:38.605422 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbbc00-fdd0-4674-98a1-9132ddb70f1c admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:38.605701 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbbc00-fdd0-4674-98a1-9132ddb70f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:38.606001 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbbc00-fdd0-4674-98a1-9132ddb70f1c admin admin] PATH_INFO: `/v3/projects/2c1761f9da314ac58bcae77fad4c4d62/users/1244fc4c747142a4afbb5d7935138cc1/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:38.622019 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bbbc00-fdd0-4674-98a1-9132ddb70f1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c1761f9da314ac58bcae77fad4c4d62, user_id=1244fc4c747142a4afbb5d7935138cc1, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:38.624766 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bbbc00-fdd0-4674-98a1-9132ddb70f1c admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:38.638780 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1445/2897] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:59:38 2022] PUT /identity/v3/projects/2c1761f9da314ac58bcae77fad4c4d62/users/1244fc4c747142a4afbb5d7935138cc1/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:59:38.642929 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29181724-7b31-4c5c-82b1-c01423aeb78d admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:38.653697 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29181724-7b31-4c5c-82b1-c01423aeb78d admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:38.711234 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177ace8-17b0-4d80-946e-fa27ab38be46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:38.712270 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177ace8-17b0-4d80-946e-fa27ab38be46 admin admin] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:38.712270 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177ace8-17b0-4d80-946e-fa27ab38be46 admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:38.712450 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177ace8-17b0-4d80-946e-fa27ab38be46 admin admin] PATH_INFO: `/v3/roles` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:38.713178 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1177ace8-17b0-4d80-946e-fa27ab38be46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:38.714933 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1177ace8-17b0-4d80-946e-fa27ab38be46 admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:38.726130 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1453/2898] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 5 20:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 05 20:59:38.730798 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bbbc00-fdd0-4674-98a1-9132ddb70f1c admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:38.741687 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bbbc00-fdd0-4674-98a1-9132ddb70f1c admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:38.747444 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69625e5-ab65-424d-9b61-06847b8add02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:38.748391 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69625e5-ab65-424d-9b61-06847b8add02 admin admin] REQUEST_METHOD: `PUT` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:38.748671 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69625e5-ab65-424d-9b61-06847b8add02 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:38.748943 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69625e5-ab65-424d-9b61-06847b8add02 admin admin] PATH_INFO: `/v3/projects/2c1761f9da314ac58bcae77fad4c4d62/users/1244fc4c747142a4afbb5d7935138cc1/roles/37ba4a62052348d4811b560c19a07e02` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:38.751036 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69625e5-ab65-424d-9b61-06847b8add02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c1761f9da314ac58bcae77fad4c4d62, user_id=1244fc4c747142a4afbb5d7935138cc1, role_id=37ba4a62052348d4811b560c19a07e02)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:38.753799 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69625e5-ab65-424d-9b61-06847b8add02 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:38.764910 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1446/2899] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 5 20:59:38 2022] PUT /identity/v3/projects/2c1761f9da314ac58bcae77fad4c4d62/users/1244fc4c747142a4afbb5d7935138cc1/roles/37ba4a62052348d4811b560c19a07e02 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 20:59:43.467770 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22aadcc-e057-41b9-a9f7-72cb333ac554 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:43.468567 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22aadcc-e057-41b9-a9f7-72cb333ac554 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:43.469002 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22aadcc-e057-41b9-a9f7-72cb333ac554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:43.498885 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-f22aadcc-e057-41b9-a9f7-72cb333ac554 None None] MFA Rules not processed for user `1244fc4c747142a4afbb5d7935138cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:59:43.501375 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-f22aadcc-e057-41b9-a9f7-72cb333ac554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:43.591303 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1454/2900] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:59:43 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:59:43.609461 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69625e5-ab65-424d-9b61-06847b8add02 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:43.611524 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-d69625e5-ab65-424d-9b61-06847b8add02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:43.703043 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69625e5-ab65-424d-9b61-06847b8add02 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:43.709130 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c92c7-55f7-412b-85e9-d1eb6bc92bf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:43.709776 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c92c7-55f7-412b-85e9-d1eb6bc92bf6 service nova] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:43.710393 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c92c7-55f7-412b-85e9-d1eb6bc92bf6 service nova] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:43.710671 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c92c7-55f7-412b-85e9-d1eb6bc92bf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:43.716751 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:43.794155 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c92c7-55f7-412b-85e9-d1eb6bc92bf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:43.796021 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7c92c7-55f7-412b-85e9-d1eb6bc92bf6 service nova] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:43.807682 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1447/2901] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:59:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:59:44.801747 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e82e36-916f-40a8-bb6a-713f34783c03 None None] REQUEST_METHOD: `POST` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:44.802302 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e82e36-916f-40a8-bb6a-713f34783c03 None None] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:44.802403 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e82e36-916f-40a8-bb6a-713f34783c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:44.821613 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.auth.core [None req-b1e82e36-916f-40a8-bb6a-713f34783c03 None None] MFA Rules not processed for user `70b8fc3a183a4861aff69d285701356c`. Rule list: `[]` (Enabled: `True`). {{(pid=87152) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 05 20:59:44.822850 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-b1e82e36-916f-40a8-bb6a-713f34783c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:44.830808 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1455/2902] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 5 20:59:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 05 20:59:53.802434 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=24 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:54.815897 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=97,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 20:59:58.148084 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c92c7-55f7-412b-85e9-d1eb6bc92bf6 service nova] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:58.149703 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-fc7c92c7-55f7-412b-85e9-d1eb6bc92bf6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:58.209475 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c92c7-55f7-412b-85e9-d1eb6bc92bf6 service nova] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:58.213701 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3a8e0-654f-4a4a-b516-b60c42f95f68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2141561d059043baa440e966a5e1c6cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:58.214389 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3a8e0-654f-4a4a-b516-b60c42f95f68 service cinder] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:58.214668 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3a8e0-654f-4a4a-b516-b60c42f95f68 service cinder] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:58.214946 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3a8e0-654f-4a4a-b516-b60c42f95f68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:58.217072 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-95e3a8e0-654f-4a4a-b516-b60c42f95f68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:58.231147 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3a8e0-654f-4a4a-b516-b60c42f95f68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:58.232587 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3a8e0-654f-4a4a-b516-b60c42f95f68 service cinder] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:58.243742 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1448/2903] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:59:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:59:58.547817 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e82e36-916f-40a8-bb6a-713f34783c03 None None] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:58.612928 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e82e36-916f-40a8-bb6a-713f34783c03 None None] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:58.617331 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886dbfc-e3a5-4d15-9a01-239eb7fceb02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:58.618003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886dbfc-e3a5-4d15-9a01-239eb7fceb02 service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:58.618291 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886dbfc-e3a5-4d15-9a01-239eb7fceb02 service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:58.618571 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886dbfc-e3a5-4d15-9a01-239eb7fceb02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:58.620587 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-1886dbfc-e3a5-4d15-9a01-239eb7fceb02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:58.630659 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886dbfc-e3a5-4d15-9a01-239eb7fceb02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:58.632091 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886dbfc-e3a5-4d15-9a01-239eb7fceb02 service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:58.640974 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1456/2904] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:59:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 20:59:59.105300 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3a8e0-654f-4a4a-b516-b60c42f95f68 service cinder] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:59.106964 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-95e3a8e0-654f-4a4a-b516-b60c42f95f68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:59.121790 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886dbfc-e3a5-4d15-9a01-239eb7fceb02 service neutron] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 20:59:59.123703 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-1886dbfc-e3a5-4d15-9a01-239eb7fceb02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:59.134160 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886dbfc-e3a5-4d15-9a01-239eb7fceb02 service neutron] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:59.137702 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca92363-5682-4e0f-bedb-3e3e65405d06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:59.138412 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca92363-5682-4e0f-bedb-3e3e65405d06 service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:59.139200 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca92363-5682-4e0f-bedb-3e3e65405d06 service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:59.139510 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca92363-5682-4e0f-bedb-3e3e65405d06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:59.141307 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-1ca92363-5682-4e0f-bedb-3e3e65405d06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:59.157410 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca92363-5682-4e0f-bedb-3e3e65405d06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:59.158904 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca92363-5682-4e0f-bedb-3e3e65405d06 service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:59.170180 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1457/2905] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:59:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 20:59:59.185287 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3a8e0-654f-4a4a-b516-b60c42f95f68 service cinder] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 20:59:59.190877 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f921aa-d8d1-41f8-abc7-002ef51cf175 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16662dd5e2e74163b6aa2e1e7ef07524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 20:59:59.191592 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f921aa-d8d1-41f8-abc7-002ef51cf175 service placement] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 20:59:59.191858 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f921aa-d8d1-41f8-abc7-002ef51cf175 service placement] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 20:59:59.192149 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f921aa-d8d1-41f8-abc7-002ef51cf175 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 20:59:59.194112 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-26f921aa-d8d1-41f8-abc7-002ef51cf175 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 20:59:59.206465 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f921aa-d8d1-41f8-abc7-002ef51cf175 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 20:59:59.208061 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f921aa-d8d1-41f8-abc7-002ef51cf175 service placement] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 20:59:59.218727 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1449/2906] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 20:59:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:00:01.017513 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca92363-5682-4e0f-bedb-3e3e65405d06 service neutron] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:01.027714 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca92363-5682-4e0f-bedb-3e3e65405d06 service neutron] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:01.031550 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730f90f-b343-4cca-811a-3602e433b782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:01.032210 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730f90f-b343-4cca-811a-3602e433b782 service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:01.032496 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730f90f-b343-4cca-811a-3602e433b782 service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:01.032775 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730f90f-b343-4cca-811a-3602e433b782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:01.034590 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-5730f90f-b343-4cca-811a-3602e433b782 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:01.045078 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730f90f-b343-4cca-811a-3602e433b782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:01.047438 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730f90f-b343-4cca-811a-3602e433b782 service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:01.055881 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1458/2907] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 21:00:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:00:01.694234 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f921aa-d8d1-41f8-abc7-002ef51cf175 service placement] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:01.696093 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-26f921aa-d8d1-41f8-abc7-002ef51cf175 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:01.720234 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f921aa-d8d1-41f8-abc7-002ef51cf175 service placement] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:01.727227 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88072240-04a0-4258-8c41-249846ce2b34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:01.727819 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88072240-04a0-4258-8c41-249846ce2b34 service nova] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:01.728172 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88072240-04a0-4258-8c41-249846ce2b34 service nova] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:01.728553 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88072240-04a0-4258-8c41-249846ce2b34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:01.730845 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-88072240-04a0-4258-8c41-249846ce2b34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:01.745826 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88072240-04a0-4258-8c41-249846ce2b34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:01.747525 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88072240-04a0-4258-8c41-249846ce2b34 service nova] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:01.759556 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1450/2908] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 21:00:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 05 21:00:07.969744 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730f90f-b343-4cca-811a-3602e433b782 service neutron] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:07.984761 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730f90f-b343-4cca-811a-3602e433b782 service neutron] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:07.990900 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3335390-7bcb-4516-a6a6-4b72adb92c3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '814b675b98b844a2a12a39890ee69d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:07.991557 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3335390-7bcb-4516-a6a6-4b72adb92c3f service nova] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:07.991872 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3335390-7bcb-4516-a6a6-4b72adb92c3f service nova] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:07.992146 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3335390-7bcb-4516-a6a6-4b72adb92c3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:07.994000 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-c3335390-7bcb-4516-a6a6-4b72adb92c3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:00:08.007590 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3335390-7bcb-4516-a6a6-4b72adb92c3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:08.009198 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3335390-7bcb-4516-a6a6-4b72adb92c3f service nova] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:08.020923 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1459/2909] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 21:00:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:00:09.962062 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88072240-04a0-4258-8c41-249846ce2b34 service nova] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:00:09.972011 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88072240-04a0-4258-8c41-249846ce2b34 service nova] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:00:09.976332 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb1e93-1058-4676-9a69-026cae16f160 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:00:09.976974 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb1e93-1058-4676-9a69-026cae16f160 service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:00:09.977254 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb1e93-1058-4676-9a69-026cae16f160 service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:00:09.977526 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb1e93-1058-4676-9a69-026cae16f160 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:00:09.987612 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbb1e93-1058-4676-9a69-026cae16f160 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:00:09.989064 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbb1e93-1058-4676-9a69-026cae16f160 service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:00:09.999039 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1451/2910] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 21:00:09 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:00:18.015970 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=44 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:00:19.994691 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=70 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:02:21.497727 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3335390-7bcb-4516-a6a6-4b72adb92c3f service nova] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:02:21.539003 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3335390-7bcb-4516-a6a6-4b72adb92c3f service nova] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:02:21.542785 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff5370-d4be-43ae-ad24-4ea10a24439b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:02:21.543432 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff5370-d4be-43ae-ad24-4ea10a24439b service neutron] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:02:21.543712 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff5370-d4be-43ae-ad24-4ea10a24439b service neutron] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:02:21.543986 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff5370-d4be-43ae-ad24-4ea10a24439b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:02:21.545772 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-67ff5370-d4be-43ae-ad24-4ea10a24439b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:02:21.577578 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff5370-d4be-43ae-ad24-4ea10a24439b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:02:21.579055 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff5370-d4be-43ae-ad24-4ea10a24439b service neutron] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:02:21.587505 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1460/2911] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 21:02:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:02:21.682473 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb1e93-1058-4676-9a69-026cae16f160 service neutron] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:02:21.711674 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb1e93-1058-4676-9a69-026cae16f160 service neutron] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:02:21.715546 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c88b3-f579-4ad0-9fb5-a66e7c38049f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '157a258bcff642cb91a0a474f8f50941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:02:21.716189 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c88b3-f579-4ad0-9fb5-a66e7c38049f service neutron] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:02:21.716464 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c88b3-f579-4ad0-9fb5-a66e7c38049f service neutron] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:02:21.716736 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c88b3-f579-4ad0-9fb5-a66e7c38049f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:02:21.718601 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-938c88b3-f579-4ad0-9fb5-a66e7c38049f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:02:21.774127 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c88b3-f579-4ad0-9fb5-a66e7c38049f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:02:21.775590 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c88b3-f579-4ad0-9fb5-a66e7c38049f service neutron] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:02:21.796917 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1452/2912] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 21:02:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:02:31.583909 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=27 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:02:31.794412 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=36 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:02:48.663214 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff5370-d4be-43ae-ad24-4ea10a24439b service neutron] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:02:48.664734 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-67ff5370-d4be-43ae-ad24-4ea10a24439b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:02:48.702154 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff5370-d4be-43ae-ad24-4ea10a24439b service neutron] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:02:48.709531 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ed074-de89-40c7-b617-5fed2cb2e384 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16662dd5e2e74163b6aa2e1e7ef07524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:02:48.710527 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ed074-de89-40c7-b617-5fed2cb2e384 service placement] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:02:48.710866 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ed074-de89-40c7-b617-5fed2cb2e384 service placement] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:02:48.711203 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ed074-de89-40c7-b617-5fed2cb2e384 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:02:48.713713 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-fd3ed074-de89-40c7-b617-5fed2cb2e384 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:02:48.732469 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ed074-de89-40c7-b617-5fed2cb2e384 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:02:48.734113 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ed074-de89-40c7-b617-5fed2cb2e384 service placement] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:02:48.744526 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1461/2913] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 21:02:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:02:58.740431 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=15 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:03:43.572069 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c88b3-f579-4ad0-9fb5-a66e7c38049f service neutron] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:03:43.588197 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c88b3-f579-4ad0-9fb5-a66e7c38049f service neutron] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:03:43.609715 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909fad41-365d-4950-a6c3-130a58a86928 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16662dd5e2e74163b6aa2e1e7ef07524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:03:43.610504 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fad41-365d-4950-a6c3-130a58a86928 service placement] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:03:43.610787 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fad41-365d-4950-a6c3-130a58a86928 service placement] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:03:43.611062 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fad41-365d-4950-a6c3-130a58a86928 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:03:43.612927 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-909fad41-365d-4950-a6c3-130a58a86928 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:03:43.625418 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909fad41-365d-4950-a6c3-130a58a86928 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:03:43.627188 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909fad41-365d-4950-a6c3-130a58a86928 service placement] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:03:43.638565 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1453/2914] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 21:03:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:03:46.741484 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ed074-de89-40c7-b617-5fed2cb2e384 service placement] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:03:46.755143 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ed074-de89-40c7-b617-5fed2cb2e384 service placement] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:03:46.761489 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06f0d6-8564-46f0-b39c-6cc3a7c8776d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16662dd5e2e74163b6aa2e1e7ef07524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:03:46.762307 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06f0d6-8564-46f0-b39c-6cc3a7c8776d service placement] REQUEST_METHOD: `GET` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:03:46.762656 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06f0d6-8564-46f0-b39c-6cc3a7c8776d service placement] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:03:46.763027 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06f0d6-8564-46f0-b39c-6cc3a7c8776d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:03:46.765056 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-eb06f0d6-8564-46f0-b39c-6cc3a7c8776d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:03:46.780293 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb06f0d6-8564-46f0-b39c-6cc3a7c8776d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:03:46.783137 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb06f0d6-8564-46f0-b39c-6cc3a7c8776d service placement] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:03:46.795343 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1462/2915] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 21:03:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:03:46.807179 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909fad41-365d-4950-a6c3-130a58a86928 service placement] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:03:46.891407 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909fad41-365d-4950-a6c3-130a58a86928 service placement] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:03:46.895916 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e6bcdd-f999-4219-966a-531c3d73fdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:03:46.896792 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6bcdd-f999-4219-966a-531c3d73fdb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:03:46.897066 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6bcdd-f999-4219-966a-531c3d73fdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:03:46.897336 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e6bcdd-f999-4219-966a-531c3d73fdb7 admin admin] PATH_INFO: `/v3/users/70b8fc3a183a4861aff69d285701356c` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:03:46.898496 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e6bcdd-f999-4219-966a-531c3d73fdb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70b8fc3a183a4861aff69d285701356c)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:03:46.900459 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e6bcdd-f999-4219-966a-531c3d73fdb7 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:03:46.947681 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-42e6bcdd-f999-4219-966a-531c3d73fdb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70b8fc3a183a4861aff69d285701356c'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:03:46.954730 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-42e6bcdd-f999-4219-966a-531c3d73fdb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70b8fc3a183a4861aff69d285701356c'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:03:46.967406 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-42e6bcdd-f999-4219-966a-531c3d73fdb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70b8fc3a183a4861aff69d285701356c'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:03:46.968192 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-42e6bcdd-f999-4219-966a-531c3d73fdb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70b8fc3a183a4861aff69d285701356c'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:03:46.968933 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-42e6bcdd-f999-4219-966a-531c3d73fdb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70b8fc3a183a4861aff69d285701356c'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:03:46.982948 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1454/2916] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 21:03:46 2022] DELETE /identity/v3/users/70b8fc3a183a4861aff69d285701356c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:03:47.176560 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06f0d6-8564-46f0-b39c-6cc3a7c8776d service placement] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:03:47.187928 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06f0d6-8564-46f0-b39c-6cc3a7c8776d service placement] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:03:47.247412 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fffc3a-a588-47f1-821f-bc2a24f3005e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:03:47.248298 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fffc3a-a588-47f1-821f-bc2a24f3005e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:03:47.248572 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fffc3a-a588-47f1-821f-bc2a24f3005e admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:03:47.248839 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fffc3a-a588-47f1-821f-bc2a24f3005e admin admin] PATH_INFO: `/v3/projects/9e269e6ae8c647ff83f7c6531912a393` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:03:47.250101 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fffc3a-a588-47f1-821f-bc2a24f3005e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e269e6ae8c647ff83f7c6531912a393)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:03:47.252014 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fffc3a-a588-47f1-821f-bc2a24f3005e admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:03:47.299860 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-01fffc3a-a588-47f1-821f-bc2a24f3005e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e269e6ae8c647ff83f7c6531912a393', 'request_id': 'req-01fffc3a-a588-47f1-821f-bc2a24f3005e'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:03:47.305260 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-01fffc3a-a588-47f1-821f-bc2a24f3005e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e269e6ae8c647ff83f7c6531912a393', 'request_id': 'req-01fffc3a-a588-47f1-821f-bc2a24f3005e'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:03:47.315036 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-01fffc3a-a588-47f1-821f-bc2a24f3005e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e269e6ae8c647ff83f7c6531912a393', 'request_id': 'req-01fffc3a-a588-47f1-821f-bc2a24f3005e'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:03:47.338193 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-01fffc3a-a588-47f1-821f-bc2a24f3005e admin admin] The token cache is being invalidate because project 9e269e6ae8c647ff83f7c6531912a393 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:03:47.338481 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-01fffc3a-a588-47f1-821f-bc2a24f3005e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:03:47.339288 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-01fffc3a-a588-47f1-821f-bc2a24f3005e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:03:47.340936 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1463/2917] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 21:03:47 2022] DELETE /identity/v3/projects/9e269e6ae8c647ff83f7c6531912a393 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:03:47.345125 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e6bcdd-f999-4219-966a-531c3d73fdb7 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:03:47.346602 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-42e6bcdd-f999-4219-966a-531c3d73fdb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:03:47.360485 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e6bcdd-f999-4219-966a-531c3d73fdb7 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:03:47.410317 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:03:47.425977 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4b57e-57c4-408e-9013-e1ed1c0b1425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:03:47.427641 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4b57e-57c4-408e-9013-e1ed1c0b1425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:03:47.427641 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4b57e-57c4-408e-9013-e1ed1c0b1425 admin admin] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:03:47.427641 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4b57e-57c4-408e-9013-e1ed1c0b1425 admin admin] PATH_INFO: `/v3/users/1244fc4c747142a4afbb5d7935138cc1` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:03:47.428734 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4b57e-57c4-408e-9013-e1ed1c0b1425 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1244fc4c747142a4afbb5d7935138cc1)` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:03:47.430701 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4b57e-57c4-408e-9013-e1ed1c0b1425 admin admin] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:03:47.484135 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-94a4b57e-57c4-408e-9013-e1ed1c0b1425 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1244fc4c747142a4afbb5d7935138cc1'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:03:47.491152 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-94a4b57e-57c4-408e-9013-e1ed1c0b1425 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1244fc4c747142a4afbb5d7935138cc1'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:03:47.504725 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-94a4b57e-57c4-408e-9013-e1ed1c0b1425 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1244fc4c747142a4afbb5d7935138cc1'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:03:47.506115 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-94a4b57e-57c4-408e-9013-e1ed1c0b1425 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1244fc4c747142a4afbb5d7935138cc1'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:03:47.506732 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.notifications [None req-94a4b57e-57c4-408e-9013-e1ed1c0b1425 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1244fc4c747142a4afbb5d7935138cc1'} {{(pid=87151) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:03:47.521676 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1455/2918] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 5 21:03:47 2022] DELETE /identity/v3/users/1244fc4c747142a4afbb5d7935138cc1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:03:47.709358 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fffc3a-a588-47f1-821f-bc2a24f3005e admin admin] Authenticating user token {{(pid=87152) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:03:47.710981 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.fernet_utils [None req-01fffc3a-a588-47f1-821f-bc2a24f3005e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87152) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:03:47.726216 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fffc3a-a588-47f1-821f-bc2a24f3005e admin admin] Validating token access rules against request {{(pid=87152) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:03:47.782874 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed20e4e-13c2-4783-97eb-61093aac1ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0aa59f315d9f4ee3a1a7a51f7ef6b880', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2d267a59c9249019ee131b3dae58a6e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87152) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:03:47.783772 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed20e4e-13c2-4783-97eb-61093aac1ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:03:47.784050 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed20e4e-13c2-4783-97eb-61093aac1ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:03:47.784295 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed20e4e-13c2-4783-97eb-61093aac1ddd admin admin] PATH_INFO: `/v3/projects/2c1761f9da314ac58bcae77fad4c4d62` {{(pid=87152) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:03:47.785529 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed20e4e-13c2-4783-97eb-61093aac1ddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c1761f9da314ac58bcae77fad4c4d62)` {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:03:47.787489 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed20e4e-13c2-4783-97eb-61093aac1ddd admin admin] RBAC: Authorization granted {{(pid=87152) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:03:47.795588 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:03:47.838108 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-fed20e4e-13c2-4783-97eb-61093aac1ddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c1761f9da314ac58bcae77fad4c4d62', 'request_id': 'req-fed20e4e-13c2-4783-97eb-61093aac1ddd'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:03:47.843776 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-fed20e4e-13c2-4783-97eb-61093aac1ddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c1761f9da314ac58bcae77fad4c4d62', 'request_id': 'req-fed20e4e-13c2-4783-97eb-61093aac1ddd'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:03:47.852476 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-fed20e4e-13c2-4783-97eb-61093aac1ddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c1761f9da314ac58bcae77fad4c4d62', 'request_id': 'req-fed20e4e-13c2-4783-97eb-61093aac1ddd'} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:03:47.863755 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-fed20e4e-13c2-4783-97eb-61093aac1ddd admin admin] The token cache is being invalidate because project 2c1761f9da314ac58bcae77fad4c4d62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87152) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 05 21:03:47.864042 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-fed20e4e-13c2-4783-97eb-61093aac1ddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:03:47.864695 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG keystone.notifications [None req-fed20e4e-13c2-4783-97eb-61093aac1ddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87152) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 05 21:03:47.866492 dv-cinder-797608-49-smb devstack@keystone.service[87152]: [pid: 87152|app: 0|req: 1464/2919] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 5 21:03:47 2022] DELETE /identity/v3/projects/2c1761f9da314ac58bcae77fad4c4d62 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 05 21:03:57.517134 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=31,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:03:57.861023 dv-cinder-797608-49-smb devstack@keystone.service[87152]: DEBUG dbcounter [-] [87152] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87152) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 05 21:07:54.640015 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4b57e-57c4-408e-9013-e1ed1c0b1425 admin admin] Authenticating user token {{(pid=87151) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 05 21:07:54.641689 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-94a4b57e-57c4-408e-9013-e1ed1c0b1425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:54.715899 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4b57e-57c4-408e-9013-e1ed1c0b1425 admin admin] Validating token access rules against request {{(pid=87151) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 05 21:07:54.779654 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57ffb5-d702-4dc6-9f2b-978dcaab35ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16662dd5e2e74163b6aa2e1e7ef07524', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b321588ec1f14bcb94a184310cf72856', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87151) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 05 21:07:54.780307 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57ffb5-d702-4dc6-9f2b-978dcaab35ff service placement] REQUEST_METHOD: `GET` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 05 21:07:54.780598 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57ffb5-d702-4dc6-9f2b-978dcaab35ff service placement] SCRIPT_NAME: `/identity` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 05 21:07:54.780870 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57ffb5-d702-4dc6-9f2b-978dcaab35ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87151) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 05 21:07:54.783380 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.fernet_utils [None req-3b57ffb5-d702-4dc6-9f2b-978dcaab35ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87151) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 05 21:07:54.795666 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57ffb5-d702-4dc6-9f2b-978dcaab35ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 05 21:07:54.797279 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57ffb5-d702-4dc6-9f2b-978dcaab35ff service placement] RBAC: Authorization granted {{(pid=87151) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 05 21:07:54.807637 dv-cinder-797608-49-smb devstack@keystone.service[87151]: [pid: 87151|app: 0|req: 1456/2920] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 5 21:07:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 05 21:08:04.803369 dv-cinder-797608-49-smb devstack@keystone.service[87151]: DEBUG dbcounter [-] [87151] Writing DB stats keystone:SELECT=58 {{(pid=87151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}